Jul 21 00:39:05.928450 ip-10-0-138-241 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 00:39:05.928460 ip-10-0-138-241 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 00:39:05.928466 ip-10-0-138-241 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 00:39:05.928699 ip-10-0-138-241 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 00:39:16.008292 ip-10-0-138-241 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 00:39:16.008312 ip-10-0-138-241 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5604d993c1a940f5ada8fffc9c50459d --
Jul 21 00:40:56.209064 ip-10-0-138-241 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.619724    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624941    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624953    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624956    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624960    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624963    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624966    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624969    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:40:56.696841 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624972    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:40:56.689806 ip-10-0-138-241 systemd[1]: Started Kubernetes Kubelet.
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624976    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624979    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624982    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624985    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624994    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.624997    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625000    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625002    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625005    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625007    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625011    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625014    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625017    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625019    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625022    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625025    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625028    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625031    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625034    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:40:56.969820 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625036    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625039    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625041    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625044    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625047    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625050    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625053    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625055    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625058    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625060    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625063    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625066    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625068    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625071    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625074    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625078    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625082    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625085    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625088    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:40:56.978285 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625091    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625093    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625096    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625099    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625102    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625104    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625107    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625109    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625112    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625114    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625117    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625120    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625125    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625129    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625132    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625135    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625138    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625141    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625143    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:40:56.979576 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625146    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625148    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625151    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625153    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625156    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625158    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625161    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625163    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625166    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625168    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625171    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625173    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625176    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625179    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625181    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625184    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625186    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625189    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625191    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:40:56.981238 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625194    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625196    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625200    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625203    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625205    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625208    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625210    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625213    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625215    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625219    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625222    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625224    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625227    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625229    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625232    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625949    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625956    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625961    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625965    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625968    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:40:56.983893 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625970    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625973    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625976    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625979    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625982    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625984    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625988    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625991    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625993    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625996    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.625999    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626001    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626004    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626006    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626009    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626011    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626014    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626016    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626019    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626021    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:40:56.985236 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626025    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626027    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626030    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626033    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626035    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626037    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626040    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626042    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626045    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626047    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626050    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626053    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626056    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626058    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626061    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626064    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626067    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626069    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626072    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626075    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:40:56.988666 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626077    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626080    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626083    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626085    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626088    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626091    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626094    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626096    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626099    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626102    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626110    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626113    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626116    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626118    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626121    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626123    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626126    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626130    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626141    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:40:56.989751 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626145    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626148    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626151    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626154    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626157    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626160    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626163    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626166    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626169    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626172    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626175    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626177    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626180    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626183    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626186    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626190    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626192    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626195    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626199    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:40:56.992629 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626203    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626206    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626209    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626212    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626215    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626217    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626220    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626223    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626226    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626228    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626231    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626233    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626236    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626238    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626241    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626243    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626696    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626702    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626705    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626708    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:40:56.993811 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626711    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626715    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626717    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626720    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626724    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626728    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626745    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626748    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626750    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626753    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626756    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626758    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626762    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626766    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626784    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626788    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626791    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626794    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626798    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:40:56.995281 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626800    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626803    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626806    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626809    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626811    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626814    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626817    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626819    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626822    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626824    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626827    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626829    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626832    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626835    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626837    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626839    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626842    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626844    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626847    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626851    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:40:56.996105 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626859    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626862    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626865    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626867    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626870    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626873    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626876    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626879    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626881    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626885    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626887    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626890    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626892    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626895    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626898    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626900    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626903    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626905    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626907    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626910    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:40:56.998431 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626912    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626915    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626917    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626920    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626922    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626925    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626927    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626931    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626934    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626936    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626940    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626943    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626946    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626954    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626957    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626960    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626962    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626967    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626969    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:40:57.000217 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626972    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626974    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626977    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626979    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626981    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626984    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626986    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626989    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626991    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626993    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626996    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.626998    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627001    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627003    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627006    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627008    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627010    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627081    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627091    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627103    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627110    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 00:40:57.002095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627116    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627120    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627124    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627129    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627133    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627136    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627150    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627153    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627156    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627164    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627167    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627170    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627172    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627176    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627183    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627186    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627189    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627192    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627195    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627198    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627202    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627204    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627208    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627211    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 00:40:57.003583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627214    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627217    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627220    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627223    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627235    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627238    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627241    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627244    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627247    2560 flags.go:64] FLAG: --enable-server="true"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627250    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627257    2560 flags.go:64] FLAG: --event-burst="100"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627262    2560 flags.go:64] FLAG: --event-qps="50"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627265    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627268    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627271    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627280    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627283    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627287    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627290    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627293    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627296    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627299    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627302    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627305    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627308    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 00:40:57.004684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627311    2560 flags.go:64] FLAG: --feature-gates=""
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627315    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627318    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627321    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627324    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627327    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627330    2560 flags.go:64] FLAG: --help="false"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627332    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627335    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627339    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627341    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627344    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627348    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627351    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627356    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627359    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627362    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627364    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627369    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627372    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627375    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627378    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627381    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627389    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 00:40:57.006226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627393    2560 flags.go:64] FLAG: --lock-file=""
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627396    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627399    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627402    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627407    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627410    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627413    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627416    2560 flags.go:64] FLAG: --logging-format="text"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627419    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627422    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627425    2560 flags.go:64] FLAG: --manifest-url=""
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627428    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627432    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627435    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627439    2560 flags.go:64] FLAG: --max-pods="110"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627442    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627445    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627448    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627451    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627454    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627457    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627460    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627467    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627469    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627472    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 00:40:57.007259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627475    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627479    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627485    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627488    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627491    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627494    2560 flags.go:64] FLAG: --port="10250"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627497    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627507    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03f2b5bee74ec0861"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627510    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627513    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627516    2560 flags.go:64] FLAG: --register-node="true"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627519    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627522    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627525    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627528    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627531    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627534    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627538    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627541    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627543    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627546    2560 flags.go:64] FLAG: --runonce="false"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627549    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627552    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627555    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627558    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 00:40:57.008364 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627561    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627564    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627567    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627570    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627573    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627576    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627578    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627581    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627584    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627588    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627591    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627596    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627599    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627602    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627610    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627624    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627627    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627630    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627633    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627636    2560 flags.go:64] FLAG: --v="2"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627645    2560 flags.go:64] FLAG: --version="false"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627649    2560 flags.go:64] FLAG: --vmodule=""
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627653    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.627656    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627817    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:40:57.011504 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627822    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627825    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627830    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627833    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627836    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627839    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627841    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627844    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627848    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627851    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627854    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627857    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627860    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627862    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627865    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627867    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627872    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627874    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627877    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:40:57.012458 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627880    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627882    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627886    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627889    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627896    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627899    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627902    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627904    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627907    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627909    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627912    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627914    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627917    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627919    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627922    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627924    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627927    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627929    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627932    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627934    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:40:57.016534 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627937    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627939    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627942    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627944    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627947    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627949    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627951    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627954    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627956    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627961    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627963    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627966    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627968    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627971    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627975    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627978    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627981    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627989    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627991    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627994    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:40:57.017156 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627997    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.627999    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628002    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628005    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628007    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628010    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628013    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628015    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628018    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628020    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628023    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628025    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628027    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628030    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628032    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628035    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628037    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628040    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628042    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628045    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:40:57.017707 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628053    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628057    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628059    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628062    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628064    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628067    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628070    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628073    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628076    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628078    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628082    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628085    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628087    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628090    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628093    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628095    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628099    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628102    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:40:57.018314 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.628105    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.628806    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.638185    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.638199    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.638218    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.638228    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638282    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638287    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638290    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638294    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638297    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638299    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638302    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638304    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638307    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:40:57.018803 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638310    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638313    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638316    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638318    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638321    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638324    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638327    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638330    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638333    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638336    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638339    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638341    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638344    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638347    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638350    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638353    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638356    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638358    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638361    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:40:57.019258 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638363    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638365    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638368    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638371    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638374    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638376    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638379    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638382    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638384    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638388    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638392    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638394    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638397    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638400    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638402    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638405    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638408    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638410    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638413    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638416    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:40:57.019769 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638419    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638422    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638424    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638427    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638430    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638432    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638435    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638439    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638442    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638445    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638447    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638450    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638452    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638455    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638457    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638460    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638463    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638465    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638468    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638470    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:40:57.020356 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638473    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638475    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638478    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638480    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638483    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638486    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638488    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638491    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638493    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638496    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638498    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638502    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638504    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638507    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638510    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638512    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638514    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638517    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638519    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:40:57.020897 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638523    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638526    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638529    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638531    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638534    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638536    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638539    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638543    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638546    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638549    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638553    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638557    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.638562    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638690    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:40:57.021425 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638696    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638699    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638702    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638705    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638708    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638710    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638713    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638716    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638718    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638721    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638723    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638727    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638733    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638737    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638740    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638743    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638746    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638749    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638752    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:40:57.021827 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638756    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638759    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638762    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638765    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638768    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638789    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638794    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638797    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638800    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638803    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638805    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638808    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638810    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638813    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638816    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638818    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638821    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638823    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638826    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:40:57.022413 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638828    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638831    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638833    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638836    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638838    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638841    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638846    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638848    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638851    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638853    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638856    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638858    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638862    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638867    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638870    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638873    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638876    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638878    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638881    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638883    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:40:57.023056 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638886    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638888    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638891    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638894    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638896    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638898    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638901    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638903    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638906    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638908    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638911    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638913    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638916    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638918    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638921    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638923    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638926    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638928    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638932    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638935    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:40:57.023708 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638938    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638940    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638943    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638946    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638949    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638954    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638957    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638960    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638962    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638965    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638967    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638970    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638972    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638975    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638977    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638980    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638982    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638985    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638987    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:40:57.024341 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:56.638990    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.638995    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.639091    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.641867    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.643199    2560 server.go:1019] "Starting client certificate rotation"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.643295    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.643333    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.645582    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.649479    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.658451    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.660867    2560 log.go:25] "Validated CRI v1 image API"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.661675    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 00:40:57.025162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.664798    2560 fs.go:135] Filesystem UUIDs: map[251465ec-539f-4226-ba43-4121418f6ec3:/dev/nvme0n1p3 6c84d775-c079-4da3-8f87-5f71bf2c8f52:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 21 00:40:57.025561 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.664819    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 00:40:57.025767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.669548    2560 manager.go:216] Machine: {Timestamp:2026-07-21 00:40:56.669075158 +0000 UTC m=+0.341465516 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103913 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24c9f045f2d5a615bf55236ddec7e6 SystemUUID:ec24c9f0-45f2-d5a6-15bf-55236ddec7e6 BootID:5604d993-c1a9-40f5-ada8-fffc9c50459d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:a5:20:ec:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:a5:20:ec:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:50:f9:2f:0d:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 00:40:57.025767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.669648    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 00:40:57.025767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.669720    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 00:40:57.025767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.671436    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 00:40:57.025767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.673220    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 00:40:57.025767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.673415    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 00:40:57.025767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.674143    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.674155    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.674162    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.674179    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.675416    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678004    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678109    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678141    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678151    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678164    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678173    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678207    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678482    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.678497    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.681028    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.682792    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.682820    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684363    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684376    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684383    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684389    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684397    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684403    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684411    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684416    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684422    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684428    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684439    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.684444    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.685946    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.685952    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.688948    2560 server.go:1268] "Started kubelet"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.689017    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.689090    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.689136    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.689197    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.689265    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.689337    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.690802    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5x8r6"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.690812    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 00:40:57.026186 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.691358    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.695042    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.695691    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-241.ec2.internal.18c42734031325df  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-241.ec2.internal,UID:ip-10-0-138-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-241.ec2.internal,},FirstTimestamp:2026-07-21 00:40:56.688928223 +0000 UTC m=+0.361318580,LastTimestamp:2026-07-21 00:40:56.688928223 +0000 UTC m=+0.361318580,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-241.ec2.internal,}"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.698123    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5x8r6"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.698894    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.698906    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.699237    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700021    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700036    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700008    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700104    2560 factory.go:153] Registering CRI-O factory
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700121    2560 factory.go:223] Registration of the crio container factory successfully
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700124    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700130    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700172    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700200    2560 factory.go:55] Registering systemd factory
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700208    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700228    2560 factory.go:103] Registering Raw factory
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700238    2560 manager.go:1196] Started watching for new ooms in manager
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.700637    2560 manager.go:349] Starting recovery of all containers
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.703472    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.703749    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.713058    2560 manager.go:354] Recovery completed
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.717143    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.718868    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.718893    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.718902    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.719352    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.719359    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.719362    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.719385    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.719991    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:40:57.027408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.720015    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.720028    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.720555    2560 policy_none.go:49] "None policy: Start"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.720566    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.720576    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.721484    2560 policy_none.go:47] "Start"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.800303    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.801304    2560 manager.go:337] "Starting Device Plugin manager"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.801336    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.801346    2560 server.go:87] "Starting device plugin registration server"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.801620    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.801631    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.801723    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.801816    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.801824    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.802354    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.802406    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.846448    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.847607    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.847638    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.847659    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.847690    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.850158    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.902706    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.903503    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.903529    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.903543    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.903565    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.911222    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.912226    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.912241    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-241.ec2.internal\": node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:56.929152    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.947891    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"]
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.947945    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.949325    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.949350    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.949362    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.950746    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:40:57.028487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.950866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.950898    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.951422    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.951431    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.951445    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.951450    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.951461    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.951460    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.952658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.952687    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.953358    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.953380    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:56.953391    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.029278    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.029579 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.029353    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.030592    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.101425    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb247d17e6b825ff2433dfd75f4e4bf3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"eb247d17e6b825ff2433dfd75f4e4bf3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.101448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb247d17e6b825ff2433dfd75f4e4bf3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"eb247d17e6b825ff2433dfd75f4e4bf3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.101468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b4717978e5444ed26107fe6a970140c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"1b4717978e5444ed26107fe6a970140c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.130230    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.201927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb247d17e6b825ff2433dfd75f4e4bf3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"eb247d17e6b825ff2433dfd75f4e4bf3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.201970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb247d17e6b825ff2433dfd75f4e4bf3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"eb247d17e6b825ff2433dfd75f4e4bf3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.201996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b4717978e5444ed26107fe6a970140c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"1b4717978e5444ed26107fe6a970140c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.202010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb247d17e6b825ff2433dfd75f4e4bf3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"eb247d17e6b825ff2433dfd75f4e4bf3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.202027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b4717978e5444ed26107fe6a970140c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"1b4717978e5444ed26107fe6a970140c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.202328 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.202032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb247d17e6b825ff2433dfd75f4e4bf3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"eb247d17e6b825ff2433dfd75f4e4bf3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.261761 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.231018    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.351883 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.331471    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.351883 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.332582    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.351883 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.333632    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.472217 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.432541    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.592420 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.533046    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.633496    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.642631    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.642801    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.654639    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.679128    2560 apiserver.go:52] "Watching apiserver"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.684037    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.693438    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.694510    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-m688j","openshift-network-diagnostics/network-check-target-shvb7","openshift-network-operator/iptables-alerter-5thjl","openshift-ovn-kubernetes/ovnkube-node-sgswq","kube-system/global-pull-secret-syncer-76c2g","kube-system/konnectivity-agent-lblfv","openshift-multus/multus-additional-cni-plugins-8xhsl","openshift-multus/multus-wjsmv","openshift-multus/network-metrics-daemon-94k2f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75","openshift-cluster-node-tuning-operator/tuned-v78s6","openshift-dns/node-resolver-z7sxq"]
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.696121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.697594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.697987    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.698243    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b824b\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.698682    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.699115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.699244    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.699497    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.699547    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.699500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.701694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.703468    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.703485    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hxcdg\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.703529    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.703812    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 00:35:57 +0000 UTC" deadline="2028-04-16 09:28:37.259067554 +0000 UTC"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.703904    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15248h47m39.55517083s"
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.704114    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.704139    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 00:40:57.720254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.704287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:57.723173 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.704380    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-systemd-units\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-node-log\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-var-lib-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-etc-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823622    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m5dbx\""
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823703    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-ovn\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823819    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824004    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824055    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.823775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qgxn\" (UniqueName: \"kubernetes.io/projected/99d2f9e2-08e9-4bde-91bd-fac4032ad422-kube-api-access-6qgxn\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-iptables-alerter-script\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-systemd\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824223    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 00:40:57.861348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08434792-4357-45d1-8b53-ce207c60e3e4-serviceca\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-host-slash\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-kubelet\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824391    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-run-netns\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-cni-bin\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5jz\" (UniqueName: \"kubernetes.io/projected/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-kube-api-access-mh5jz\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-log-socket\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovnkube-script-lib\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-cni-netd\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8nb\" (UniqueName: \"kubernetes.io/projected/08434792-4357-45d1-8b53-ce207c60e3e4-kube-api-access-cf8nb\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-slash\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862085 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovnkube-config\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-env-overrides\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824871    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovn-node-metrics-cert\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.824966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08434792-4357-45d1-8b53-ce207c60e3e4-host\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.826361    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.827192    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.827291    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9l79b\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.827631    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.827859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.828187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.828536    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.828591    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.828628    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.828595    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gttlc\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.828902    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.828950    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.829052    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p7zl5"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.829451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.829522    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.829793    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.829868    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jbtdf\""
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.831030    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.832510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.862743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834045    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal"]
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834064    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834091    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"]
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834177    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834269    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834279    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cv2qw\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834326    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834279    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.834785    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.835046    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r55jd\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.838127    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.838331    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.838505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 00:40:57.863612 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.838681    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tzdgk\""
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.900855    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-device-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-sys-fs\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-cnibin\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysconfig\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-sys\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-systemd\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-cni-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-cni-bin\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-host\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-systemd\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08434792-4357-45d1-8b53-ce207c60e3e4-serviceca\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-kubelet\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-cni-bin\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.986425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2c6f987-646c-4341-9190-3fa552d5fe92-dbus\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-system-cni-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-modprobe-d\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-run\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovnkube-script-lib\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.925525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2c6f987-646c-4341-9190-3fa552d5fe92-kubelet-config\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-var-lib-kubelet\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlwdv\" (UniqueName: \"kubernetes.io/projected/2481b770-734e-450f-bb3d-0ad19f01c319-kube-api-access-wlwdv\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-cni-bin\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-kubelet\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-system-cni-dir\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08434792-4357-45d1-8b53-ce207c60e3e4-serviceca\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-lib-modules\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.926972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-slash\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.991880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovnkube-config\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-slash\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-env-overrides\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovnkube-script-lib\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/602efe0c-543b-4a83-b637-633f5e4ce0e0-konnectivity-ca\") pod \"konnectivity-agent-lblfv\" (UID: \"602efe0c-543b-4a83-b637-633f5e4ce0e0\") " pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjt6r\" (UniqueName: \"kubernetes.io/projected/fcf87c52-a489-48f9-b382-1e22ec687300-kube-api-access-bjt6r\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-os-release\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-socket-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-registration-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cnibin\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0258730-45d0-4621-9e51-3e41710eb652-cni-binary-copy\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08434792-4357-45d1-8b53-ce207c60e3e4-host\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.992735 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-systemd-units\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08434792-4357-45d1-8b53-ce207c60e3e4-host\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-systemd-units\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-node-log\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-os-release\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-cni-multus\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-node-log\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysctl-conf\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2481b770-734e-450f-bb3d-0ad19f01c319-tmp\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836b0627-f6be-42b9-b8bc-e12dcba46ccf-tmp-dir\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-ovn\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htxg\" (UniqueName: \"kubernetes.io/projected/69fbbda5-0cec-4e74-842b-9e4b8281382f-kube-api-access-8htxg\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.927965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s22jx\" (UniqueName: \"kubernetes.io/projected/7d6a9e8c-f46f-4701-8b64-3e9682adba10-kube-api-access-s22jx\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-k8s-cni-cncf-io\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.993620 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-ovn\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-conf-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-multus-certs\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-env-overrides\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-iptables-alerter-script\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0258730-45d0-4621-9e51-3e41710eb652-multus-daemon-config\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovnkube-config\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-iptables-alerter-script\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.928598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-etc-kubernetes\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-host-slash\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-run-netns\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.998130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5jz\" (UniqueName: \"kubernetes.io/projected/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-kube-api-access-mh5jz\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-log-socket\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj47c\" (UniqueName: \"kubernetes.io/projected/b0258730-45d0-4621-9e51-3e41710eb652-kube-api-access-hj47c\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-kubernetes\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysctl-d\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-cni-netd\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-systemd\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/836b0627-f6be-42b9-b8bc-e12dcba46ccf-hosts-file\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8nb\" (UniqueName: \"kubernetes.io/projected/08434792-4357-45d1-8b53-ce207c60e3e4-kube-api-access-cf8nb\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-etc-selinux\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-netns\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.999052 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-kubelet\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s65cl\" (UniqueName: \"kubernetes.io/projected/836b0627-f6be-42b9-b8bc-e12dcba46ccf-kube-api-access-s65cl\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovn-node-metrics-cert\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-cni-netd\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2481b770-734e-450f-bb3d-0ad19f01c319-etc-tuned\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/602efe0c-543b-4a83-b637-633f5e4ce0e0-agent-certs\") pod \"konnectivity-agent-lblfv\" (UID: \"602efe0c-543b-4a83-b637-633f5e4ce0e0\") " pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-socket-dir-parent\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-hostroot\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.929913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-log-socket\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-run-netns\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:57.999909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-var-lib-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-run-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-etc-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-host-slash\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-var-lib-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qgxn\" (UniqueName: \"kubernetes.io/projected/99d2f9e2-08e9-4bde-91bd-fac4032ad422-kube-api-access-6qgxn\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d2f9e2-08e9-4bde-91bd-fac4032ad422-etc-openvswitch\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.930808    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.934169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d2f9e2-08e9-4bde-91bd-fac4032ad422-ovn-node-metrics-cert\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.935096    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.935121    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.935135    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kp6pc for pod openshift-network-diagnostics/network-check-target-shvb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:57.935196    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc podName:9d0b617f-a8a9-4fb5-b5ae-771d552cdca7 nodeName:}" failed. No retries permitted until 2026-07-21 00:40:58.435175187 +0000 UTC m=+2.107565555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kp6pc" (UniqueName: "kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc") pod "network-check-target-shvb7" (UID: "9d0b617f-a8a9-4fb5-b5ae-771d552cdca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:40:58.003091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.937290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5jz\" (UniqueName: \"kubernetes.io/projected/7c419665-7780-41c1-9ca1-2cb05bf2ed3d-kube-api-access-mh5jz\") pod \"iptables-alerter-5thjl\" (UID: \"7c419665-7780-41c1-9ca1-2cb05bf2ed3d\") " pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:58.004472 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.937453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8nb\" (UniqueName: \"kubernetes.io/projected/08434792-4357-45d1-8b53-ce207c60e3e4-kube-api-access-cf8nb\") pod \"node-ca-m688j\" (UID: \"08434792-4357-45d1-8b53-ce207c60e3e4\") " pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:58.004472 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.937498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qgxn\" (UniqueName: \"kubernetes.io/projected/99d2f9e2-08e9-4bde-91bd-fac4032ad422-kube-api-access-6qgxn\") pod \"ovnkube-node-sgswq\" (UID: \"99d2f9e2-08e9-4bde-91bd-fac4032ad422\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.004472 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:57.974457    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-cni-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-cni-bin\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-host\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2c6f987-646c-4341-9190-3fa552d5fe92-dbus\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-system-cni-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-cni-bin\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-host\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031268    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-system-cni-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-modprobe-d\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-run\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031327    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2c6f987-646c-4341-9190-3fa552d5fe92-kubelet-config\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-var-lib-kubelet\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2c6f987-646c-4341-9190-3fa552d5fe92-dbus\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-run\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.119974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlwdv\" (UniqueName: \"kubernetes.io/projected/2481b770-734e-450f-bb3d-0ad19f01c319-kube-api-access-wlwdv\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-cni-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2c6f987-646c-4341-9190-3fa552d5fe92-kubelet-config\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-system-cni-dir\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-var-lib-kubelet\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-modprobe-d\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-system-cni-dir\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-lib-modules\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-lib-modules\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/602efe0c-543b-4a83-b637-633f5e4ce0e0-konnectivity-ca\") pod \"konnectivity-agent-lblfv\" (UID: \"602efe0c-543b-4a83-b637-633f5e4ce0e0\") " pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjt6r\" (UniqueName: \"kubernetes.io/projected/fcf87c52-a489-48f9-b382-1e22ec687300-kube-api-access-bjt6r\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.031580    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:40:58.235565 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-os-release\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.031630    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret podName:b2c6f987-646c-4341-9190-3fa552d5fe92 nodeName:}" failed. No retries permitted until 2026-07-21 00:40:58.531613413 +0000 UTC m=+2.204003758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret") pod "global-pull-secret-syncer-76c2g" (UID: "b2c6f987-646c-4341-9190-3fa552d5fe92") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-os-release\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-socket-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-registration-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cnibin\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0258730-45d0-4621-9e51-3e41710eb652-cni-binary-copy\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cnibin\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-socket-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-os-release\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-cni-multus\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysctl-conf\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-registration-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2481b770-734e-450f-bb3d-0ad19f01c319-tmp\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.237355 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836b0627-f6be-42b9-b8bc-e12dcba46ccf-tmp-dir\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-cni-multus\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8htxg\" (UniqueName: \"kubernetes.io/projected/69fbbda5-0cec-4e74-842b-9e4b8281382f-kube-api-access-8htxg\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s22jx\" (UniqueName: \"kubernetes.io/projected/7d6a9e8c-f46f-4701-8b64-3e9682adba10-kube-api-access-s22jx\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-k8s-cni-cncf-io\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-conf-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysctl-conf\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/602efe0c-543b-4a83-b637-633f5e4ce0e0-konnectivity-ca\") pod \"konnectivity-agent-lblfv\" (UID: \"602efe0c-543b-4a83-b637-633f5e4ce0e0\") " pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-multus-certs\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.031985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-os-release\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0258730-45d0-4621-9e51-3e41710eb652-multus-daemon-config\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-conf-dir\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-etc-kubernetes\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-etc-kubernetes\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.238234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj47c\" (UniqueName: \"kubernetes.io/projected/b0258730-45d0-4621-9e51-3e41710eb652-kube-api-access-hj47c\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-multus-certs\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-kubernetes\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysctl-d\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-systemd\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836b0627-f6be-42b9-b8bc-e12dcba46ccf-tmp-dir\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/836b0627-f6be-42b9-b8bc-e12dcba46ccf-hosts-file\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0258730-45d0-4621-9e51-3e41710eb652-cni-binary-copy\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-etc-selinux\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-netns\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-kubelet\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-systemd\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s65cl\" (UniqueName: \"kubernetes.io/projected/836b0627-f6be-42b9-b8bc-e12dcba46ccf-kube-api-access-s65cl\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:58.240418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-etc-selinux\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-netns\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.032661    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/836b0627-f6be-42b9-b8bc-e12dcba46ccf-hosts-file\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysctl-d\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0258730-45d0-4621-9e51-3e41710eb652-multus-daemon-config\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.032733    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs podName:fcf87c52-a489-48f9-b382-1e22ec687300 nodeName:}" failed. No retries permitted until 2026-07-21 00:40:58.532717614 +0000 UTC m=+2.205107975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs") pod "network-metrics-daemon-94k2f" (UID: "fcf87c52-a489-48f9-b382-1e22ec687300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-var-lib-kubelet\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2481b770-734e-450f-bb3d-0ad19f01c319-etc-tuned\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d6a9e8c-f46f-4701-8b64-3e9682adba10-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.241310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/602efe0c-543b-4a83-b637-633f5e4ce0e0-agent-certs\") pod \"konnectivity-agent-lblfv\" (UID: \"602efe0c-543b-4a83-b637-633f5e4ce0e0\") " pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-socket-dir-parent\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-host-run-k8s-cni-cncf-io\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-kubernetes\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-multus-socket-dir-parent\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.032979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-hostroot\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-device-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-sys-fs\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-cnibin\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysconfig\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-device-dir\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-sys\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033180    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-hostroot\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-sys\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.243523 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/69fbbda5-0cec-4e74-842b-9e4b8281382f-sys-fs\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0258730-45d0-4621-9e51-3e41710eb652-cnibin\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2481b770-734e-450f-bb3d-0ad19f01c319-etc-sysconfig\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.033373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d6a9e8c-f46f-4701-8b64-3e9682adba10-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.034465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2481b770-734e-450f-bb3d-0ad19f01c319-tmp\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.035038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/602efe0c-543b-4a83-b637-633f5e4ce0e0-agent-certs\") pod \"konnectivity-agent-lblfv\" (UID: \"602efe0c-543b-4a83-b637-633f5e4ce0e0\") " pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.035102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2481b770-734e-450f-bb3d-0ad19f01c319-etc-tuned\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.040878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s22jx\" (UniqueName: \"kubernetes.io/projected/7d6a9e8c-f46f-4701-8b64-3e9682adba10-kube-api-access-s22jx\") pod \"multus-additional-cni-plugins-8xhsl\" (UID: \"7d6a9e8c-f46f-4701-8b64-3e9682adba10\") " pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.041019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlwdv\" (UniqueName: \"kubernetes.io/projected/2481b770-734e-450f-bb3d-0ad19f01c319-kube-api-access-wlwdv\") pod \"tuned-v78s6\" (UID: \"2481b770-734e-450f-bb3d-0ad19f01c319\") " pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.041222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjt6r\" (UniqueName: \"kubernetes.io/projected/fcf87c52-a489-48f9-b382-1e22ec687300-kube-api-access-bjt6r\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.041422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s65cl\" (UniqueName: \"kubernetes.io/projected/836b0627-f6be-42b9-b8bc-e12dcba46ccf-kube-api-access-s65cl\") pod \"node-resolver-z7sxq\" (UID: \"836b0627-f6be-42b9-b8bc-e12dcba46ccf\") " pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.041594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj47c\" (UniqueName: \"kubernetes.io/projected/b0258730-45d0-4621-9e51-3e41710eb652-kube-api-access-hj47c\") pod \"multus-wjsmv\" (UID: \"b0258730-45d0-4621-9e51-3e41710eb652\") " pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.041849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htxg\" (UniqueName: \"kubernetes.io/projected/69fbbda5-0cec-4e74-842b-9e4b8281382f-kube-api-access-8htxg\") pod \"aws-ebs-csi-driver-node-4pb75\" (UID: \"69fbbda5-0cec-4e74-842b-9e4b8281382f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.130999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m688j"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.155060    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5thjl"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.185636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:40:58.244405 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.202756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:40:58.311681 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.311655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xhsl"
Jul 21 00:40:58.329825 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.329791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wjsmv"
Jul 21 00:40:58.340685 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.340662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75"
Jul 21 00:40:58.346372 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.346349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v78s6"
Jul 21 00:40:58.347607 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.347588    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7sxq"
Jul 21 00:40:58.402199 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.402158    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb247d17e6b825ff2433dfd75f4e4bf3.slice/crio-2e54430fa13b7483d2491070be4a6dbc996e5af7f398745399a948fa80596adf WatchSource:0}: Error finding container 2e54430fa13b7483d2491070be4a6dbc996e5af7f398745399a948fa80596adf: Status 404 returned error can't find the container with id 2e54430fa13b7483d2491070be4a6dbc996e5af7f398745399a948fa80596adf
Jul 21 00:40:58.405898 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.405879    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:40:58.437232 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.437202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:40:58.437670 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.437649    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:40:58.437753 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.437677    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:40:58.437753 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.437693    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kp6pc for pod openshift-network-diagnostics/network-check-target-shvb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:40:58.437753 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.437746    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc podName:9d0b617f-a8a9-4fb5-b5ae-771d552cdca7 nodeName:}" failed. No retries permitted until 2026-07-21 00:40:59.437729647 +0000 UTC m=+3.110120007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kp6pc" (UniqueName: "kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc") pod "network-check-target-shvb7" (UID: "9d0b617f-a8a9-4fb5-b5ae-771d552cdca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:40:58.502334 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.502304    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d2f9e2_08e9_4bde_91bd_fac4032ad422.slice/crio-e8af03729fa05a98f74e734899977aad7629d7986b5e1247f7193deec664e9cf WatchSource:0}: Error finding container e8af03729fa05a98f74e734899977aad7629d7986b5e1247f7193deec664e9cf: Status 404 returned error can't find the container with id e8af03729fa05a98f74e734899977aad7629d7986b5e1247f7193deec664e9cf
Jul 21 00:40:58.538401 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.538375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:58.538479 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.538417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:58.538540 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.538526    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:40:58.538595 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.538585    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs podName:fcf87c52-a489-48f9-b382-1e22ec687300 nodeName:}" failed. No retries permitted until 2026-07-21 00:40:59.538571624 +0000 UTC m=+3.210961973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs") pod "network-metrics-daemon-94k2f" (UID: "fcf87c52-a489-48f9-b382-1e22ec687300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:40:58.538640 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.538526    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:40:58.538674 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:58.538656    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret podName:b2c6f987-646c-4341-9190-3fa552d5fe92 nodeName:}" failed. No retries permitted until 2026-07-21 00:40:59.538643593 +0000 UTC m=+3.211033939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret") pod "global-pull-secret-syncer-76c2g" (UID: "b2c6f987-646c-4341-9190-3fa552d5fe92") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:40:58.628984 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.628959    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c419665_7780_41c1_9ca1_2cb05bf2ed3d.slice/crio-9ab3958382fe295ce75363e22eb51c5a0983cf0968571067ca06daff68fa6631 WatchSource:0}: Error finding container 9ab3958382fe295ce75363e22eb51c5a0983cf0968571067ca06daff68fa6631: Status 404 returned error can't find the container with id 9ab3958382fe295ce75363e22eb51c5a0983cf0968571067ca06daff68fa6631
Jul 21 00:40:58.630803 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.630773    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:40:58.635068 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.635043    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b4717978e5444ed26107fe6a970140c.slice/crio-2e3cd640a43fc06f4e0c1d0740a4c149ca7d17c4f94913e571288dd5c1a67665 WatchSource:0}: Error finding container 2e3cd640a43fc06f4e0c1d0740a4c149ca7d17c4f94913e571288dd5c1a67665: Status 404 returned error can't find the container with id 2e3cd640a43fc06f4e0c1d0740a4c149ca7d17c4f94913e571288dd5c1a67665
Jul 21 00:40:58.705972 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.705944    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fbbda5_0cec_4e74_842b_9e4b8281382f.slice/crio-30de3568ca3e7bb3afdc5943d2698748d067d9cbaed2b0a089272cd731d94d66 WatchSource:0}: Error finding container 30de3568ca3e7bb3afdc5943d2698748d067d9cbaed2b0a089272cd731d94d66: Status 404 returned error can't find the container with id 30de3568ca3e7bb3afdc5943d2698748d067d9cbaed2b0a089272cd731d94d66
Jul 21 00:40:58.706537 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.706515    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0258730_45d0_4621_9e51_3e41710eb652.slice/crio-fee84bca61eb362638cf6921781bc4b4577b56ea7e5a0d39b4d835e972ef46ff WatchSource:0}: Error finding container fee84bca61eb362638cf6921781bc4b4577b56ea7e5a0d39b4d835e972ef46ff: Status 404 returned error can't find the container with id fee84bca61eb362638cf6921781bc4b4577b56ea7e5a0d39b4d835e972ef46ff
Jul 21 00:40:58.732046 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.732016    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08434792_4357_45d1_8b53_ce207c60e3e4.slice/crio-2f3165360ae0309ee9f89d3ac74ca65145b80dea74e84b32b8442cec0e55470d WatchSource:0}: Error finding container 2f3165360ae0309ee9f89d3ac74ca65145b80dea74e84b32b8442cec0e55470d: Status 404 returned error can't find the container with id 2f3165360ae0309ee9f89d3ac74ca65145b80dea74e84b32b8442cec0e55470d
Jul 21 00:40:58.755160 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.755139    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836b0627_f6be_42b9_b8bc_e12dcba46ccf.slice/crio-285b54a1b1ea3b225d863f992bf118063b28d06c47449cc1e89e25004a53754d WatchSource:0}: Error finding container 285b54a1b1ea3b225d863f992bf118063b28d06c47449cc1e89e25004a53754d: Status 404 returned error can't find the container with id 285b54a1b1ea3b225d863f992bf118063b28d06c47449cc1e89e25004a53754d
Jul 21 00:40:58.768977 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.768955    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2481b770_734e_450f_bb3d_0ad19f01c319.slice/crio-121bbcf34b39f7d78f5944481cbfcdfb1e503f298720bbdde5d8ee4a29482e1a WatchSource:0}: Error finding container 121bbcf34b39f7d78f5944481cbfcdfb1e503f298720bbdde5d8ee4a29482e1a: Status 404 returned error can't find the container with id 121bbcf34b39f7d78f5944481cbfcdfb1e503f298720bbdde5d8ee4a29482e1a
Jul 21 00:40:58.822532 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.822505    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602efe0c_543b_4a83_b637_633f5e4ce0e0.slice/crio-bc3e236853c44b78b083781fea125cef98f22bd63af40584fc689c43dc7d77a1 WatchSource:0}: Error finding container bc3e236853c44b78b083781fea125cef98f22bd63af40584fc689c43dc7d77a1: Status 404 returned error can't find the container with id bc3e236853c44b78b083781fea125cef98f22bd63af40584fc689c43dc7d77a1
Jul 21 00:40:58.833103 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.833059    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 00:35:58 +0000 UTC" deadline="2028-03-05 04:22:16.449718561 +0000 UTC"
Jul 21 00:40:58.833180 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.833103    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14235h41m17.616619279s"
Jul 21 00:40:58.851905 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.851838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5thjl" event={"ID":"7c419665-7780-41c1-9ca1-2cb05bf2ed3d","Type":"ContainerStarted","Data":"9ab3958382fe295ce75363e22eb51c5a0983cf0968571067ca06daff68fa6631"}
Jul 21 00:40:58.853008 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.852986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"e8af03729fa05a98f74e734899977aad7629d7986b5e1247f7193deec664e9cf"}
Jul 21 00:40:58.854058 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.854039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"eb247d17e6b825ff2433dfd75f4e4bf3","Type":"ContainerStarted","Data":"2e54430fa13b7483d2491070be4a6dbc996e5af7f398745399a948fa80596adf"}
Jul 21 00:40:58.855070 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.855049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lblfv" event={"ID":"602efe0c-543b-4a83-b637-633f5e4ce0e0","Type":"ContainerStarted","Data":"bc3e236853c44b78b083781fea125cef98f22bd63af40584fc689c43dc7d77a1"}
Jul 21 00:40:58.856039 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.856020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7sxq" event={"ID":"836b0627-f6be-42b9-b8bc-e12dcba46ccf","Type":"ContainerStarted","Data":"285b54a1b1ea3b225d863f992bf118063b28d06c47449cc1e89e25004a53754d"}
Jul 21 00:40:58.857170 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.857110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m688j" event={"ID":"08434792-4357-45d1-8b53-ce207c60e3e4","Type":"ContainerStarted","Data":"2f3165360ae0309ee9f89d3ac74ca65145b80dea74e84b32b8442cec0e55470d"}
Jul 21 00:40:58.858209 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.858182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wjsmv" event={"ID":"b0258730-45d0-4621-9e51-3e41710eb652","Type":"ContainerStarted","Data":"fee84bca61eb362638cf6921781bc4b4577b56ea7e5a0d39b4d835e972ef46ff"}
Jul 21 00:40:58.859311 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.859282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v78s6" event={"ID":"2481b770-734e-450f-bb3d-0ad19f01c319","Type":"ContainerStarted","Data":"121bbcf34b39f7d78f5944481cbfcdfb1e503f298720bbdde5d8ee4a29482e1a"}
Jul 21 00:40:58.860306 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.860281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75" event={"ID":"69fbbda5-0cec-4e74-842b-9e4b8281382f","Type":"ContainerStarted","Data":"30de3568ca3e7bb3afdc5943d2698748d067d9cbaed2b0a089272cd731d94d66"}
Jul 21 00:40:58.861203 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:58.861157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" event={"ID":"1b4717978e5444ed26107fe6a970140c","Type":"ContainerStarted","Data":"2e3cd640a43fc06f4e0c1d0740a4c149ca7d17c4f94913e571288dd5c1a67665"}
Jul 21 00:40:58.983896 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:40:58.983866    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6a9e8c_f46f_4701_8b64_3e9682adba10.slice/crio-35631b6bd1637be1ac29d114ca4fddfb9bada9382ca6af1043256f8624f5da19 WatchSource:0}: Error finding container 35631b6bd1637be1ac29d114ca4fddfb9bada9382ca6af1043256f8624f5da19: Status 404 returned error can't find the container with id 35631b6bd1637be1ac29d114ca4fddfb9bada9382ca6af1043256f8624f5da19
Jul 21 00:40:59.446378 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.446291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:40:59.446549 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.446492    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:40:59.446549 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.446514    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:40:59.446549 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.446526    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kp6pc for pod openshift-network-diagnostics/network-check-target-shvb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:40:59.446693 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.446586    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc podName:9d0b617f-a8a9-4fb5-b5ae-771d552cdca7 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:01.446566047 +0000 UTC m=+5.118956411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kp6pc" (UniqueName: "kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc") pod "network-check-target-shvb7" (UID: "9d0b617f-a8a9-4fb5-b5ae-771d552cdca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:40:59.547274 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.547234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:59.547453 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.547332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:59.547519 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.547501    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:40:59.547591 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.547572    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret podName:b2c6f987-646c-4341-9190-3fa552d5fe92 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:01.547549211 +0000 UTC m=+5.219939558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret") pod "global-pull-secret-syncer-76c2g" (UID: "b2c6f987-646c-4341-9190-3fa552d5fe92") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:40:59.548145 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.548123    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:40:59.548245 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.548188    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs podName:fcf87c52-a489-48f9-b382-1e22ec687300 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:01.548168089 +0000 UTC m=+5.220558450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs") pod "network-metrics-daemon-94k2f" (UID: "fcf87c52-a489-48f9-b382-1e22ec687300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:40:59.836201 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.834207    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 00:35:58 +0000 UTC" deadline="2028-04-17 05:49:49.835677316 +0000 UTC"
Jul 21 00:40:59.836201 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.834250    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15269h8m50.001432632s"
Jul 21 00:40:59.848754 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.848723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:40:59.848924 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.848879    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:40:59.849919 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.849896    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:40:59.850050 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.850025    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:40:59.850116 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.850093    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:40:59.850205 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:40:59.850169    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:40:59.867686 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:40:59.867623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerStarted","Data":"35631b6bd1637be1ac29d114ca4fddfb9bada9382ca6af1043256f8624f5da19"}
Jul 21 00:41:01.465150 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:01.465114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:01.465680 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.465349    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:01.465680 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.465369    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:01.465680 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.465383    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kp6pc for pod openshift-network-diagnostics/network-check-target-shvb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:01.465680 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.465454    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc podName:9d0b617f-a8a9-4fb5-b5ae-771d552cdca7 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:05.465433603 +0000 UTC m=+9.137823963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kp6pc" (UniqueName: "kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc") pod "network-check-target-shvb7" (UID: "9d0b617f-a8a9-4fb5-b5ae-771d552cdca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:01.566064 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:01.565736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:01.566064 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:01.565814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:01.566064 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.565933    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:01.566064 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.565998    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret podName:b2c6f987-646c-4341-9190-3fa552d5fe92 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:05.565977247 +0000 UTC m=+9.238367617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret") pod "global-pull-secret-syncer-76c2g" (UID: "b2c6f987-646c-4341-9190-3fa552d5fe92") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:01.566064 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.565932    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:01.566064 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.566042    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs podName:fcf87c52-a489-48f9-b382-1e22ec687300 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:05.566031167 +0000 UTC m=+9.238421533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs") pod "network-metrics-daemon-94k2f" (UID: "fcf87c52-a489-48f9-b382-1e22ec687300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:01.849528 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:01.848658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:01.849528 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.848789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:01.849528 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:01.849223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:01.849528 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.849325    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:01.849528 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:01.849393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:01.849528 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:01.849480    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:03.848058 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:03.848024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:03.848542 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:03.848042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:03.848542 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:03.848233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:03.848542 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:03.848200    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:03.848542 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:03.848331    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:03.848542 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:03.848415    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:05.505270 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:05.505226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:05.505684 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.505400    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:05.505684 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.505423    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:05.505684 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.505434    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kp6pc for pod openshift-network-diagnostics/network-check-target-shvb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:05.505684 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.505484    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc podName:9d0b617f-a8a9-4fb5-b5ae-771d552cdca7 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:13.505468936 +0000 UTC m=+17.177859281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kp6pc" (UniqueName: "kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc") pod "network-check-target-shvb7" (UID: "9d0b617f-a8a9-4fb5-b5ae-771d552cdca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:05.605927 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:05.605885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:05.606118 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:05.605965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:05.606118 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.606089    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:05.606118 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.606110    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:05.606287 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.606178    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs podName:fcf87c52-a489-48f9-b382-1e22ec687300 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:13.606156594 +0000 UTC m=+17.278546951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs") pod "network-metrics-daemon-94k2f" (UID: "fcf87c52-a489-48f9-b382-1e22ec687300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:05.606287 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.606200    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret podName:b2c6f987-646c-4341-9190-3fa552d5fe92 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:13.606189749 +0000 UTC m=+17.278580094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret") pod "global-pull-secret-syncer-76c2g" (UID: "b2c6f987-646c-4341-9190-3fa552d5fe92") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:05.848027 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:05.847990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:05.848234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:05.848118    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:05.848234 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.848130    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:05.848234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:05.848192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:05.848387 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.848316    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:05.848530 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:05.848484    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:07.849550 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:07.848720    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:07.849550 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:07.848878    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:07.849550 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:07.848964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:07.849550 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:07.849055    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:07.849550 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:07.849114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:07.849550 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:07.849181    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:09.848156 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:09.848086    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:09.848627 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:09.848222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:09.848627 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:09.848229    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:09.848627 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:09.848251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:09.848627 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:09.848338    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:09.848627 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:09.848433    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:11.848877 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:11.848836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:11.849320 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:11.848836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:11.849320 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:11.848952    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:11.849320 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:11.848965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:11.849320 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:11.849069    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:11.849320 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:11.849156    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:13.574820 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:13.574766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:13.575276 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.574956    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:13.575276 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.574984    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:13.575276 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.574997    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kp6pc for pod openshift-network-diagnostics/network-check-target-shvb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:13.575276 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.575072    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc podName:9d0b617f-a8a9-4fb5-b5ae-771d552cdca7 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:29.575044088 +0000 UTC m=+33.247434434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kp6pc" (UniqueName: "kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc") pod "network-check-target-shvb7" (UID: "9d0b617f-a8a9-4fb5-b5ae-771d552cdca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:13.675254 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:13.675218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:13.675448 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:13.675279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:13.675448 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.675380    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:13.675448 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.675382    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:13.675448 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.675444    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs podName:fcf87c52-a489-48f9-b382-1e22ec687300 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:29.675426029 +0000 UTC m=+33.347816376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs") pod "network-metrics-daemon-94k2f" (UID: "fcf87c52-a489-48f9-b382-1e22ec687300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:13.675637 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.675463    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret podName:b2c6f987-646c-4341-9190-3fa552d5fe92 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:29.675453876 +0000 UTC m=+33.347844221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret") pod "global-pull-secret-syncer-76c2g" (UID: "b2c6f987-646c-4341-9190-3fa552d5fe92") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:13.848298 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:13.848217    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:13.848298 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:13.848244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:13.848298 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:13.848255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:13.848598 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.848352    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:13.848598 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.848410    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:13.848598 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:13.848543    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:15.848399 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:15.848311    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:15.848399 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:15.848341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:15.848399 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:15.848350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:15.848953 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:15.848460    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:15.848953 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:15.848598    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:15.848953 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:15.848658    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:17.848285 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:17.848249    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:17.848739 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:17.848296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:17.848739 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:17.848365    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:17.848739 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:17.848379    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:17.848739 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:17.848445    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:17.848739 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:17.848544    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:19.848477 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.848183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:19.849107 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.848225    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:19.849107 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:19.848565    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:19.849107 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.848228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:19.849107 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:19.848618    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:19.849107 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:19.848704    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:19.907969 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.907939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v78s6" event={"ID":"2481b770-734e-450f-bb3d-0ad19f01c319","Type":"ContainerStarted","Data":"624303f2a67c7a7eb6b2c665b572da6b8dc4176a52c829303f9f35a5f4b8ae79"}
Jul 21 00:41:19.909296 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.909275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75" event={"ID":"69fbbda5-0cec-4e74-842b-9e4b8281382f","Type":"ContainerStarted","Data":"60eafb2c8dd00bce9a8011f44d864736b4cd80fa0df97f13ff8aed00cdf3c59f"}
Jul 21 00:41:19.910738 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.910705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" event={"ID":"1b4717978e5444ed26107fe6a970140c","Type":"ContainerStarted","Data":"9f63afb4da0bc858c53c96139117e39270048eef80557e867e8da77cee92e397"}
Jul 21 00:41:19.912946 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.912926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"5dd1327c81df78e387476c979f95e44e2fce0d626f048f811d61b23a2547f3df"}
Jul 21 00:41:19.913040 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.912985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"77a4cb2d762b3c65cbc36267899512b55ab8e69330e950113a41cae7de6884cb"}
Jul 21 00:41:19.913040 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.913016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"387baf6c21d883a8f85f09891e57034eace69ba358bbe3bb35975359a10f7643"}
Jul 21 00:41:19.914334 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.914315    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb247d17e6b825ff2433dfd75f4e4bf3" containerID="01340a46c5f280ee2dff2a3a09a61f8950221409b6395bf37cfda7fb92d6c8ea" exitCode=0
Jul 21 00:41:19.914422 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.914380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"eb247d17e6b825ff2433dfd75f4e4bf3","Type":"ContainerDied","Data":"01340a46c5f280ee2dff2a3a09a61f8950221409b6395bf37cfda7fb92d6c8ea"}
Jul 21 00:41:19.915882 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.915862    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d6a9e8c-f46f-4701-8b64-3e9682adba10" containerID="26e665a7ef2326ad97376f00d8d2083311505e45f833ddd576a1600310193f09" exitCode=0
Jul 21 00:41:19.915975 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.915941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerDied","Data":"26e665a7ef2326ad97376f00d8d2083311505e45f833ddd576a1600310193f09"}
Jul 21 00:41:19.917415 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.917384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lblfv" event={"ID":"602efe0c-543b-4a83-b637-633f5e4ce0e0","Type":"ContainerStarted","Data":"fbd9fad365670447cb64f34836ecfbabd4a97988eecd4ea0dc940f3bb6fa3674"}
Jul 21 00:41:19.918947 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.918927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7sxq" event={"ID":"836b0627-f6be-42b9-b8bc-e12dcba46ccf","Type":"ContainerStarted","Data":"d068250e2ce1a5c66f231855ba9637d7e82ecc39aa2f47cbc396f73517655a25"}
Jul 21 00:41:19.920633 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.920428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m688j" event={"ID":"08434792-4357-45d1-8b53-ce207c60e3e4","Type":"ContainerStarted","Data":"2fee99c62ea1a7e79643e4deb1a4a6862617bea0e9b34696ee25cbe701779775"}
Jul 21 00:41:19.921754 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.921734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wjsmv" event={"ID":"b0258730-45d0-4621-9e51-3e41710eb652","Type":"ContainerStarted","Data":"cb464d4d3e944bf80f8482abbf2ceaed1fa0f653a79ba6e774a4c70d0fed058c"}
Jul 21 00:41:19.923340 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.923294    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v78s6" podStartSLOduration=2.441237795 podStartE2EDuration="22.9232629s" totalImagesPullingTime="20.482025105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:19.9226999 +0000 UTC m=+23.595090278" watchObservedRunningTime="2026-07-21 00:41:19.9232629 +0000 UTC m=+23.595653295"
Jul 21 00:41:19.935499 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.935461    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m688j" podStartSLOduration=2.407743333 podStartE2EDuration="22.935450792s" totalImagesPullingTime="20.527707459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:19.934908349 +0000 UTC m=+23.607298706" watchObservedRunningTime="2026-07-21 00:41:19.935450792 +0000 UTC m=+23.607841157"
Jul 21 00:41:19.973622 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.973570    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lblfv" podStartSLOduration=2.56609896 podStartE2EDuration="22.973551955s" totalImagesPullingTime="20.407452995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:19.947673044 +0000 UTC m=+23.620063424" watchObservedRunningTime="2026-07-21 00:41:19.973551955 +0000 UTC m=+23.645942324"
Jul 21 00:41:19.987947 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:19.987884    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wjsmv" podStartSLOduration=2.388291894 podStartE2EDuration="22.98786711s" totalImagesPullingTime="20.599575216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:19.987789323 +0000 UTC m=+23.660179681" watchObservedRunningTime="2026-07-21 00:41:19.98786711 +0000 UTC m=+23.660257477"
Jul 21 00:41:20.013533 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.013495    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" podStartSLOduration=22.01348162 podStartE2EDuration="22.01348162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:20.013155951 +0000 UTC m=+23.685546317" watchObservedRunningTime="2026-07-21 00:41:20.01348162 +0000 UTC m=+23.685871987"
Jul 21 00:41:20.025636 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.025601    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z7sxq" podStartSLOduration=2.530477662 podStartE2EDuration="23.025588213s" totalImagesPullingTime="20.495110551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:20.025493721 +0000 UTC m=+23.697884086" watchObservedRunningTime="2026-07-21 00:41:20.025588213 +0000 UTC m=+23.697978579"
Jul 21 00:41:20.879706 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.879676    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 00:41:20.925759 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.925686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75" event={"ID":"69fbbda5-0cec-4e74-842b-9e4b8281382f","Type":"ContainerStarted","Data":"62d435e9e0a94bc4e756c56f2857e4c3ace02a14da72d3356241d0d8c074bddd"}
Jul 21 00:41:20.927269 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.927231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5thjl" event={"ID":"7c419665-7780-41c1-9ca1-2cb05bf2ed3d","Type":"ContainerStarted","Data":"499a143036f5f2e1685e24c48cb23a386a06ebcd8ca84a5058f1462a1c613dd0"}
Jul 21 00:41:20.930602 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.930576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"c0cf9485d5169ac6e2412dcdd576e72f761321058e3bceb981862f0baa87f9ae"}
Jul 21 00:41:20.930702 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.930637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"577dd054a3e9ab6f342e65e13fdb73ea8d854848e14e4764b47f660fcf4abc83"}
Jul 21 00:41:20.930702 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.930682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"ce24ae2903fe7f418224000c0178ebcd88d17cf673c21b9d778d8f823db758da"}
Jul 21 00:41:20.932611 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.932590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"eb247d17e6b825ff2433dfd75f4e4bf3","Type":"ContainerStarted","Data":"8ca0b2ee66417a39067d0dcb209d75e2993a0778393a4c6a772232a7e59a379a"}
Jul 21 00:41:20.939168 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.939126    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5thjl" podStartSLOduration=3.316101134 podStartE2EDuration="23.939111377s" totalImagesPullingTime="20.623010243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:20.938930906 +0000 UTC m=+24.611321272" watchObservedRunningTime="2026-07-21 00:41:20.939111377 +0000 UTC m=+24.611501744"
Jul 21 00:41:20.955227 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:20.955190    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" podStartSLOduration=22.95517766 podStartE2EDuration="22.95517766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:20.955018634 +0000 UTC m=+24.627408996" watchObservedRunningTime="2026-07-21 00:41:20.95517766 +0000 UTC m=+24.627568025"
Jul 21 00:41:21.815004 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.814905    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T00:41:20.879698724Z","UUID":"f337a5ef-1799-40ef-85e9-c95957f7143c","Handler":null,"Name":"","Endpoint":""}
Jul 21 00:41:21.817012 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.816987    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 00:41:21.817123 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.817037    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 00:41:21.848954 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.848920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:21.848954 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.848958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:21.849183 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.849019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:21.849183 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:21.849035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:21.849183 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:21.849094    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:21.849183 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:21.849164    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:21.937247 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.937211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75" event={"ID":"69fbbda5-0cec-4e74-842b-9e4b8281382f","Type":"ContainerStarted","Data":"1e81e3342b71e3821f2e71bdb9a868cd9f95a1e2ee2f2a612f127d1efde26659"}
Jul 21 00:41:21.952215 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:21.952155    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pb75" podStartSLOduration=6.910139236 podStartE2EDuration="24.952140344s" totalImagesPullingTime="18.042001108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:21.951726074 +0000 UTC m=+25.624116439" watchObservedRunningTime="2026-07-21 00:41:21.952140344 +0000 UTC m=+25.624530710"
Jul 21 00:41:22.942725 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:22.942682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"d734e9014a9357e7eff7b6b7533dcd1c20007aa466900946952908b3c338b7d5"}
Jul 21 00:41:23.041502 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:23.041463    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:41:23.042321 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:23.042299    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:41:23.848304 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:23.848268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:23.848581 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:23.848321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:23.848581 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:23.848387    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:23.848581 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:23.848402    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:23.848581 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:23.848457    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:23.848786 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:23.848575    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:23.944677 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:23.944643    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:41:23.945294 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:23.945277    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lblfv"
Jul 21 00:41:24.949616 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:24.949403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" event={"ID":"99d2f9e2-08e9-4bde-91bd-fac4032ad422","Type":"ContainerStarted","Data":"2768f26781c741cffc979e879572bbfc4d2d3a031c5a301c0a3779e3ed041210"}
Jul 21 00:41:24.950557 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:24.949663    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:41:24.951394 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:24.951360    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d6a9e8c-f46f-4701-8b64-3e9682adba10" containerID="55f9995f3768fb92c5543e4b0d3edfd8322239e93b78e5754130740632596c43" exitCode=0
Jul 21 00:41:24.951507 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:24.951404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerDied","Data":"55f9995f3768fb92c5543e4b0d3edfd8322239e93b78e5754130740632596c43"}
Jul 21 00:41:24.966360 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:24.966331    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:41:25.007430 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:25.007368    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq" podStartSLOduration=7.140414668 podStartE2EDuration="28.007349048s" totalImagesPullingTime="20.86693438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:25.006814762 +0000 UTC m=+28.679205128" watchObservedRunningTime="2026-07-21 00:41:25.007349048 +0000 UTC m=+28.679739415"
Jul 21 00:41:25.848273 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:25.848087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:25.848485 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:25.848094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:25.848485 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:25.848379    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:25.848485 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:25.848118    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:25.848485 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:25.848429    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:25.848679 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:25.848504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:25.954312 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:25.954285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:41:25.954789 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:25.954368    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:41:25.969461 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:25.969433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:41:26.479268 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.479182    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76c2g"]
Jul 21 00:41:26.479479 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.479342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:26.479479 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:26.479438    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:26.482349 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.482319    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94k2f"]
Jul 21 00:41:26.482504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.482440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:26.482572 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:26.482541    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:26.483080 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.483053    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-shvb7"]
Jul 21 00:41:26.483170 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.483151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:26.483255 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:26.483234    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:26.958402 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.958372    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d6a9e8c-f46f-4701-8b64-3e9682adba10" containerID="41c7c3cd1b14df7b5d8a6dd660eac455888e280bf7e9bb520b6c3dcc03f1efea" exitCode=0
Jul 21 00:41:26.958976 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:26.958458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerDied","Data":"41c7c3cd1b14df7b5d8a6dd660eac455888e280bf7e9bb520b6c3dcc03f1efea"}
Jul 21 00:41:27.848095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:27.848059    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:27.848095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:27.848098    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:27.848335 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:27.848187    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:27.848335 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:27.848302    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:28.395940 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:28.395838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:28.476762 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:28.476723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:28.848224 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:28.848196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:28.848392 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:28.848311    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:28.965250 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:28.965221    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d6a9e8c-f46f-4701-8b64-3e9682adba10" containerID="896ee4f0a60194b31bf447a9bec7dc8c6e8fc548f8e669df039f6d63c27ca720" exitCode=0
Jul 21 00:41:28.965408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:28.965264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerDied","Data":"896ee4f0a60194b31bf447a9bec7dc8c6e8fc548f8e669df039f6d63c27ca720"}
Jul 21 00:41:29.589215 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:29.589005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:29.589706 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.589147    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:41:29.589706 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.589304    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:41:29.589706 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.589319    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kp6pc for pod openshift-network-diagnostics/network-check-target-shvb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:29.589706 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.589389    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc podName:9d0b617f-a8a9-4fb5-b5ae-771d552cdca7 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:01.589368626 +0000 UTC m=+65.261758974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kp6pc" (UniqueName: "kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc") pod "network-check-target-shvb7" (UID: "9d0b617f-a8a9-4fb5-b5ae-771d552cdca7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:41:29.689750 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:29.689712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:29.689948 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:29.689827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:29.689948 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.689855    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:29.689948 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.689938    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret podName:b2c6f987-646c-4341-9190-3fa552d5fe92 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:01.689918568 +0000 UTC m=+65.362308928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret") pod "global-pull-secret-syncer-76c2g" (UID: "b2c6f987-646c-4341-9190-3fa552d5fe92") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:41:29.689948 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.689943    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:29.690123 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.689981    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs podName:fcf87c52-a489-48f9-b382-1e22ec687300 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:01.689970615 +0000 UTC m=+65.362360964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs") pod "network-metrics-daemon-94k2f" (UID: "fcf87c52-a489-48f9-b382-1e22ec687300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:41:29.848653 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:29.848561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:29.848653 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:29.848588    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:29.848892 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.848691    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:29.848892 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:29.848817    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:30.848897 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:30.848861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:30.849302 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:30.849001    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:31.848430 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:31.848389    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:31.848430 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:31.848424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:31.848683 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:31.848520    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-shvb7" podUID="9d0b617f-a8a9-4fb5-b5ae-771d552cdca7"
Jul 21 00:41:31.848683 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:31.848605    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94k2f" podUID="fcf87c52-a489-48f9-b382-1e22ec687300"
Jul 21 00:41:32.848466 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:32.848430    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:32.849004 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:32.848554    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76c2g" podUID="b2c6f987-646c-4341-9190-3fa552d5fe92"
Jul 21 00:41:33.173671 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.173622    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeReady"
Jul 21 00:41:33.173796 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.173718    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 00:41:33.206296 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.206274    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58bbb4dff7-v9sws"]
Jul 21 00:41:33.229136 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.229098    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ntlfq"]
Jul 21 00:41:33.229701 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.229683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.232645 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.232541    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 00:41:33.232645 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.232546    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9r7r2\""
Jul 21 00:41:33.232856 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.232729    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 00:41:33.232856 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.232790    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 00:41:33.238072 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.238042    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 00:41:33.249513 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.249494    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kcgfm"]
Jul 21 00:41:33.249588 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.249504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.252305 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.252284    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 00:41:33.252561 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.252545    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 00:41:33.252694 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.252672    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lf5vb\""
Jul 21 00:41:33.269479 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.269461    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58bbb4dff7-v9sws"]
Jul 21 00:41:33.269557 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.269487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcgfm"]
Jul 21 00:41:33.269557 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.269499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntlfq"]
Jul 21 00:41:33.269625 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.269564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.271460 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.271432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ql26v\""
Jul 21 00:41:33.271551 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.271488    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 00:41:33.271551 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.271512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 00:41:33.271720 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.271703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 00:41:33.314274 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ps7j\" (UniqueName: \"kubernetes.io/projected/cde337ab-bd30-48ce-b01c-2f2582c6cff0-kube-api-access-4ps7j\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.314347 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cde337ab-bd30-48ce-b01c-2f2582c6cff0-config-volume\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.314347 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3be64348-c49c-44ca-ba2e-7def9d974834-ca-trust-extracted\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314347 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-image-registry-private-configuration\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314453 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvt7m\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-kube-api-access-hvt7m\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314453 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-registry-certificates\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314453 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-trusted-ca\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314540 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-bound-sa-token\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314540 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.314540 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314540 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-installation-pull-secrets\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.314652 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cde337ab-bd30-48ce-b01c-2f2582c6cff0-tmp-dir\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.314652 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fa73e2a-1f8c-40f7-a489-96821178deab-cert\") pod \"ingress-canary-kcgfm\" (UID: \"0fa73e2a-1f8c-40f7-a489-96821178deab\") " pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.314652 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.314605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbmh\" (UniqueName: \"kubernetes.io/projected/0fa73e2a-1f8c-40f7-a489-96821178deab-kube-api-access-wnbmh\") pod \"ingress-canary-kcgfm\" (UID: \"0fa73e2a-1f8c-40f7-a489-96821178deab\") " pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.333133 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.333111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:33.415515 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-registry-certificates\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.415616 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-trusted-ca\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.415616 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-bound-sa-token\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.415616 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-installation-pull-secrets\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cde337ab-bd30-48ce-b01c-2f2582c6cff0-tmp-dir\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fa73e2a-1f8c-40f7-a489-96821178deab-cert\") pod \"ingress-canary-kcgfm\" (UID: \"0fa73e2a-1f8c-40f7-a489-96821178deab\") " pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbmh\" (UniqueName: \"kubernetes.io/projected/0fa73e2a-1f8c-40f7-a489-96821178deab-kube-api-access-wnbmh\") pod \"ingress-canary-kcgfm\" (UID: \"0fa73e2a-1f8c-40f7-a489-96821178deab\") " pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ps7j\" (UniqueName: \"kubernetes.io/projected/cde337ab-bd30-48ce-b01c-2f2582c6cff0-kube-api-access-4ps7j\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cde337ab-bd30-48ce-b01c-2f2582c6cff0-config-volume\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.415829 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3be64348-c49c-44ca-ba2e-7def9d974834-ca-trust-extracted\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.416208 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-image-registry-private-configuration\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.416208 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.415894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvt7m\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-kube-api-access-hvt7m\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.416208 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.416105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cde337ab-bd30-48ce-b01c-2f2582c6cff0-tmp-dir\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.416208 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.416158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-registry-certificates\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.416824 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.416517    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 00:41:33.416824 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.416536    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bbb4dff7-v9sws: secret "image-registry-tls" not found
Jul 21 00:41:33.416824 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.416626    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls podName:3be64348-c49c-44ca-ba2e-7def9d974834 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:33.916606939 +0000 UTC m=+37.588997290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls") pod "image-registry-58bbb4dff7-v9sws" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834") : secret "image-registry-tls" not found
Jul 21 00:41:33.416824 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.416696    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3be64348-c49c-44ca-ba2e-7def9d974834-ca-trust-extracted\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.417056 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.416834    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:41:33.417056 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.416896    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls podName:cde337ab-bd30-48ce-b01c-2f2582c6cff0 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:33.916879706 +0000 UTC m=+37.589270065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls") pod "dns-default-ntlfq" (UID: "cde337ab-bd30-48ce-b01c-2f2582c6cff0") : secret "dns-default-metrics-tls" not found
Jul 21 00:41:33.417056 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.416922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-trusted-ca\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.417509 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.417245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cde337ab-bd30-48ce-b01c-2f2582c6cff0-config-volume\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.420323 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.420299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-image-registry-private-configuration\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.420400 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.420334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-installation-pull-secrets\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.420400 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.420371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fa73e2a-1f8c-40f7-a489-96821178deab-cert\") pod \"ingress-canary-kcgfm\" (UID: \"0fa73e2a-1f8c-40f7-a489-96821178deab\") " pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.427434 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.427300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbmh\" (UniqueName: \"kubernetes.io/projected/0fa73e2a-1f8c-40f7-a489-96821178deab-kube-api-access-wnbmh\") pod \"ingress-canary-kcgfm\" (UID: \"0fa73e2a-1f8c-40f7-a489-96821178deab\") " pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.427745 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.427718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ps7j\" (UniqueName: \"kubernetes.io/projected/cde337ab-bd30-48ce-b01c-2f2582c6cff0-kube-api-access-4ps7j\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.427860 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.427809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-bound-sa-token\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.428951 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.428909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvt7m\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-kube-api-access-hvt7m\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.433282 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.433255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:33.559808 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.559758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:33.577813 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.577787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcgfm"
Jul 21 00:41:33.659683 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.659656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:33.748742 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.748707    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcgfm"]
Jul 21 00:41:33.752442 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.752418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:33.752836 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:41:33.752811    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa73e2a_1f8c_40f7_a489_96821178deab.slice/crio-abe284ecc8ed11b4a18d8f6ff8600df5ce063e5cfdc4c26298beed39e152a39a WatchSource:0}: Error finding container abe284ecc8ed11b4a18d8f6ff8600df5ce063e5cfdc4c26298beed39e152a39a: Status 404 returned error can't find the container with id abe284ecc8ed11b4a18d8f6ff8600df5ce063e5cfdc4c26298beed39e152a39a
Jul 21 00:41:33.807860 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.807826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:33.848495 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.848474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:41:33.849077 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.848660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:41:33.850855 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.850841    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 00:41:33.850933 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.850918    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 00:41:33.851205 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.851187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 00:41:33.851324 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.851230    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nqmsz\""
Jul 21 00:41:33.851324 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.851260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wcfmk\""
Jul 21 00:41:33.866477 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.866461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:33.920806 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.920759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:33.920932 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.920840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:33.920932 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.920892    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:41:33.921041 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.920949    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls podName:cde337ab-bd30-48ce-b01c-2f2582c6cff0 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:34.920934852 +0000 UTC m=+38.593325196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls") pod "dns-default-ntlfq" (UID: "cde337ab-bd30-48ce-b01c-2f2582c6cff0") : secret "dns-default-metrics-tls" not found
Jul 21 00:41:33.921041 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.920949    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 00:41:33.921041 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.920965    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bbb4dff7-v9sws: secret "image-registry-tls" not found
Jul 21 00:41:33.921041 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:33.921010    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls podName:3be64348-c49c-44ca-ba2e-7def9d974834 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:34.920995135 +0000 UTC m=+38.593385498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls") pod "image-registry-58bbb4dff7-v9sws" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834") : secret "image-registry-tls" not found
Jul 21 00:41:33.982545 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.982474    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d6a9e8c-f46f-4701-8b64-3e9682adba10" containerID="8613c68d68550fd4b8021ad41a7cbb136d7daae21dfce3c8e8afb908433d47ea" exitCode=0
Jul 21 00:41:33.982676 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.982554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerDied","Data":"8613c68d68550fd4b8021ad41a7cbb136d7daae21dfce3c8e8afb908433d47ea"}
Jul 21 00:41:33.983634 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:33.983615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcgfm" event={"ID":"0fa73e2a-1f8c-40f7-a489-96821178deab","Type":"ContainerStarted","Data":"abe284ecc8ed11b4a18d8f6ff8600df5ce063e5cfdc4c26298beed39e152a39a"}
Jul 21 00:41:34.644022 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.643988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:34.697580 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.697503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:34.848908 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.848878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:41:34.851501 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.851451    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 00:41:34.931070 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.931044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:34.931206 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.931090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:34.931206 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:34.931192    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:41:34.931318 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:34.931245    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls podName:cde337ab-bd30-48ce-b01c-2f2582c6cff0 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:36.931230871 +0000 UTC m=+40.603621218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls") pod "dns-default-ntlfq" (UID: "cde337ab-bd30-48ce-b01c-2f2582c6cff0") : secret "dns-default-metrics-tls" not found
Jul 21 00:41:34.931318 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:34.931286    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 00:41:34.931318 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:34.931304    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bbb4dff7-v9sws: secret "image-registry-tls" not found
Jul 21 00:41:34.931482 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:34.931363    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls podName:3be64348-c49c-44ca-ba2e-7def9d974834 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:36.931345756 +0000 UTC m=+40.603736116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls") pod "image-registry-58bbb4dff7-v9sws" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834") : secret "image-registry-tls" not found
Jul 21 00:41:34.992408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.992337    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d6a9e8c-f46f-4701-8b64-3e9682adba10" containerID="7a9c21beca4d22dc05208960fc0d696a66142c2a34d49ee618b449b33d3d392f" exitCode=0
Jul 21 00:41:34.992408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:34.992378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerDied","Data":"7a9c21beca4d22dc05208960fc0d696a66142c2a34d49ee618b449b33d3d392f"}
Jul 21 00:41:35.641584 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:35.641549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:35.999235 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:35.999157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" event={"ID":"7d6a9e8c-f46f-4701-8b64-3e9682adba10","Type":"ContainerStarted","Data":"aea892f2c47c42f3ca655dd72487375a46b2557488dbe4a566012b77203272d6"}
Jul 21 00:41:36.022801 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:36.022710    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8xhsl" podStartSLOduration=7.545342336 podStartE2EDuration="39.022689099s" totalImagesPullingTime="31.477346763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:36.021183348 +0000 UTC m=+39.693573713" watchObservedRunningTime="2026-07-21 00:41:36.022689099 +0000 UTC m=+39.695079466"
Jul 21 00:41:36.140880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:36.140716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:36.334591 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:36.334563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:36.435589 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:36.435559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:36.946946 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:36.946908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:36.946946 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:36.946956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:36.947168 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:36.947059    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 00:41:36.947168 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:36.947073    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bbb4dff7-v9sws: secret "image-registry-tls" not found
Jul 21 00:41:36.947168 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:36.947059    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:41:36.947168 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:36.947121    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls podName:3be64348-c49c-44ca-ba2e-7def9d974834 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:40.94710732 +0000 UTC m=+44.619497677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls") pod "image-registry-58bbb4dff7-v9sws" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834") : secret "image-registry-tls" not found
Jul 21 00:41:36.947168 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:36.947133    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls podName:cde337ab-bd30-48ce-b01c-2f2582c6cff0 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:40.947127625 +0000 UTC m=+44.619517969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls") pod "dns-default-ntlfq" (UID: "cde337ab-bd30-48ce-b01c-2f2582c6cff0") : secret "dns-default-metrics-tls" not found
Jul 21 00:41:37.002671 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:37.002632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcgfm" event={"ID":"0fa73e2a-1f8c-40f7-a489-96821178deab","Type":"ContainerStarted","Data":"81b9bde0bcf6348a7e9b34dabeca2fc8677a4a705612c7f1351686840f9278a0"}
Jul 21 00:41:37.017530 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:37.017481    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kcgfm" podStartSLOduration=1.685085231 podStartE2EDuration="4.017467167s" totalImagesPullingTime="2.332381936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:37.016456475 +0000 UTC m=+40.688846841" watchObservedRunningTime="2026-07-21 00:41:37.017467167 +0000 UTC m=+40.689857533"
Jul 21 00:41:39.334823 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:39.334770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:39.896071 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:39.896038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:39.953042 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:39.953012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.135729 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.135651    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.369013 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.368984    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c2cnk"]
Jul 21 00:41:40.401076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.401016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c2cnk"]
Jul 21 00:41:40.401182 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.401116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.403000 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.402979    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 00:41:40.403266 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.403244    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 00:41:40.403868 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.403848    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 00:41:40.403946 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.403901    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 00:41:40.403946 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.403929    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fhmkx\""
Jul 21 00:41:40.416431 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.416404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.472078 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.472053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.473079 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.473060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.473173 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.473118    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bssfh\" (UniqueName: \"kubernetes.io/projected/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-api-access-bssfh\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.473230 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.473174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cfaeaa3-fe5b-4c30-a28f-a647170decba-data-volume\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.473230 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.473200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.473330 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.473278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cfaeaa3-fe5b-4c30-a28f-a647170decba-crio-socket\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.574061 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.574031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bssfh\" (UniqueName: \"kubernetes.io/projected/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-api-access-bssfh\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.574201 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.574152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cfaeaa3-fe5b-4c30-a28f-a647170decba-data-volume\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.574201 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.574188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.574311 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.574273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cfaeaa3-fe5b-4c30-a28f-a647170decba-crio-socket\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.574362 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.574322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.574362 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.574356    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:40.574455 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.574417    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:41.074401522 +0000 UTC m=+44.746791866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:40.574455 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.574429    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:41:40.574548 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.574487    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:41.074469207 +0000 UTC m=+44.746859582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : configmap "kube-rbac-proxy" not found
Jul 21 00:41:40.574548 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.574503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cfaeaa3-fe5b-4c30-a28f-a647170decba-crio-socket\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.574548 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.574509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cfaeaa3-fe5b-4c30-a28f-a647170decba-data-volume\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.580466 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.580443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.583827 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.583802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bssfh\" (UniqueName: \"kubernetes.io/projected/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-api-access-bssfh\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:40.682465 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.682396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.838945 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.838911    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.939207 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.939128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:40.977857 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.977816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:40.977972 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:40.977881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:40.977972 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.977953    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:41:40.978067 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.978009    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls podName:cde337ab-bd30-48ce-b01c-2f2582c6cff0 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:48.977994353 +0000 UTC m=+52.650384697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls") pod "dns-default-ntlfq" (UID: "cde337ab-bd30-48ce-b01c-2f2582c6cff0") : secret "dns-default-metrics-tls" not found
Jul 21 00:41:40.978067 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.978013    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 00:41:40.978067 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.978026    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bbb4dff7-v9sws: secret "image-registry-tls" not found
Jul 21 00:41:40.978186 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:40.978076    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls podName:3be64348-c49c-44ca-ba2e-7def9d974834 nodeName:}" failed. No retries permitted until 2026-07-21 00:41:48.978061275 +0000 UTC m=+52.650451661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls") pod "image-registry-58bbb4dff7-v9sws" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834") : secret "image-registry-tls" not found
Jul 21 00:41:41.053243 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.053211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:41.072239 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.072216    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"]
Jul 21 00:41:41.078273 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.078247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:41.078389 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.078325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:41.078389 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:41.078375    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:41.078461 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:41.078410    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:41:41.078461 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:41.078433    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:42.078418745 +0000 UTC m=+45.750809089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:41.078536 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:41.078477    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:42.078465513 +0000 UTC m=+45.750855874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : configmap "kube-rbac-proxy" not found
Jul 21 00:41:41.092527 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.092501    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"]
Jul 21 00:41:41.092615 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.092580    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"
Jul 21 00:41:41.094733 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.094714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 00:41:41.094855 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.094840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-td2fk\""
Jul 21 00:41:41.094924 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.094906    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 00:41:41.123049 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.123022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:41.178819 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.178768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz5qb\" (UniqueName: \"kubernetes.io/projected/579833fa-c4b9-4f8b-8270-2967c6eb143f-kube-api-access-lz5qb\") pod \"migrator-7cc9c7ffd7-gd7hm\" (UID: \"579833fa-c4b9-4f8b-8270-2967c6eb143f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"
Jul 21 00:41:41.179277 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.179259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:41.280167 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.280089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz5qb\" (UniqueName: \"kubernetes.io/projected/579833fa-c4b9-4f8b-8270-2967c6eb143f-kube-api-access-lz5qb\") pod \"migrator-7cc9c7ffd7-gd7hm\" (UID: \"579833fa-c4b9-4f8b-8270-2967c6eb143f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"
Jul 21 00:41:41.287686 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.287657    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:41.287886 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.287870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz5qb\" (UniqueName: \"kubernetes.io/projected/579833fa-c4b9-4f8b-8270-2967c6eb143f-kube-api-access-lz5qb\") pod \"migrator-7cc9c7ffd7-gd7hm\" (UID: \"579833fa-c4b9-4f8b-8270-2967c6eb143f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"
Jul 21 00:41:41.337435 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.337406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:41.401136 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.401106    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"
Jul 21 00:41:41.528291 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:41.528263    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm"]
Jul 21 00:41:41.531216 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:41:41.531144    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579833fa_c4b9_4f8b_8270_2967c6eb143f.slice/crio-14414c7308b04b2953da6c184f1af6fad0da479f99e3ee78cff0e368d5f40430 WatchSource:0}: Error finding container 14414c7308b04b2953da6c184f1af6fad0da479f99e3ee78cff0e368d5f40430: Status 404 returned error can't find the container with id 14414c7308b04b2953da6c184f1af6fad0da479f99e3ee78cff0e368d5f40430
Jul 21 00:41:42.015116 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.015078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm" event={"ID":"579833fa-c4b9-4f8b-8270-2967c6eb143f","Type":"ContainerStarted","Data":"14414c7308b04b2953da6c184f1af6fad0da479f99e3ee78cff0e368d5f40430"}
Jul 21 00:41:42.086624 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.086590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:42.086795 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.086667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:42.086795 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:42.086717    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:41:42.086795 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:42.086793    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:42.086887 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:42.086806    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:44.086767114 +0000 UTC m=+47.759157479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : configmap "kube-rbac-proxy" not found
Jul 21 00:41:42.086887 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:42.086829    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:44.086818559 +0000 UTC m=+47.759208903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:42.111235 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.111213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7sxq_836b0627-f6be-42b9-b8bc-e12dcba46ccf/dns-node-resolver/0.log"
Jul 21 00:41:42.433282 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.432876    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-cjppn"]
Jul 21 00:41:42.444454 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.444428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.444630 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.444481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-cjppn"]
Jul 21 00:41:42.446617 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.446599    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 00:41:42.446723 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.446604    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 00:41:42.447318 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.447297    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 00:41:42.447531 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.447511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2nb7q\""
Jul 21 00:41:42.447792 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.447762    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 00:41:42.469541 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.469520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:42.490587 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.490567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh892\" (UniqueName: \"kubernetes.io/projected/fcc886a7-3650-4e5e-8c47-3117e2389fb7-kube-api-access-nh892\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.490680 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.490620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fcc886a7-3650-4e5e-8c47-3117e2389fb7-signing-cabundle\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.490796 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.490756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fcc886a7-3650-4e5e-8c47-3117e2389fb7-signing-key\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.591656 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.591625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fcc886a7-3650-4e5e-8c47-3117e2389fb7-signing-cabundle\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.591815 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.591739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fcc886a7-3650-4e5e-8c47-3117e2389fb7-signing-key\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.591815 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.591792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh892\" (UniqueName: \"kubernetes.io/projected/fcc886a7-3650-4e5e-8c47-3117e2389fb7-kube-api-access-nh892\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.592502 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.592476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fcc886a7-3650-4e5e-8c47-3117e2389fb7-signing-cabundle\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.594393 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.594370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fcc886a7-3650-4e5e-8c47-3117e2389fb7-signing-key\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.600076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.600056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh892\" (UniqueName: \"kubernetes.io/projected/fcc886a7-3650-4e5e-8c47-3117e2389fb7-kube-api-access-nh892\") pod \"service-ca-58598695f7-cjppn\" (UID: \"fcc886a7-3650-4e5e-8c47-3117e2389fb7\") " pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.755051 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.754986    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-cjppn"
Jul 21 00:41:42.912604 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:42.912575    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m688j_08434792-4357-45d1-8b53-ce207c60e3e4/node-ca/0.log"
Jul 21 00:41:43.148803 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:43.148760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-cjppn"]
Jul 21 00:41:43.152336 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:41:43.152312    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc886a7_3650_4e5e_8c47_3117e2389fb7.slice/crio-530c9b1e59e7b6136615fcbfd4c00e8cbd6151296c9b5a22d76d287b8e3d2ba3 WatchSource:0}: Error finding container 530c9b1e59e7b6136615fcbfd4c00e8cbd6151296c9b5a22d76d287b8e3d2ba3: Status 404 returned error can't find the container with id 530c9b1e59e7b6136615fcbfd4c00e8cbd6151296c9b5a22d76d287b8e3d2ba3
Jul 21 00:41:43.307384 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:43.307309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:43.712116 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:43.712087    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcgfm_0fa73e2a-1f8c-40f7-a489-96821178deab/serve-healthcheck-canary/0.log"
Jul 21 00:41:44.022432 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:44.022347    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm" event={"ID":"579833fa-c4b9-4f8b-8270-2967c6eb143f","Type":"ContainerStarted","Data":"a1611418a4371318e19082353f85a899e6d597ead007132ba93540b7d1b5a3d5"}
Jul 21 00:41:44.022432 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:44.022415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm" event={"ID":"579833fa-c4b9-4f8b-8270-2967c6eb143f","Type":"ContainerStarted","Data":"2afd24fce4415e3a1fac1d0e4a634ef4acc032e0e8078b366bf586bad35a500b"}
Jul 21 00:41:44.023575 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:44.023552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-cjppn" event={"ID":"fcc886a7-3650-4e5e-8c47-3117e2389fb7","Type":"ContainerStarted","Data":"530c9b1e59e7b6136615fcbfd4c00e8cbd6151296c9b5a22d76d287b8e3d2ba3"}
Jul 21 00:41:44.037899 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:44.037768    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gd7hm" podStartSLOduration=1.222535061 podStartE2EDuration="3.037749804s" totalImagesPullingTime="1.815214743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:44.037535064 +0000 UTC m=+47.709925430" watchObservedRunningTime="2026-07-21 00:41:44.037749804 +0000 UTC m=+47.710140171"
Jul 21 00:41:44.105156 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:44.105122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:44.105274 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:44.105232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:44.105339 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:44.105279    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:44.105339 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:44.105321    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:41:44.105339 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:44.105338    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:48.105320054 +0000 UTC m=+51.777710412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:44.105476 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:44.105354    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:48.10534455 +0000 UTC m=+51.777734907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : configmap "kube-rbac-proxy" not found
Jul 21 00:41:44.640259 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:44.640217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:46.030792 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:46.030741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-cjppn" event={"ID":"fcc886a7-3650-4e5e-8c47-3117e2389fb7","Type":"ContainerStarted","Data":"8bce7ebe14e5ce775357dcb79c756fcff1aafb75300674a5c223b4c2435fd24a"}
Jul 21 00:41:46.106668 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:46.106643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:46.840288 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:46.840248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:46.972987 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:46.972951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:47.102980 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:47.102903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:47.203548 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:47.203507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:47.305748 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:47.305721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:48.135385 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:48.135346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:48.135853 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:48.135416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:48.135853 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:48.135522    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:48.135853 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:48.135575    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls podName:9cfaeaa3-fe5b-4c30-a28f-a647170decba nodeName:}" failed. No retries permitted until 2026-07-21 00:41:56.135554621 +0000 UTC m=+59.807944967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2cnk" (UID: "9cfaeaa3-fe5b-4c30-a28f-a647170decba") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:41:48.136076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:48.136056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cfaeaa3-fe5b-4c30-a28f-a647170decba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:48.140412 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:48.140388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:48.538606 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:48.538538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:48.744906 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:48.744871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:48.934154 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:48.934120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:49.041733 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:49.041706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:41:49.041891 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:49.041747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:41:49.041891 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:49.041872    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:41:49.041891 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:49.041888    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 00:41:49.042007 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:49.041899    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58bbb4dff7-v9sws: secret "image-registry-tls" not found
Jul 21 00:41:49.042007 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:49.041947    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls podName:cde337ab-bd30-48ce-b01c-2f2582c6cff0 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:05.041928688 +0000 UTC m=+68.714319045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls") pod "dns-default-ntlfq" (UID: "cde337ab-bd30-48ce-b01c-2f2582c6cff0") : secret "dns-default-metrics-tls" not found
Jul 21 00:41:49.042007 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:41:49.041960    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls podName:3be64348-c49c-44ca-ba2e-7def9d974834 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:05.041955074 +0000 UTC m=+68.714345418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls") pod "image-registry-58bbb4dff7-v9sws" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834") : secret "image-registry-tls" not found
Jul 21 00:41:49.341487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:49.341458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:49.392641 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:49.392609    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:49.625363 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:49.625284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:50.139994 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:50.139964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:50.437877 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:50.437795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:50.538682 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:50.538653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:50.639584 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:50.639550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:50.739731 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:50.739643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:50.937345 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:50.937306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:51.139291 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:51.139255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:51.210755 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:51.210724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:52.137038 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:52.137010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:52.535368 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:52.535291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:52.740884 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:52.740853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:52.943450 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:52.943421    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:53.154203 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:53.154166    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:53.392676 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:53.392647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:53.626301 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:53.626267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:54.138144 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:54.138111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:54.783245 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:54.783207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:54.833782 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:54.833753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:54.893888 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:54.893860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:54.995408 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:54.995377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:55.338437 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:55.338406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:55.936667 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:55.936638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:56.196464 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.196371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:56.198764 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.198736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cfaeaa3-fe5b-4c30-a28f-a647170decba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2cnk\" (UID: \"9cfaeaa3-fe5b-4c30-a28f-a647170decba\") " pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:56.309852 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.309819    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c2cnk"
Jul 21 00:41:56.431143 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.431086    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-cjppn" podStartSLOduration=12.093677045 podStartE2EDuration="14.431068915s" totalImagesPullingTime="2.33739187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:41:46.045493387 +0000 UTC m=+49.717883754" watchObservedRunningTime="2026-07-21 00:41:56.431068915 +0000 UTC m=+60.103459310"
Jul 21 00:41:56.431345 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.431284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c2cnk"]
Jul 21 00:41:56.435981 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:41:56.435949    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cfaeaa3_fe5b_4c30_a28f_a647170decba.slice/crio-3564c8545086ae4f3ca66fca56f9a8088360942eccc54e6d8feb3f5ede2b55a3 WatchSource:0}: Error finding container 3564c8545086ae4f3ca66fca56f9a8088360942eccc54e6d8feb3f5ede2b55a3: Status 404 returned error can't find the container with id 3564c8545086ae4f3ca66fca56f9a8088360942eccc54e6d8feb3f5ede2b55a3
Jul 21 00:41:56.840006 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.839973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:56.940789 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.940736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:56.989072 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:56.989041    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:57.059831 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:57.059792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2cnk" event={"ID":"9cfaeaa3-fe5b-4c30-a28f-a647170decba","Type":"ContainerStarted","Data":"3564c8545086ae4f3ca66fca56f9a8088360942eccc54e6d8feb3f5ede2b55a3"}
Jul 21 00:41:57.139492 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:57.139362    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:57.534665 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:57.534588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:41:57.972270 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:41:57.972233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgswq"
Jul 21 00:42:01.644980 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.644940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:42:01.647090 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.647070    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 00:42:01.658282 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.658264    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 00:42:01.668180 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.668160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp6pc\" (UniqueName: \"kubernetes.io/projected/9d0b617f-a8a9-4fb5-b5ae-771d552cdca7-kube-api-access-kp6pc\") pod \"network-check-target-shvb7\" (UID: \"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7\") " pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:42:01.746296 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.746265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:42:01.746470 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.746330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:42:01.748744 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.748723    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 00:42:01.748806 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.748723    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 00:42:01.759563 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.759540    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nqmsz\""
Jul 21 00:42:01.759675 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.759609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcf87c52-a489-48f9-b382-1e22ec687300-metrics-certs\") pod \"network-metrics-daemon-94k2f\" (UID: \"fcf87c52-a489-48f9-b382-1e22ec687300\") " pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:42:01.759675 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.759617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2c6f987-646c-4341-9190-3fa552d5fe92-original-pull-secret\") pod \"global-pull-secret-syncer-76c2g\" (UID: \"b2c6f987-646c-4341-9190-3fa552d5fe92\") " pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:42:01.764981 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.764959    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wcfmk\""
Jul 21 00:42:01.768425 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.768406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:42:01.773533 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.773519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94k2f"
Jul 21 00:42:01.859091 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.859066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76c2g"
Jul 21 00:42:01.896802 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.896706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-shvb7"]
Jul 21 00:42:01.899595 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:01.899561    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0b617f_a8a9_4fb5_b5ae_771d552cdca7.slice/crio-746a2479181ab9784105edf15098386864822fe4b4e8440c849a457e0a4e2017 WatchSource:0}: Error finding container 746a2479181ab9784105edf15098386864822fe4b4e8440c849a457e0a4e2017: Status 404 returned error can't find the container with id 746a2479181ab9784105edf15098386864822fe4b4e8440c849a457e0a4e2017
Jul 21 00:42:01.913657 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.913623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94k2f"]
Jul 21 00:42:01.990860 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:01.990512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76c2g"]
Jul 21 00:42:01.994843 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:01.994818    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c6f987_646c_4341_9190_3fa552d5fe92.slice/crio-7e9444b96d4e60e2263979a9f8eb4f15fe3b04b49af693df40131b6c2aaf4ddb WatchSource:0}: Error finding container 7e9444b96d4e60e2263979a9f8eb4f15fe3b04b49af693df40131b6c2aaf4ddb: Status 404 returned error can't find the container with id 7e9444b96d4e60e2263979a9f8eb4f15fe3b04b49af693df40131b6c2aaf4ddb
Jul 21 00:42:02.075224 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:02.075190    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2cnk" event={"ID":"9cfaeaa3-fe5b-4c30-a28f-a647170decba","Type":"ContainerStarted","Data":"562d106cc0271fd305d7710192798ed2e6791f5b2c7c3abef04e9f7ad115f6f1"}
Jul 21 00:42:02.076391 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:02.076359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76c2g" event={"ID":"b2c6f987-646c-4341-9190-3fa552d5fe92","Type":"ContainerStarted","Data":"7e9444b96d4e60e2263979a9f8eb4f15fe3b04b49af693df40131b6c2aaf4ddb"}
Jul 21 00:42:02.077428 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:02.077406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-shvb7" event={"ID":"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7","Type":"ContainerStarted","Data":"746a2479181ab9784105edf15098386864822fe4b4e8440c849a457e0a4e2017"}
Jul 21 00:42:02.078560 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:02.078537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94k2f" event={"ID":"fcf87c52-a489-48f9-b382-1e22ec687300","Type":"ContainerStarted","Data":"2beca9f30bdb5a46c65065c919b9eb3fa83b0067a9c07ca71001240f6b1d3912"}
Jul 21 00:42:04.092346 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.092247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94k2f" event={"ID":"fcf87c52-a489-48f9-b382-1e22ec687300","Type":"ContainerStarted","Data":"77ab39791e9c9e375c934eaa3812bc3bf8ac36309a7621cbf232b8f734f2d36b"}
Jul 21 00:42:04.092346 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.092310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94k2f" event={"ID":"fcf87c52-a489-48f9-b382-1e22ec687300","Type":"ContainerStarted","Data":"08e177ecf19ed131d9ab90e8b44168316fdd6009f897de5de5720e9ad0b76e52"}
Jul 21 00:42:04.119221 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.118606    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-94k2f" podStartSLOduration=66.027461204 podStartE2EDuration="1m7.118585935s" totalImagesPullingTime="1.091124731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:04.117732953 +0000 UTC m=+67.790123332" watchObservedRunningTime="2026-07-21 00:42:04.118585935 +0000 UTC m=+67.790976302"
Jul 21 00:42:04.123016 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.122989    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"]
Jul 21 00:42:04.132130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.131673    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"]
Jul 21 00:42:04.132623 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.132358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.134114 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.133744    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"]
Jul 21 00:42:04.134114 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.133874    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.135875 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.135583    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cf8vm\""
Jul 21 00:42:04.135875 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.135684    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 00:42:04.135875 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.135739    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 00:42:04.136077 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.136015    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 00:42:04.136174 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.136076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 00:42:04.136831 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.136329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.136831 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.136442    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 00:42:04.139271 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.139062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 00:42:04.140248 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.139592    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 00:42:04.140248 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.139857    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 00:42:04.140248 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.140102    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 00:42:04.140248 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.140224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"]
Jul 21 00:42:04.144482 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.144460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"]
Jul 21 00:42:04.148613 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.148563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"]
Jul 21 00:42:04.228443 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.228404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:04.272721 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.272685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-hub\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.272885 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.272736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqdff\" (UniqueName: \"kubernetes.io/projected/69bac3d3-6c67-43f1-b504-4796d1545199-kube-api-access-qqdff\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.272885 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.272838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.272885 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.272879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-ca\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.273055 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.272914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvdhc\" (UniqueName: \"kubernetes.io/projected/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-kube-api-access-pvdhc\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.273055 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.272955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.273055 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.272986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6bd8171-a89c-4358-b7a9-9859ce97bb57-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8585dfff9d-mkp4z\" (UID: \"f6bd8171-a89c-4358-b7a9-9859ce97bb57\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.273055 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.273021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69bac3d3-6c67-43f1-b504-4796d1545199-tmp\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.273241 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.273070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/69bac3d3-6c67-43f1-b504-4796d1545199-klusterlet-config\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.273241 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.273116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzbzn\" (UniqueName: \"kubernetes.io/projected/f6bd8171-a89c-4358-b7a9-9859ce97bb57-kube-api-access-pzbzn\") pod \"managed-serviceaccount-addon-agent-8585dfff9d-mkp4z\" (UID: \"f6bd8171-a89c-4358-b7a9-9859ce97bb57\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.273241 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.273141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.323923 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.323891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:04.374377 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvdhc\" (UniqueName: \"kubernetes.io/projected/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-kube-api-access-pvdhc\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.374377 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.374377 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6bd8171-a89c-4358-b7a9-9859ce97bb57-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8585dfff9d-mkp4z\" (UID: \"f6bd8171-a89c-4358-b7a9-9859ce97bb57\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.374377 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69bac3d3-6c67-43f1-b504-4796d1545199-tmp\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.375124 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/69bac3d3-6c67-43f1-b504-4796d1545199-klusterlet-config\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.375124 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzbzn\" (UniqueName: \"kubernetes.io/projected/f6bd8171-a89c-4358-b7a9-9859ce97bb57-kube-api-access-pzbzn\") pod \"managed-serviceaccount-addon-agent-8585dfff9d-mkp4z\" (UID: \"f6bd8171-a89c-4358-b7a9-9859ce97bb57\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.375124 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.375124 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-hub\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.375124 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqdff\" (UniqueName: \"kubernetes.io/projected/69bac3d3-6c67-43f1-b504-4796d1545199-kube-api-access-qqdff\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.375124 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.375124 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.374635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-ca\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.376739 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.376595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.376739 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.376726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69bac3d3-6c67-43f1-b504-4796d1545199-tmp\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.382129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.379233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-ca\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.382129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.380881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/69bac3d3-6c67-43f1-b504-4796d1545199-klusterlet-config\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.382129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.381103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-hub\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.382129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.381141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6bd8171-a89c-4358-b7a9-9859ce97bb57-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8585dfff9d-mkp4z\" (UID: \"f6bd8171-a89c-4358-b7a9-9859ce97bb57\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.382129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.381154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.382761 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.382738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.390293 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.390247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzbzn\" (UniqueName: \"kubernetes.io/projected/f6bd8171-a89c-4358-b7a9-9859ce97bb57-kube-api-access-pzbzn\") pod \"managed-serviceaccount-addon-agent-8585dfff9d-mkp4z\" (UID: \"f6bd8171-a89c-4358-b7a9-9859ce97bb57\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.395957 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.395856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqdff\" (UniqueName: \"kubernetes.io/projected/69bac3d3-6c67-43f1-b504-4796d1545199-kube-api-access-qqdff\") pod \"klusterlet-addon-workmgr-66c7fd4748-wjqdf\" (UID: \"69bac3d3-6c67-43f1-b504-4796d1545199\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.397497 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.397475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvdhc\" (UniqueName: \"kubernetes.io/projected/b13cebed-34d1-4ed1-9c18-a8dca5e65a26-kube-api-access-pvdhc\") pod \"cluster-proxy-proxy-agent-5548ddcbbb-7zxs4\" (UID: \"b13cebed-34d1-4ed1-9c18-a8dca5e65a26\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.437402 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.437314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:04.465995 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.465967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"
Jul 21 00:42:04.472556 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.472530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:04.480807 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.480769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"
Jul 21 00:42:04.526751 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.526686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:04.620158 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:04.620113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:05.081204 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.081168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:42:05.081387 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.081245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:42:05.083429 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.083392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde337ab-bd30-48ce-b01c-2f2582c6cff0-metrics-tls\") pod \"dns-default-ntlfq\" (UID: \"cde337ab-bd30-48ce-b01c-2f2582c6cff0\") " pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:42:05.083538 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.083453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"image-registry-58bbb4dff7-v9sws\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") " pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:42:05.302174 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.302136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:05.342063 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.341990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9r7r2\""
Jul 21 00:42:05.350801 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.350767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:42:05.362811 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.362791    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lf5vb\""
Jul 21 00:42:05.369333 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.369306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:05.371737 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.371715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:42:05.428170 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.428130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:05.529015 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.528954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:05.620376 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.620299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:05.677552 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.677522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:05.777762 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:05.777716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:06.110229 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:06.110194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:06.304893 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:06.304856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:06.405238 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:06.405144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:07.532913 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:07.532879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:07.583607 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:07.583573    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:08.933018 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:08.932987    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"]
Jul 21 00:42:08.936550 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:08.936500    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z"]
Jul 21 00:42:08.951532 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:08.951512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58bbb4dff7-v9sws"]
Jul 21 00:42:09.045716 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:09.045681    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bac3d3_6c67_43f1_b504_4796d1545199.slice/crio-7ae1c9f5ff8760521ed50096c3f32011c30bacaad721586d43fdabbe9954e7b7 WatchSource:0}: Error finding container 7ae1c9f5ff8760521ed50096c3f32011c30bacaad721586d43fdabbe9954e7b7: Status 404 returned error can't find the container with id 7ae1c9f5ff8760521ed50096c3f32011c30bacaad721586d43fdabbe9954e7b7
Jul 21 00:42:09.046141 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:09.046111    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6bd8171_a89c_4358_b7a9_9859ce97bb57.slice/crio-04090bcfd9f4fc6e4d120bf44becd69a26aa2463994c0cd78ff203d5a3545b1c WatchSource:0}: Error finding container 04090bcfd9f4fc6e4d120bf44becd69a26aa2463994c0cd78ff203d5a3545b1c: Status 404 returned error can't find the container with id 04090bcfd9f4fc6e4d120bf44becd69a26aa2463994c0cd78ff203d5a3545b1c
Jul 21 00:42:09.047079 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:09.047055    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be64348_c49c_44ca_ba2e_7def9d974834.slice/crio-6b6db1ea1a3dca6b273b9597970af600d04c259f4c009a3057ff9f1c794fec7e WatchSource:0}: Error finding container 6b6db1ea1a3dca6b273b9597970af600d04c259f4c009a3057ff9f1c794fec7e: Status 404 returned error can't find the container with id 6b6db1ea1a3dca6b273b9597970af600d04c259f4c009a3057ff9f1c794fec7e
Jul 21 00:42:09.109464 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.109436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76c2g" event={"ID":"b2c6f987-646c-4341-9190-3fa552d5fe92","Type":"ContainerStarted","Data":"40ff250a0e7104e182ae029a60449f1459639a742dbbad7e83ab2d92b35e4083"}
Jul 21 00:42:09.110544 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.110523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws" event={"ID":"3be64348-c49c-44ca-ba2e-7def9d974834","Type":"ContainerStarted","Data":"6b6db1ea1a3dca6b273b9597970af600d04c259f4c009a3057ff9f1c794fec7e"}
Jul 21 00:42:09.111593 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.111571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf" event={"ID":"69bac3d3-6c67-43f1-b504-4796d1545199","Type":"ContainerStarted","Data":"7ae1c9f5ff8760521ed50096c3f32011c30bacaad721586d43fdabbe9954e7b7"}
Jul 21 00:42:09.112548 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.112522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z" event={"ID":"f6bd8171-a89c-4358-b7a9-9859ce97bb57","Type":"ContainerStarted","Data":"04090bcfd9f4fc6e4d120bf44becd69a26aa2463994c0cd78ff203d5a3545b1c"}
Jul 21 00:42:09.113745 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.113726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-shvb7" event={"ID":"9d0b617f-a8a9-4fb5-b5ae-771d552cdca7","Type":"ContainerStarted","Data":"c72562c2b88a3d19d7d77650237228e8dbc15623dd82c1eeb721dcafabce28c4"}
Jul 21 00:42:09.125640 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.125619    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:42:09.138989 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.138943    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-76c2g" podStartSLOduration=65.412931348 podStartE2EDuration="1m12.138927286s" totalImagesPullingTime="6.725995938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:09.138553536 +0000 UTC m=+72.810943902" watchObservedRunningTime="2026-07-21 00:42:09.138927286 +0000 UTC m=+72.811317654"
Jul 21 00:42:09.152561 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.152518    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-shvb7" podStartSLOduration=65.349453283 podStartE2EDuration="1m12.152503044s" totalImagesPullingTime="6.803049761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:09.151356271 +0000 UTC m=+72.823746665" watchObservedRunningTime="2026-07-21 00:42:09.152503044 +0000 UTC m=+72.824893409"
Jul 21 00:42:09.172368 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.172346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntlfq"]
Jul 21 00:42:09.175689 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.175633    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4"]
Jul 21 00:42:09.176086 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:09.176055    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde337ab_bd30_48ce_b01c_2f2582c6cff0.slice/crio-3dd6f79eeb3a1f7659c851dfda2cfafdabc3966258fce1867e882fda4bc8255a WatchSource:0}: Error finding container 3dd6f79eeb3a1f7659c851dfda2cfafdabc3966258fce1867e882fda4bc8255a: Status 404 returned error can't find the container with id 3dd6f79eeb3a1f7659c851dfda2cfafdabc3966258fce1867e882fda4bc8255a
Jul 21 00:42:09.179905 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:09.179882    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb13cebed_34d1_4ed1_9c18_a8dca5e65a26.slice/crio-bf6202d298f3d9401106a5306d74b287b2893d8169047be5e7ffcc025ce11b71 WatchSource:0}: Error finding container bf6202d298f3d9401106a5306d74b287b2893d8169047be5e7ffcc025ce11b71: Status 404 returned error can't find the container with id bf6202d298f3d9401106a5306d74b287b2893d8169047be5e7ffcc025ce11b71
Jul 21 00:42:09.898810 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.898759    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:09.953048 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:09.953007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:10.119580 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:10.119540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4" event={"ID":"b13cebed-34d1-4ed1-9c18-a8dca5e65a26","Type":"ContainerStarted","Data":"bf6202d298f3d9401106a5306d74b287b2893d8169047be5e7ffcc025ce11b71"}
Jul 21 00:42:10.121857 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:10.121830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2cnk" event={"ID":"9cfaeaa3-fe5b-4c30-a28f-a647170decba","Type":"ContainerStarted","Data":"1860d6a2122ac98811bb7f9915296b6caa873d71d61ceb366a47480e7b50ae54"}
Jul 21 00:42:10.124262 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:10.123672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws" event={"ID":"3be64348-c49c-44ca-ba2e-7def9d974834","Type":"ContainerStarted","Data":"d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f"}
Jul 21 00:42:10.124262 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:10.123918    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:42:10.125656 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:10.125631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntlfq" event={"ID":"cde337ab-bd30-48ce-b01c-2f2582c6cff0","Type":"ContainerStarted","Data":"3dd6f79eeb3a1f7659c851dfda2cfafdabc3966258fce1867e882fda4bc8255a"}
Jul 21 00:42:10.629513 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:10.629474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:10.682893 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:10.682854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:11.254678 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:11.254584    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:11.343070 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:11.342999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:11.773368 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:11.773290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:11.927637 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:11.927558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:14.140608 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:14.140548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:14.200504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:14.200437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:17.155400 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.155315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2cnk" event={"ID":"9cfaeaa3-fe5b-4c30-a28f-a647170decba","Type":"ContainerStarted","Data":"4e78644d4ef58e74cb328754c8deb2a20a5251711c920c664e2011df5fce2a36"}
Jul 21 00:42:17.156816 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.156770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf" event={"ID":"69bac3d3-6c67-43f1-b504-4796d1545199","Type":"ContainerStarted","Data":"7efc972ffdd2f95d4ee06eb5c1f05f3f2bf80e63fc482dcf6e3279453766ae24"}
Jul 21 00:42:17.156928 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.156909    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:17.158551 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.158527    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf"
Jul 21 00:42:17.158722 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.158689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntlfq" event={"ID":"cde337ab-bd30-48ce-b01c-2f2582c6cff0","Type":"ContainerStarted","Data":"677df0698b2f57be75c1c927f83bdfcab1d9a30966e7793f9ce5f7656aa3e578"}
Jul 21 00:42:17.158862 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.158750    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:42:17.158862 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.158790    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntlfq" event={"ID":"cde337ab-bd30-48ce-b01c-2f2582c6cff0","Type":"ContainerStarted","Data":"77bbf1e2c80502c2f68253a3ea80aaba86c193a6e2824039397a6dc47b5fb736"}
Jul 21 00:42:17.160092 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.160070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z" event={"ID":"f6bd8171-a89c-4358-b7a9-9859ce97bb57","Type":"ContainerStarted","Data":"2e8a3bbe781759858942514d3de076c90c3d584b13135f039342cb9a7d22c8e5"}
Jul 21 00:42:17.161830 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.161812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4" event={"ID":"b13cebed-34d1-4ed1-9c18-a8dca5e65a26","Type":"ContainerStarted","Data":"db3fbb677f8f1c280b0e11f2196838c58d4d0266a9d05decafa3bc656a7fcb23"}
Jul 21 00:42:17.161907 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.161839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4" event={"ID":"b13cebed-34d1-4ed1-9c18-a8dca5e65a26","Type":"ContainerStarted","Data":"966191fb89d3748180ea5f899d2959d0555457a11d87779a8081cd06827c1dd0"}
Jul 21 00:42:17.161907 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.161851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4" event={"ID":"b13cebed-34d1-4ed1-9c18-a8dca5e65a26","Type":"ContainerStarted","Data":"e5a2fc420a5899f68c68a1e771671667145c50617864b07dc9e3cfc4588d673a"}
Jul 21 00:42:17.173050 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.173011    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws" podStartSLOduration=72.172998182 podStartE2EDuration="1m12.172998182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:10.144508029 +0000 UTC m=+73.816898395" watchObservedRunningTime="2026-07-21 00:42:17.172998182 +0000 UTC m=+80.845388548"
Jul 21 00:42:17.173140 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.173106    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c2cnk" podStartSLOduration=17.186192426 podStartE2EDuration="37.173101181s" totalImagesPullingTime="19.986908755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:41:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.171527522 +0000 UTC m=+80.843917889" watchObservedRunningTime="2026-07-21 00:42:17.173101181 +0000 UTC m=+80.845491546"
Jul 21 00:42:17.186905 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.186863    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66c7fd4748-wjqdf" podStartSLOduration=5.646921006 podStartE2EDuration="13.186847849s" totalImagesPullingTime="7.539926843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.186278714 +0000 UTC m=+80.858669081" watchObservedRunningTime="2026-07-21 00:42:17.186847849 +0000 UTC m=+80.859238192"
Jul 21 00:42:17.203332 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.203291    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5548ddcbbb-7zxs4" podStartSLOduration=5.755487931 podStartE2EDuration="13.203275951s" totalImagesPullingTime="7.44778802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.202233798 +0000 UTC m=+80.874624164" watchObservedRunningTime="2026-07-21 00:42:17.203275951 +0000 UTC m=+80.875666317"
Jul 21 00:42:17.217567 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.217522    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ntlfq" podStartSLOduration=36.784543832 podStartE2EDuration="44.217506833s" totalImagesPullingTime="7.432963001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.216584264 +0000 UTC m=+80.888974628" watchObservedRunningTime="2026-07-21 00:42:17.217506833 +0000 UTC m=+80.889897199"
Jul 21 00:42:17.230816 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:17.230740    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8585dfff9d-mkp4z" podStartSLOduration=5.691017078 podStartE2EDuration="13.230727291s" totalImagesPullingTime="7.539710213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:17.230090245 +0000 UTC m=+80.902480614" watchObservedRunningTime="2026-07-21 00:42:17.230727291 +0000 UTC m=+80.903117659"
Jul 21 00:42:18.468804 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:18.468757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:18.541958 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:18.541924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:18.757832 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:18.757726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:18.815764 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:18.815730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:21.221675 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:21.221627    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:21.961442 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:21.961406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:24.734287 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:24.734259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:24.831718 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:24.831685    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:24.932919 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:24.932888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:25.074975 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:25.074945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:25.269827 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:25.269794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:25.355543 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:25.355462    2560 patch_prober.go:28] interesting pod/image-registry-58bbb4dff7-v9sws container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 00:42:25.355543 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:25.355531    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws" podUID="3be64348-c49c-44ca-ba2e-7def9d974834" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 00:42:26.736490 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:26.736458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:27.167178 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.167146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ntlfq"
Jul 21 00:42:27.584839 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.584809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:27.810440 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.810401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:27.852331 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.852253    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4nqk"]
Jul 21 00:42:27.855993 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.855972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.858414 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.858392    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 00:42:27.858535 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.858515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 00:42:27.858756 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.858740    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 00:42:27.858854 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.858832    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 00:42:27.858997 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.858979    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 00:42:27.859077 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.859029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cx8t6\""
Jul 21 00:42:27.859077 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.859029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 00:42:27.894522 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.894494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:27.954335 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954335 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954589 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-tls\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954589 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7tsc\" (UniqueName: \"kubernetes.io/projected/b3e8ae89-97d3-459c-a466-735c81dbc3d8-kube-api-access-n7tsc\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954589 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-textfile\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954589 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-sys\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954589 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-wtmp\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-root\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.954880 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.954647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e8ae89-97d3-459c-a466-735c81dbc3d8-metrics-client-ca\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:27.955577 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:27.955554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:28.055419 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-textfile\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.055635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-sys\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.055635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-wtmp\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.055635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-root\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.055635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e8ae89-97d3-459c-a466-735c81dbc3d8-metrics-client-ca\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.055635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.055635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.056011 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-tls\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.056011 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.055686    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7tsc\" (UniqueName: \"kubernetes.io/projected/b3e8ae89-97d3-459c-a466-735c81dbc3d8-kube-api-access-n7tsc\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.056309 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.056275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-root\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.056441 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.056309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-textfile\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.056441 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:42:28.056318    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 00:42:28.056441 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.056284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-wtmp\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.056441 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:42:28.056402    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-tls podName:b3e8ae89-97d3-459c-a466-735c81dbc3d8 nodeName:}" failed. No retries permitted until 2026-07-21 00:42:28.556381561 +0000 UTC m=+92.228771910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-tls") pod "node-exporter-s4nqk" (UID: "b3e8ae89-97d3-459c-a466-735c81dbc3d8") : secret "node-exporter-tls" not found
Jul 21 00:42:28.056760 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.056717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.056889 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.056810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e8ae89-97d3-459c-a466-735c81dbc3d8-sys\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.057152 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.057132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e8ae89-97d3-459c-a466-735c81dbc3d8-metrics-client-ca\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.059234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.059210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.066443 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.066421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7tsc\" (UniqueName: \"kubernetes.io/projected/b3e8ae89-97d3-459c-a466-735c81dbc3d8-kube-api-access-n7tsc\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.088961 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.088935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:28.190108 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.190020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:28.431398 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.431363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:28.531969 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.531885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:28.559540 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.559507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-tls\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.562398 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.562366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3e8ae89-97d3-459c-a466-735c81dbc3d8-node-exporter-tls\") pod \"node-exporter-s4nqk\" (UID: \"b3e8ae89-97d3-459c-a466-735c81dbc3d8\") " pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.766624 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:28.766583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4nqk"
Jul 21 00:42:28.777237 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:42:28.777205    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e8ae89_97d3_459c_a466_735c81dbc3d8.slice/crio-295003692ed2576992f1e2ebaaeaa0ef2e2351f39b18fde2f7427ac08d8d49fb WatchSource:0}: Error finding container 295003692ed2576992f1e2ebaaeaa0ef2e2351f39b18fde2f7427ac08d8d49fb: Status 404 returned error can't find the container with id 295003692ed2576992f1e2ebaaeaa0ef2e2351f39b18fde2f7427ac08d8d49fb
Jul 21 00:42:29.203853 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:29.203815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4nqk" event={"ID":"b3e8ae89-97d3-459c-a466-735c81dbc3d8","Type":"ContainerStarted","Data":"295003692ed2576992f1e2ebaaeaa0ef2e2351f39b18fde2f7427ac08d8d49fb"}
Jul 21 00:42:29.234686 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:29.234651    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:29.317217 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:29.317183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:30.208345 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:30.208307    2560 generic.go:356] "Generic (PLEG): container finished" podID="b3e8ae89-97d3-459c-a466-735c81dbc3d8" containerID="972c96d59178ce1e8c772a35da32dace6105923a13fe5dfa7b0344ac21af57c6" exitCode=0
Jul 21 00:42:30.208742 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:30.208359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4nqk" event={"ID":"b3e8ae89-97d3-459c-a466-735c81dbc3d8","Type":"ContainerDied","Data":"972c96d59178ce1e8c772a35da32dace6105923a13fe5dfa7b0344ac21af57c6"}
Jul 21 00:42:30.464654 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:30.464575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:30.746229 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:30.746136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:30.846041 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:30.845980    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:31.134698 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.134666    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:42:31.134928 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.134658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:31.214563 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.214525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4nqk" event={"ID":"b3e8ae89-97d3-459c-a466-735c81dbc3d8","Type":"ContainerStarted","Data":"cdbacfb0e21d8a8b325788f51448aedf1aa94041b08194fce9ad533f9b11bd2e"}
Jul 21 00:42:31.214962 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.214594    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4nqk" event={"ID":"b3e8ae89-97d3-459c-a466-735c81dbc3d8","Type":"ContainerStarted","Data":"c84e6da3e25b84041cb3c7945aaf6a6a2e7821ecd646218709d8fce4acae2836"}
Jul 21 00:42:31.230886 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.230818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4nqk" podStartSLOduration=3.14398917 podStartE2EDuration="4.230797445s" totalImagesPullingTime="1.022008814s" totalInitContainerRuntime="64.799461ms" isStatefulPod=true podCreationTimestamp="2026-07-21 00:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:42:31.230397648 +0000 UTC m=+94.902788015" watchObservedRunningTime="2026-07-21 00:42:31.230797445 +0000 UTC m=+94.903187812"
Jul 21 00:42:31.232708 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.232688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:31.331987 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.331943    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:31.433162 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:31.433089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:32.624306 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:32.624271    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:32.748758 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:32.748728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:32.845147 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:32.845113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:33.396450 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:33.396371    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58bbb4dff7-v9sws"]
Jul 21 00:42:33.471143 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:33.471113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:33.684744 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:33.684659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:33.900423 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:33.900391    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:33.998150 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:33.998076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:34.077700 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:34.077671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:34.161156 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:34.161119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:34.217248 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:34.217216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:34.533037 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:34.530998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:34.631203 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:34.631170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:34.731158 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:34.731119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:36.546475 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:36.546439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:36.599972 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:36.599938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:39.468381 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:39.468351    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:39.568903 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:39.568871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:39.902755 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:39.902721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:40.002269 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:40.002236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:40.128003 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:40.127966    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-shvb7"
Jul 21 00:42:43.482005 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:43.481973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:43.539662 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:43.539630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:45.339626 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:45.339593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:45.931402 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:45.931370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:46.032184 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:46.032151    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:54.890182 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:54.890146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:54.939963 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:54.939936    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:42:58.416477 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.416414    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws" podUID="3be64348-c49c-44ca-ba2e-7def9d974834" containerName="registry" containerID="cri-o://d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f" gracePeriod=30
Jul 21 00:42:58.661584 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.661559    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:42:58.787631 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvt7m\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-kube-api-access-hvt7m\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.787631 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787625    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-registry-certificates\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.787879 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.787879 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787695    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3be64348-c49c-44ca-ba2e-7def9d974834-ca-trust-extracted\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.787879 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787723    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-trusted-ca\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.787879 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787751    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-bound-sa-token\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.787879 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787817    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-installation-pull-secrets\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.787879 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.787844    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-image-registry-private-configuration\") pod \"3be64348-c49c-44ca-ba2e-7def9d974834\" (UID: \"3be64348-c49c-44ca-ba2e-7def9d974834\") "
Jul 21 00:42:58.788185 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.788116    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:42:58.788301 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.788266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:42:58.790192 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.790171    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-kube-api-access-hvt7m" (OuterVolumeSpecName: "kube-api-access-hvt7m") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "kube-api-access-hvt7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:42:58.790476 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.790441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:42:58.790570 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.790468    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:42:58.790570 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.790529    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:42:58.790570 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.790536    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:42:58.798661 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.798630    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be64348-c49c-44ca-ba2e-7def9d974834-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3be64348-c49c-44ca-ba2e-7def9d974834" (UID: "3be64348-c49c-44ca-ba2e-7def9d974834"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:42:58.889179 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889144    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-registry-certificates\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:58.889179 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889172    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-registry-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:58.889179 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889182    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3be64348-c49c-44ca-ba2e-7def9d974834-ca-trust-extracted\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:58.889403 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889190    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3be64348-c49c-44ca-ba2e-7def9d974834-trusted-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:58.889403 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889199    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-bound-sa-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:58.889403 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889206    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-installation-pull-secrets\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:58.889403 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889215    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3be64348-c49c-44ca-ba2e-7def9d974834-image-registry-private-configuration\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:58.889403 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:58.889225    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvt7m\" (UniqueName: \"kubernetes.io/projected/3be64348-c49c-44ca-ba2e-7def9d974834-kube-api-access-hvt7m\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 00:42:59.307981 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.307944    2560 generic.go:356] "Generic (PLEG): container finished" podID="3be64348-c49c-44ca-ba2e-7def9d974834" containerID="d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f" exitCode=0
Jul 21 00:42:59.307981 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.307984    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws"
Jul 21 00:42:59.308227 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.307998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws" event={"ID":"3be64348-c49c-44ca-ba2e-7def9d974834","Type":"ContainerDied","Data":"d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f"}
Jul 21 00:42:59.308227 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.308047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bbb4dff7-v9sws" event={"ID":"3be64348-c49c-44ca-ba2e-7def9d974834","Type":"ContainerDied","Data":"6b6db1ea1a3dca6b273b9597970af600d04c259f4c009a3057ff9f1c794fec7e"}
Jul 21 00:42:59.308227 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.308073    2560 scope.go:117] "RemoveContainer" containerID="d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f"
Jul 21 00:42:59.316338 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.316313    2560 scope.go:117] "RemoveContainer" containerID="d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f"
Jul 21 00:42:59.316598 ip-10-0-138-241 kubenswrapper[2560]: E0721 00:42:59.316578    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f\": container with ID starting with d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f not found: ID does not exist" containerID="d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f"
Jul 21 00:42:59.316671 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.316611    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f"} err="failed to get container status \"d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f\": rpc error: code = NotFound desc = could not find container \"d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f\": container with ID starting with d748b531f5b7a1a5642b833c21dc2f37bcfdb683a7a19ab309cbfab8001e236f not found: ID does not exist"
Jul 21 00:42:59.323422 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.323401    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58bbb4dff7-v9sws"]
Jul 21 00:42:59.329008 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:42:59.328987    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58bbb4dff7-v9sws"]
Jul 21 00:43:00.852431 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:00.852398    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3be64348-c49c-44ca-ba2e-7def9d974834" path="/var/lib/kubelet/pods/3be64348-c49c-44ca-ba2e-7def9d974834/volumes"
Jul 21 00:43:02.087342 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:02.087310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:43:02.186581 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:02.186549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:43:02.368117 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:02.368026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:43:09.897873 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:09.897837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:43:46.993618 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:46.993587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:43:47.195157 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:47.195124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:43:55.850486 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:55.850397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:43:55.900302 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:43:55.900252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:02.182599 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:02.182558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:02.237923 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:02.237887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:14.195930 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:14.195892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:14.250244 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:14.250210    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:15.372671 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:15.372633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:15.425621 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:15.425588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:15.479065 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:15.479030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:24.904212 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:24.904176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:25.007837 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:25.007807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:29.972724 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:29.972687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:40.635353 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:40.635317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:40.736137 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:40.736107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:50.105884 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:50.105850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:44:50.152895 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:44:50.152858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:45:27.569993 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:45:27.569919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:45:27.669658 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:45:27.669628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:45:54.171024 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:45:54.170984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:45:54.941553 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:45:54.941515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:45:56.715158 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:45:56.715129    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 00:45:57.569111 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:45:57.569076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:45:57.664867 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:45:57.664830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:00.913940 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:00.913896    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:01.004139 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:01.004104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:01.134472 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:01.134440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:01.310505 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:01.310393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:01.568429 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:01.568397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:01.666567 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:01.666531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:02.955105 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:02.955057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:03.388885 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:03.388849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:03.490187 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:03.490147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:10.277326 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:10.277289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:10.330003 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:10.329972    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:11.816574 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:11.816532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:13.230356 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:13.230327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:13.329130 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:13.329100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:30.616911 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:30.616862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:30.716505 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:30.716468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:32.707031 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:32.706953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:45.997731 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:45.997696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:46.120278 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:46.120236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:46.803684 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:46.803617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:47.012838 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.012796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:47.106999 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.106964    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"]
Jul 21 00:46:47.107219 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.107199    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be64348-c49c-44ca-ba2e-7def9d974834" containerName="registry"
Jul 21 00:46:47.107264 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.107220    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be64348-c49c-44ca-ba2e-7def9d974834" containerName="registry"
Jul 21 00:46:47.107298 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.107281    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3be64348-c49c-44ca-ba2e-7def9d974834" containerName="registry"
Jul 21 00:46:47.109104 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.109088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.111248 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.111222    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 00:46:47.112043 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.112026    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 00:46:47.112129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.112049    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 00:46:47.112129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.112081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 00:46:47.112129 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.112029    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:46:47.112267 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.112190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dntcs\""
Jul 21 00:46:47.113900 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.113876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:47.122236 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.122207    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"]
Jul 21 00:46:47.250234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.250201    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"]
Jul 21 00:46:47.252277 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.252261    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.256894 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.256873    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 00:46:47.257057 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.257039    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j5g8w\""
Jul 21 00:46:47.257206 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.257192    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 00:46:47.257669 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.257636    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 00:46:47.258430 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.258415    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 00:46:47.266022 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.265998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj742\" (UniqueName: \"kubernetes.io/projected/03ebde3d-1b9e-42b1-9912-03f1a734889d-kube-api-access-xj742\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.266135 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.266038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/03ebde3d-1b9e-42b1-9912-03f1a734889d-metrics-cert\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.266135 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.266097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/03ebde3d-1b9e-42b1-9912-03f1a734889d-manager-config\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.266135 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.266127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ebde3d-1b9e-42b1-9912-03f1a734889d-cert\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.292298 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.292264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"]
Jul 21 00:46:47.366725 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-manifests\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.366725 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj742\" (UniqueName: \"kubernetes.io/projected/03ebde3d-1b9e-42b1-9912-03f1a734889d-kube-api-access-xj742\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.366725 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrp9\" (UniqueName: \"kubernetes.io/projected/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-kube-api-access-qsrp9\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.367004 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/03ebde3d-1b9e-42b1-9912-03f1a734889d-metrics-cert\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.367004 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.367004 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.367004 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/03ebde3d-1b9e-42b1-9912-03f1a734889d-manager-config\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.367004 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-tmp\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.367004 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.366920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ebde3d-1b9e-42b1-9912-03f1a734889d-cert\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.369740 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.367989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/03ebde3d-1b9e-42b1-9912-03f1a734889d-manager-config\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.373022 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.372989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03ebde3d-1b9e-42b1-9912-03f1a734889d-cert\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.373653 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.373629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/03ebde3d-1b9e-42b1-9912-03f1a734889d-metrics-cert\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.376132 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.376108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj742\" (UniqueName: \"kubernetes.io/projected/03ebde3d-1b9e-42b1-9912-03f1a734889d-kube-api-access-xj742\") pod \"lws-controller-manager-656b686d8c-4msfl\" (UID: \"03ebde3d-1b9e-42b1-9912-03f1a734889d\") " pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.418539 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.418499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:47.468044 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.468014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-tmp\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.468183 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.468080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-manifests\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.468183 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.468111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrp9\" (UniqueName: \"kubernetes.io/projected/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-kube-api-access-qsrp9\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.468183 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.468156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.468183 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.468179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.469040 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.469016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-manifests\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.471582 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.471528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-tmp\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.471695 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.471606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.472207 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.472183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.482835 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.482751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrp9\" (UniqueName: \"kubernetes.io/projected/62f58f04-760b-4b22-8b1d-a3e3cc55d7af-kube-api-access-qsrp9\") pod \"opendatahub-operator-controller-manager-5f889c5d8-vnc59\" (UID: \"62f58f04-760b-4b22-8b1d-a3e3cc55d7af\") " pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.502698 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.502663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:47.556370 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.556258    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"]
Jul 21 00:46:47.560838 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:46:47.560805    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ebde3d_1b9e_42b1_9912_03f1a734889d.slice/crio-60d5b5ce63d6ee3483493dd9eaeb950056aab9f0877fcdc22916d87f4fd7d1d8 WatchSource:0}: Error finding container 60d5b5ce63d6ee3483493dd9eaeb950056aab9f0877fcdc22916d87f4fd7d1d8: Status 404 returned error can't find the container with id 60d5b5ce63d6ee3483493dd9eaeb950056aab9f0877fcdc22916d87f4fd7d1d8
Jul 21 00:46:47.562069 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.562050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:47.562765 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.562746    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:46:47.603330 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.603287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:47.694198 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.694165    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"]
Jul 21 00:46:47.696870 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.696843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:47.697874 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:46:47.697851    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f58f04_760b_4b22_8b1d_a3e3cc55d7af.slice/crio-29846a29f05b2b96c420a697419abb9a9eccd4043118f25dd27b2cd572c9faf3 WatchSource:0}: Error finding container 29846a29f05b2b96c420a697419abb9a9eccd4043118f25dd27b2cd572c9faf3: Status 404 returned error can't find the container with id 29846a29f05b2b96c420a697419abb9a9eccd4043118f25dd27b2cd572c9faf3
Jul 21 00:46:47.780226 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.780191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:47.894098 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:47.894009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:48.052264 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:48.052223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59" event={"ID":"62f58f04-760b-4b22-8b1d-a3e3cc55d7af","Type":"ContainerStarted","Data":"29846a29f05b2b96c420a697419abb9a9eccd4043118f25dd27b2cd572c9faf3"}
Jul 21 00:46:48.053331 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:48.053309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl" event={"ID":"03ebde3d-1b9e-42b1-9912-03f1a734889d","Type":"ContainerStarted","Data":"60d5b5ce63d6ee3483493dd9eaeb950056aab9f0877fcdc22916d87f4fd7d1d8"}
Jul 21 00:46:52.070437 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:52.070393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl" event={"ID":"03ebde3d-1b9e-42b1-9912-03f1a734889d","Type":"ContainerStarted","Data":"ad2d77c447ca029099ff3b92a2698cb2e37fc4bdcfbb32ae82dca72d23d20110"}
Jul 21 00:46:52.070927 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:52.070497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:46:52.072033 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:52.071999    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59" event={"ID":"62f58f04-760b-4b22-8b1d-a3e3cc55d7af","Type":"ContainerStarted","Data":"88e59db73781bac4ca811cf467ba856bd2492d09797489c390303688ef86cd2a"}
Jul 21 00:46:52.087112 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:52.087061    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl" podStartSLOduration=0.78743727 podStartE2EDuration="5.087043779s" totalImagesPullingTime="4.299606509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:52.086392497 +0000 UTC m=+355.758782866" watchObservedRunningTime="2026-07-21 00:46:52.087043779 +0000 UTC m=+355.759434144"
Jul 21 00:46:53.077271 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:53.077225    2560 generic.go:356] "Generic (PLEG): container finished" podID="62f58f04-760b-4b22-8b1d-a3e3cc55d7af" containerID="88e59db73781bac4ca811cf467ba856bd2492d09797489c390303688ef86cd2a" exitCode=0
Jul 21 00:46:53.077657 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:53.077310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59" event={"ID":"62f58f04-760b-4b22-8b1d-a3e3cc55d7af","Type":"ContainerDied","Data":"88e59db73781bac4ca811cf467ba856bd2492d09797489c390303688ef86cd2a"}
Jul 21 00:46:54.082947 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:54.082907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59" event={"ID":"62f58f04-760b-4b22-8b1d-a3e3cc55d7af","Type":"ContainerStarted","Data":"316f8cb79305f1b9ce5377f946f165f34c3a30c440ce56e052b8bb7401a05a42"}
Jul 21 00:46:54.083346 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:54.083057    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:46:54.100430 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:54.100378    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59" podStartSLOduration=1.509348212 podStartE2EDuration="7.100361888s" totalImagesPullingTime="4.520347501s" totalInitContainerRuntime="1.070666175s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:46:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:46:54.098821306 +0000 UTC m=+357.771211671" watchObservedRunningTime="2026-07-21 00:46:54.100361888 +0000 UTC m=+357.772752254"
Jul 21 00:46:59.210335 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:59.210278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:59.309635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:59.309595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:46:59.633932 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:46:59.633898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:03.080110 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:03.080080    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-656b686d8c-4msfl"
Jul 21 00:47:05.088462 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:05.088429    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f889c5d8-vnc59"
Jul 21 00:47:06.541653 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:06.541615    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:06.655947 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:06.655905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:06.931001 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:06.930965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:07.132210 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:07.132177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:07.454059 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:07.454020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:07.555990 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:07.555954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:07.655794 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:07.655744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:07.906503 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:07.906463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:08.362839 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:08.362808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:08.794277 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:08.794199    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:08.893141 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:08.893078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:09.778047 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:09.778009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:14.865465 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:14.865434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:14.965872 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:14.965843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:15.601971 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.601936    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"]
Jul 21 00:47:15.615677 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.615647    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.618066 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.618041    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 00:47:15.618221 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.618075    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 00:47:15.618508 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.618492    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 00:47:15.620627 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.620605    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vw86v\""
Jul 21 00:47:15.622903 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.622881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"]
Jul 21 00:47:15.647991 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.647959    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:15.682352 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682352 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682566 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbpx8\" (UniqueName: \"kubernetes.io/projected/4c432abd-cedb-48cf-861a-12c1c6538dfa-kube-api-access-pbpx8\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682566 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682566 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682566 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682566 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682737 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c432abd-cedb-48cf-861a-12c1c6538dfa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.682737 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.682606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.757644 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.757608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:15.783889 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.783848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.783901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.783921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.783953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.783978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c432abd-cedb-48cf-861a-12c1c6538dfa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.783996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784076 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784380 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784380 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbpx8\" (UniqueName: \"kubernetes.io/projected/4c432abd-cedb-48cf-861a-12c1c6538dfa-kube-api-access-pbpx8\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784380 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784524 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784524 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784633 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784570    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.784769 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.784746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c432abd-cedb-48cf-861a-12c1c6538dfa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.786274 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.786246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.786823 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.786800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.794203 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.794176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c432abd-cedb-48cf-861a-12c1c6538dfa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.794316 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.794297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbpx8\" (UniqueName: \"kubernetes.io/projected/4c432abd-cedb-48cf-861a-12c1c6538dfa-kube-api-access-pbpx8\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6786c7n9\" (UID: \"4c432abd-cedb-48cf-861a-12c1c6538dfa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.800688 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.800663    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"]
Jul 21 00:47:15.803509 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.803490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.807751 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.807727    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 00:47:15.807955 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.807932    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 00:47:15.807955 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.807950    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9r62s\""
Jul 21 00:47:15.808572 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.808554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 00:47:15.840161 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.840128    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"]
Jul 21 00:47:15.885574 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.885469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g872l\" (UniqueName: \"kubernetes.io/projected/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-kube-api-access-g872l\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.885574 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.885513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.886079 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.885580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.886079 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.885622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.886079 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.885652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.886079 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.885679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.886079 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.885731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.928187 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.928157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:15.928532 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.928509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:15.986796 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.986735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.986961 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.986830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.986961 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.986882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.986961 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.986942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g872l\" (UniqueName: \"kubernetes.io/projected/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-kube-api-access-g872l\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.987136 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.986967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.987136 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.986996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.987136 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.987016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.988415 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.988363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.990798 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.990169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.990798 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.990511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.991976 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.991930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.993067 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.993043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.998138 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.998092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:15.998336 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:15.998317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g872l\" (UniqueName: \"kubernetes.io/projected/e8c5a9b9-4ae0-4d2b-a962-f48d20e03581-kube-api-access-g872l\") pod \"istiod-openshift-gateway-94bb8fbfd-jls8d\" (UID: \"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:16.060196 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:16.060161    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"]
Jul 21 00:47:16.063704 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:47:16.063674    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c432abd_cedb_48cf_861a_12c1c6538dfa.slice/crio-50a6968251b30e0b0cfbc9f0a2fb62ba4e0af2f8f729f8c72a798a5f77d1196f WatchSource:0}: Error finding container 50a6968251b30e0b0cfbc9f0a2fb62ba4e0af2f8f729f8c72a798a5f77d1196f: Status 404 returned error can't find the container with id 50a6968251b30e0b0cfbc9f0a2fb62ba4e0af2f8f729f8c72a798a5f77d1196f
Jul 21 00:47:16.112601 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:16.112549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:16.159541 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:16.159324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9" event={"ID":"4c432abd-cedb-48cf-861a-12c1c6538dfa","Type":"ContainerStarted","Data":"50a6968251b30e0b0cfbc9f0a2fb62ba4e0af2f8f729f8c72a798a5f77d1196f"}
Jul 21 00:47:16.253575 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:16.251820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"]
Jul 21 00:47:17.164831 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:17.164764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d" event={"ID":"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581","Type":"ContainerStarted","Data":"2c36356687d120407500c2f60e747f173c4fb6d4e990339685e21bc5f1441c93"}
Jul 21 00:47:18.308310 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:18.308253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:18.406255 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:18.406217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:18.537307 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:18.537257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:18.653956 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:18.653923    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:18.760567 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:18.760531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:18.835295 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:18.835261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:47:19.570191 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:19.570152    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:47:19.570541 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:19.570254    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:47:19.570541 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:19.570320    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:47:19.571751 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:19.571723    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:47:19.571850 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:19.571797    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:47:20.178675 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.178643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d" event={"ID":"e8c5a9b9-4ae0-4d2b-a962-f48d20e03581","Type":"ContainerStarted","Data":"8ebe77e3056c5ccd2832ca560ffe5280e868da6ddf82b7c5c8ce9cf255588aab"}
Jul 21 00:47:20.178920 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.178816    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:20.180217 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.180191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9" event={"ID":"4c432abd-cedb-48cf-861a-12c1c6538dfa","Type":"ContainerStarted","Data":"d47998e019aeed90dd879a4edce8098df856aefbd0aa889a785424d8372d1c66"}
Jul 21 00:47:20.180387 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.180368    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-jls8d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 00:47:20.180431 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.180416    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d" podUID="e8c5a9b9-4ae0-4d2b-a962-f48d20e03581" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 00:47:20.230594 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.230541    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d" podStartSLOduration=1.914943579 podStartE2EDuration="5.230525791s" totalImagesPullingTime="3.315582212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:47:20.204931892 +0000 UTC m=+383.877322257" watchObservedRunningTime="2026-07-21 00:47:20.230525791 +0000 UTC m=+383.902916157"
Jul 21 00:47:20.230924 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.230900    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9" podStartSLOduration=1.7266240480000001 podStartE2EDuration="5.230893133s" totalImagesPullingTime="3.504269085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:47:20.229124437 +0000 UTC m=+383.901514802" watchObservedRunningTime="2026-07-21 00:47:20.230893133 +0000 UTC m=+383.903283498"
Jul 21 00:47:20.928635 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.928594    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:20.933073 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:20.933044    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:21.184195 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:21.184113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:47:21.184693 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:21.184669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jls8d"
Jul 21 00:47:21.185115 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:47:21.185100    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6786c7n9"
Jul 21 00:48:03.444784 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:03.444750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:03.503963 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:03.503930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:05.387291 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:05.387255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:05.442081 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:05.442049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:08.117301 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:08.117260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:08.216706 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:08.216672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:08.294434 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:08.294402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:09.048652 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:09.048617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:09.262035 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:09.262002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:31.370433 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:31.370353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:31.470905 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:31.470874    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:38.265825 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:38.265786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:41.822335 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:41.822280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:41.936628 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:41.936147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:46.230966 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:46.230938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:46.453547 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:46.453510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:48.619923 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:48.619887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:48.863032 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:48.862997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:49.080827 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:49.080798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:51.251106 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:51.251073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:51.351520 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:51.351485    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:53.231185 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:53.231154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:53.332500 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:53.332463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:56.659758 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:56.659697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:56.715536 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:56.715489    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:58.372416 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:58.372379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:58.493164 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:58.493126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:59.013515 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:59.013473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:48:59.067633 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:48:59.067608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:02.716527 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:02.716492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:02.814391 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:02.814356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:09.246967 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:09.246933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:09.327397 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:09.327349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:09.929134 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:09.929098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:10.027145 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:10.027113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:10.129367 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:10.129339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:11.848909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:11.848879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:11.948847 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:11.948813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:15.647628 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:15.647590    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:15.747695 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:15.747661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:25.051591 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:25.051553    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:25.152448 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:25.152413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:31.042568 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:31.042536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:31.092429 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:31.092398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:31.655581 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:31.655546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:31.758643 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:31.758601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:37.581323 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.581285    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"]
Jul 21 00:49:37.584802 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.584768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.586670 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.586652    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hqlqs\""
Jul 21 00:49:37.598615 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.598591    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"]
Jul 21 00:49:37.611435 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.611401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:37.679909 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.679872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.679963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.680016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.680059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.680088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680306 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.680116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680306 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.680172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680306 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.680226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.680306 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.680268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4l2\" (UniqueName: \"kubernetes.io/projected/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-kube-api-access-wm4l2\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.780917 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.780876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.780926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.780943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.780970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781095 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781299 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4l2\" (UniqueName: \"kubernetes.io/projected/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-kube-api-access-wm4l2\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781299 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781299 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781430 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781823 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.781823 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.782013 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.782013 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.781895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.783340 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.783316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.783547 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.783529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.788418 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.788398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4l2\" (UniqueName: \"kubernetes.io/projected/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-kube-api-access-wm4l2\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.788509 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.788493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9d9b46-f690-4dc2-afd0-4b0917fa1ec2-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hq6cg\" (UID: \"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:37.812538 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.812504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:37.895528 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:37.895444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:38.022324 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.022300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"]
Jul 21 00:49:38.024985 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:49:38.024947    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9d9b46_f690_4dc2_afd0_4b0917fa1ec2.slice/crio-6f91978d04655972451d06ac8386ce53e06f0d56aeed70e52a7f45a986ebd715 WatchSource:0}: Error finding container 6f91978d04655972451d06ac8386ce53e06f0d56aeed70e52a7f45a986ebd715: Status 404 returned error can't find the container with id 6f91978d04655972451d06ac8386ce53e06f0d56aeed70e52a7f45a986ebd715
Jul 21 00:49:38.027166 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.027130    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:49:38.027251 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.027210    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:49:38.027292 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.027254    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:49:38.671353 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.671316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" event={"ID":"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2","Type":"ContainerStarted","Data":"2cd2a681fa914ce2b5188c5b42d462decb1c50c74d9701edd4148a661c9f9a4e"}
Jul 21 00:49:38.671743 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.671379    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" event={"ID":"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2","Type":"ContainerStarted","Data":"6f91978d04655972451d06ac8386ce53e06f0d56aeed70e52a7f45a986ebd715"}
Jul 21 00:49:38.690160 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.690111    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" podStartSLOduration=1.690095805 podStartE2EDuration="1.690095805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:49:38.68871919 +0000 UTC m=+522.361109554" watchObservedRunningTime="2026-07-21 00:49:38.690095805 +0000 UTC m=+522.362486170"
Jul 21 00:49:38.896542 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:38.896507    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:39.901390 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:39.901360    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:40.679135 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:40.679107    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:40.679997 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:40.679976    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:49:41.513755 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:41.513719    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:52.101381 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:52.101294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:52.197093 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:52.197040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:52.298192 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:52.298157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:52.900839 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:52.900803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:49:52.967573 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:49:52.967533    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:11.210185 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:11.210150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:11.310593 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:11.310558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:11.700487 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:11.700449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:14.667650 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:14.667620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:14.715112 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:14.715082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:25.888943 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:25.888902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:25.988687 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:25.988655    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:30.948224 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:30.948194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:32.341108 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:32.341069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:32.432902 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:32.432867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:32.514331 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:32.514294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:32.634463 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:32.634387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:35.651898 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:35.651867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:35.785932 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:35.785895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:41.143998 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:41.143963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:50:52.796791 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:50:52.796739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:51:08.171940 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:08.171901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:51:09.428768 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.428736    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-jk945"]
Jul 21 00:51:09.431729 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.431713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.433719 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.433695    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 00:51:09.433847 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.433696    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rlmt5\""
Jul 21 00:51:09.439646 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.439624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-jk945"]
Jul 21 00:51:09.457894 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.457859    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:51:09.534713 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.534673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f629x\" (UniqueName: \"kubernetes.io/projected/4f2f808e-e307-42c0-8ccc-ea0a5b2bc855-kube-api-access-f629x\") pod \"payload-processing-5bf47cd988-jk945\" (UID: \"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855\") " pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.534917 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.534794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2f808e-e307-42c0-8ccc-ea0a5b2bc855-plugins-config-volume\") pod \"payload-processing-5bf47cd988-jk945\" (UID: \"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855\") " pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.635867 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.635822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f629x\" (UniqueName: \"kubernetes.io/projected/4f2f808e-e307-42c0-8ccc-ea0a5b2bc855-kube-api-access-f629x\") pod \"payload-processing-5bf47cd988-jk945\" (UID: \"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855\") " pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.636046 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.635913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2f808e-e307-42c0-8ccc-ea0a5b2bc855-plugins-config-volume\") pod \"payload-processing-5bf47cd988-jk945\" (UID: \"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855\") " pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.636588 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.636565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2f808e-e307-42c0-8ccc-ea0a5b2bc855-plugins-config-volume\") pod \"payload-processing-5bf47cd988-jk945\" (UID: \"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855\") " pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.643234 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.643210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f629x\" (UniqueName: \"kubernetes.io/projected/4f2f808e-e307-42c0-8ccc-ea0a5b2bc855-kube-api-access-f629x\") pod \"payload-processing-5bf47cd988-jk945\" (UID: \"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855\") " pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.742276 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.742188    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:09.867766 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:09.867734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-jk945"]
Jul 21 00:51:09.870696 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:51:09.870670    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2f808e_e307_42c0_8ccc_ea0a5b2bc855.slice/crio-5032e63193bb0e16968807c54570d8a00b0482fe172008bfe111f6d7ac26f4ee WatchSource:0}: Error finding container 5032e63193bb0e16968807c54570d8a00b0482fe172008bfe111f6d7ac26f4ee: Status 404 returned error can't find the container with id 5032e63193bb0e16968807c54570d8a00b0482fe172008bfe111f6d7ac26f4ee
Jul 21 00:51:10.018057 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:10.017969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-jk945" event={"ID":"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855","Type":"ContainerStarted","Data":"5032e63193bb0e16968807c54570d8a00b0482fe172008bfe111f6d7ac26f4ee"}
Jul 21 00:51:13.056665 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:13.056573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-jk945" event={"ID":"4f2f808e-e307-42c0-8ccc-ea0a5b2bc855","Type":"ContainerStarted","Data":"af779211c92381e0454b214fd1603c68ad6901de587c27f9b5459d8e50f0085c"}
Jul 21 00:51:13.057089 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:13.056688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:13.072974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:13.072925    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-jk945" podStartSLOduration=1.1853063289999999 podStartE2EDuration="4.072909023s" totalImagesPullingTime="2.887602694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:51:13.070897327 +0000 UTC m=+616.743287704" watchObservedRunningTime="2026-07-21 00:51:13.072909023 +0000 UTC m=+616.745299388"
Jul 21 00:51:17.073836 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:17.073794    2560 generic.go:356] "Generic (PLEG): container finished" podID="af9d9b46-f690-4dc2-afd0-4b0917fa1ec2" containerID="2cd2a681fa914ce2b5188c5b42d462decb1c50c74d9701edd4148a661c9f9a4e" exitCode=0
Jul 21 00:51:17.074356 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:17.073851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" event={"ID":"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2","Type":"ContainerDied","Data":"2cd2a681fa914ce2b5188c5b42d462decb1c50c74d9701edd4148a661c9f9a4e"}
Jul 21 00:51:17.074356 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:17.074331    2560 scope.go:117] "RemoveContainer" containerID="2cd2a681fa914ce2b5188c5b42d462decb1c50c74d9701edd4148a661c9f9a4e"
Jul 21 00:51:17.075321 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:17.075293    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:51:17.075380 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:17.075360    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:51:17.075431 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:17.075415    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 00:51:18.079218 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:18.079182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" event={"ID":"af9d9b46-f690-4dc2-afd0-4b0917fa1ec2","Type":"ContainerStarted","Data":"58ed444d828c1c0f42cef08261351ba92bd571f835b2ba3a0e06f1cc2f038a6f"}
Jul 21 00:51:18.896237 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:18.896195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:51:18.896504 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:18.896481    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hq6cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 21 00:51:18.896561 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:18.896530    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" podUID="af9d9b46-f690-4dc2-afd0-4b0917fa1ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 21 00:51:19.847422 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:19.847379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:51:19.896271 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:19.896238    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hq6cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 21 00:51:19.896435 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:19.896292    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" podUID="af9d9b46-f690-4dc2-afd0-4b0917fa1ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 21 00:51:19.948167 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:19.948095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:51:20.896671 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:20.896630    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hq6cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 21 00:51:20.897096 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:20.896692    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" podUID="af9d9b46-f690-4dc2-afd0-4b0917fa1ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 21 00:51:21.895858 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:21.895820    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hq6cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 21 00:51:21.896041 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:21.895877    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg" podUID="af9d9b46-f690-4dc2-afd0-4b0917fa1ec2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 21 00:51:22.899814 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:22.899770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:51:22.904583 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:22.901444    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:51:22.905359 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:22.905339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hq6cg"
Jul 21 00:51:24.062327 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:24.062295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-jk945"
Jul 21 00:51:30.044703 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:30.044667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:51:35.381969 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:35.381929    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:51:35.432659 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:51:35.432630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:52:14.405323 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:14.405290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:52:17.302933 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.302896    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"]
Jul 21 00:52:17.306173 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.306153    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.308288 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.308258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 00:52:17.309046 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.309019    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 00:52:17.309046 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.309036    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xtkz5\""
Jul 21 00:52:17.309209 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.309092    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 00:52:17.315509 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.315483    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"]
Jul 21 00:52:17.333657 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.333616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:52:17.397891 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.397854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f4ad6ce-a023-432c-82a9-c2541136d45d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.397891 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.397892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.398143 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.397972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfcq\" (UniqueName: \"kubernetes.io/projected/3f4ad6ce-a023-432c-82a9-c2541136d45d-kube-api-access-5tfcq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.398143 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.398013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.398143 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.398090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.398143 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.398135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499407 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499606 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499606 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f4ad6ce-a023-432c-82a9-c2541136d45d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499606 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499606 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfcq\" (UniqueName: \"kubernetes.io/projected/3f4ad6ce-a023-432c-82a9-c2541136d45d-kube-api-access-5tfcq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499606 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499907 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499965 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.499965 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.499935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.501762 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.501736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f4ad6ce-a023-432c-82a9-c2541136d45d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.502038 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.502022    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f4ad6ce-a023-432c-82a9-c2541136d45d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.506767 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.506745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfcq\" (UniqueName: \"kubernetes.io/projected/3f4ad6ce-a023-432c-82a9-c2541136d45d-kube-api-access-5tfcq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gmd66\" (UID: \"3f4ad6ce-a023-432c-82a9-c2541136d45d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.617524 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.617475    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:17.750378 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.750348    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"]
Jul 21 00:52:17.753354 ip-10-0-138-241 kubenswrapper[2560]: W0721 00:52:17.753324    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4ad6ce_a023_432c_82a9_c2541136d45d.slice/crio-9de8eb7821baabbba5556d9e950c886d80873971c1994a1c7fccb8964a910bd2 WatchSource:0}: Error finding container 9de8eb7821baabbba5556d9e950c886d80873971c1994a1c7fccb8964a910bd2: Status 404 returned error can't find the container with id 9de8eb7821baabbba5556d9e950c886d80873971c1994a1c7fccb8964a910bd2
Jul 21 00:52:17.754953 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:17.754934    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:52:18.314150 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:18.314114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66" event={"ID":"3f4ad6ce-a023-432c-82a9-c2541136d45d","Type":"ContainerStarted","Data":"9de8eb7821baabbba5556d9e950c886d80873971c1994a1c7fccb8964a910bd2"}
Jul 21 00:52:19.319969 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:19.319933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66" event={"ID":"3f4ad6ce-a023-432c-82a9-c2541136d45d","Type":"ContainerStarted","Data":"ed04fbc6ccc6645bfabb526d270f5d7a6b7c0c40e7ba42c7b5683af07551194c"}
Jul 21 00:52:19.337096 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:19.337038    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66" podStartSLOduration=1.333581741 podStartE2EDuration="2.337020122s" totalImagesPullingTime="1.003438381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:52:19.336545288 +0000 UTC m=+683.008935654" watchObservedRunningTime="2026-07-21 00:52:19.337020122 +0000 UTC m=+683.009410487"
Jul 21 00:52:25.698143 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:25.698104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:52:27.618597 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:27.618559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:27.619053 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:27.618827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:27.631348 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:27.631319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:28.365101 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:28.365072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gmd66"
Jul 21 00:52:39.539376 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:39.539334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:52:45.827858 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:52:45.827817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:53:00.236932 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:53:00.236829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:54:53.239754 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:54:53.239721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:54:53.328195 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:54:53.328138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:54:54.344431 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:54:54.344399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:54:54.489593 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:54:54.489562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:56:33.807974 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:56:33.807943    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:56:59.027436 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:56:59.027399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:00.292451 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:00.292416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:21.909543 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:21.909463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:21.960188 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:21.960158    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:35.838490 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:35.838454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:35.938216 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:35.938177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:36.066141 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:36.066090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:41.659383 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:41.659347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:41.781199 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:41.781169    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:41.877554 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:41.877516    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:42.008092 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:42.008012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:47.776337 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:47.776303    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:47.832216 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:47.832182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:53.931395 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:53.931361    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:59.502946 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:59.502915    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:57:59.555048 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:57:59.555021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:58:20.107679 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:58:20.107646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 00:58:20.163501 ip-10-0-138-241 kubenswrapper[2560]: I0721 00:58:20.163465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:00:00.143830 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:00.143794    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w"]
Jul 21 01:00:00.146925 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:00.146905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w"
Jul 21 01:00:00.148999 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:00.148981    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:00:00.155672 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:00.155654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w"
Jul 21 01:00:00.161702 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:00.161683    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w"]
Jul 21 01:00:00.286253 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:00.286217    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w"]
Jul 21 01:00:00.289274 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:00:00.289248    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b18697_88e7_411b_ad96_feed8ea01d3f.slice/crio-2c493a9021c20cebab9ca4b9dc9c3cad6fb370f50a2cac06cbf8264f001b4854 WatchSource:0}: Error finding container 2c493a9021c20cebab9ca4b9dc9c3cad6fb370f50a2cac06cbf8264f001b4854: Status 404 returned error can't find the container with id 2c493a9021c20cebab9ca4b9dc9c3cad6fb370f50a2cac06cbf8264f001b4854
Jul 21 01:00:00.291158 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:00.291142    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:00:01.150759 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:01.150722    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w" event={"ID":"f9b18697-88e7-411b-ad96-feed8ea01d3f","Type":"ContainerStarted","Data":"2c493a9021c20cebab9ca4b9dc9c3cad6fb370f50a2cac06cbf8264f001b4854"}
Jul 21 01:00:06.173150 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:06.173068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w" event={"ID":"f9b18697-88e7-411b-ad96-feed8ea01d3f","Type":"ContainerStarted","Data":"f3fc418d5bb391f7d988c2399bb324db559586e2a20e5751074225b29156b389"}
Jul 21 01:00:06.187274 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:06.187226    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w" podStartSLOduration=0.93882791 podStartE2EDuration="6.187211123s" totalImagesPullingTime="5.248383213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:00:06.186353125 +0000 UTC m=+1149.858743489" watchObservedRunningTime="2026-07-21 01:00:06.187211123 +0000 UTC m=+1149.859601488"
Jul 21 01:00:07.183228 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:07.183190    2560 generic.go:356] "Generic (PLEG): container finished" podID="f9b18697-88e7-411b-ad96-feed8ea01d3f" containerID="f3fc418d5bb391f7d988c2399bb324db559586e2a20e5751074225b29156b389" exitCode=0
Jul 21 01:00:07.183684 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:07.183244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w" event={"ID":"f9b18697-88e7-411b-ad96-feed8ea01d3f","Type":"ContainerDied","Data":"f3fc418d5bb391f7d988c2399bb324db559586e2a20e5751074225b29156b389"}
Jul 21 01:00:08.308794 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:08.308754    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w"
Jul 21 01:00:09.193206 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:09.193129    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w"
Jul 21 01:00:09.193206 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:09.193140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-w246w" event={"ID":"f9b18697-88e7-411b-ad96-feed8ea01d3f","Type":"ContainerDied","Data":"2c493a9021c20cebab9ca4b9dc9c3cad6fb370f50a2cac06cbf8264f001b4854"}
Jul 21 01:00:09.193206 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:00:09.193186    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c493a9021c20cebab9ca4b9dc9c3cad6fb370f50a2cac06cbf8264f001b4854"
Jul 21 01:03:31.473823 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:03:31.473704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:04:22.355505 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:04:22.355457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:05:29.958815 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:05:29.958769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:05:33.450231 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:05:33.450181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:06:06.536146 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:06:06.536104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:06:07.841271 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:06:07.841233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:06:11.881129 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:06:11.881093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:06:39.422100 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:06:39.422039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:15.751322 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:15.751285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:23.178019 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:23.177939    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:31.444877 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:31.444841    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:36.701674 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:36.701628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:39.759900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:39.759867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:39.859270 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:39.859203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:40.229370 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:40.229331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:45.857741 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:45.857695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:45.922436 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:45.922401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:46.109514 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.109400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:46.439328 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.439247    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"]
Jul 21 01:09:46.439643 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.439624    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b18697-88e7-411b-ad96-feed8ea01d3f" containerName="cleanup"
Jul 21 01:09:46.439723 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.439645    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b18697-88e7-411b-ad96-feed8ea01d3f" containerName="cleanup"
Jul 21 01:09:46.439887 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.439739    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b18697-88e7-411b-ad96-feed8ea01d3f" containerName="cleanup"
Jul 21 01:09:46.442664 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.442642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.444743 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.444724    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fb3c8577-openshift-default-dockercfg-nnvjm\""
Jul 21 01:09:46.463087 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.463063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"]
Jul 21 01:09:46.469669 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.469623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:46.535767 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.535722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-socket\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.535955 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.535822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-podinfo\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.535955 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.535850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-certs\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.535955 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.535883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-token\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.535955 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.535934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb95h\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-kube-api-access-zb95h\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.536149 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.535980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-data\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.536149 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.536020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-envoy\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.536149 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.536047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b434aa-a9d6-4d4d-b38e-539519595c7b-istiod-ca-cert\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.536268 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.536146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-credential-socket\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637382 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-socket\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637382 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-podinfo\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-certs\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-token\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb95h\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-kube-api-access-zb95h\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-data\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-envoy\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b434aa-a9d6-4d4d-b38e-539519595c7b-istiod-ca-cert\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.637631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-credential-socket\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.638016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-socket\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.638016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.637926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-data\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.638121 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.638097    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-credential-socket\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.638175 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.638152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-certs\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.638482 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.638457    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b434aa-a9d6-4d4d-b38e-539519595c7b-istiod-ca-cert\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.639923 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.639899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-envoy\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.640343 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.640323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-podinfo\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.644939 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.644917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-token\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.645475 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.645454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb95h\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-kube-api-access-zb95h\") pod \"e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") " pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.752891 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.752769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:46.754542 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.754513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:46.910194 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.910168    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"]
Jul 21 01:09:46.912702 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:09:46.912672    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b434aa_a9d6_4d4d_b38e_539519595c7b.slice/crio-b55c8fd29d560b8f76a3295dca92c3ae41e8c720ba0c6ad756025aabc924273f WatchSource:0}: Error finding container b55c8fd29d560b8f76a3295dca92c3ae41e8c720ba0c6ad756025aabc924273f: Status 404 returned error can't find the container with id b55c8fd29d560b8f76a3295dca92c3ae41e8c720ba0c6ad756025aabc924273f
Jul 21 01:09:46.914671 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.914640    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:09:46.914763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.914701    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:09:46.914763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:46.914733    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:09:47.458786 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:47.458746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" event={"ID":"61b434aa-a9d6-4d4d-b38e-539519595c7b","Type":"ContainerStarted","Data":"88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31"}
Jul 21 01:09:47.458977 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:47.458828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" event={"ID":"61b434aa-a9d6-4d4d-b38e-539519595c7b","Type":"ContainerStarted","Data":"b55c8fd29d560b8f76a3295dca92c3ae41e8c720ba0c6ad756025aabc924273f"}
Jul 21 01:09:47.478626 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:47.478571    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podStartSLOduration=1.478554535 podStartE2EDuration="1.478554535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:09:47.477368368 +0000 UTC m=+1731.149758735" watchObservedRunningTime="2026-07-21 01:09:47.478554535 +0000 UTC m=+1731.150944900"
Jul 21 01:09:47.753615 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:47.753525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:47.754929 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:47.754904    2560 patch_prober.go:28] interesting pod/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 21 01:09:47.755042 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:47.754963    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 21 01:09:48.757574 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:48.757542    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:48.810961 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:48.810924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:48.897123 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:48.897091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:48.964138 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:48.964105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:49.351326 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:49.351292    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:49.451151 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:49.451112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:09:49.466810 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:49.466767    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:49.473318 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:49.473289    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:09:49.569817 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:09:49.569788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:04.530806 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:04.530738    2560 patch_prober.go:28] interesting pod/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": read tcp 10.133.0.2:41852->10.133.0.23:15021: read: connection reset by peer" start-of-body=
Jul 21 01:10:04.531182 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:04.530838    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": read tcp 10.133.0.2:41852->10.133.0.23:15021: read: connection reset by peer"
Jul 21 01:10:05.534450 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:05.534414    2560 generic.go:356] "Generic (PLEG): container finished" podID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerID="88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31" exitCode=0
Jul 21 01:10:05.534877 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:05.534465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" event={"ID":"61b434aa-a9d6-4d4d-b38e-539519595c7b","Type":"ContainerDied","Data":"88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31"}
Jul 21 01:10:05.534925 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:05.534906    2560 scope.go:117] "RemoveContainer" containerID="88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31"
Jul 21 01:10:05.535895 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:05.535863    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:05.535996 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:05.535932    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:05.535996 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:05.535972    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:06.542687 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:06.542644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" event={"ID":"61b434aa-a9d6-4d4d-b38e-539519595c7b","Type":"ContainerStarted","Data":"0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3"}
Jul 21 01:10:06.754005 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:06.753962    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:10:06.754244 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:06.754214    2560 patch_prober.go:28] interesting pod/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 21 01:10:06.754295 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:06.754278    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 21 01:10:07.753669 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:07.753623    2560 patch_prober.go:28] interesting pod/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 21 01:10:07.754173 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:07.753691    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 21 01:10:08.753996 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:08.753951    2560 patch_prober.go:28] interesting pod/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 21 01:10:08.754469 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:08.754015    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 21 01:10:09.753636 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:09.753595    2560 patch_prober.go:28] interesting pod/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 21 01:10:09.753830 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:09.753663    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 21 01:10:10.756791 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:10.756748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:10:10.757255 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:10.757046    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:10:10.757844 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:10.757824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:10:14.459751 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.459714    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"]
Jul 21 01:10:14.462287 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.462268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"
Jul 21 01:10:14.464375 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.464353    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:10:14.464461 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.464358    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:10:14.475821 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.475795    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"]
Jul 21 01:10:14.581422 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.581376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9597aef4-ef6f-404a-a0de-93e82649bd2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp\" (UID: \"9597aef4-ef6f-404a-a0de-93e82649bd2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"
Jul 21 01:10:14.682127 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.682078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9597aef4-ef6f-404a-a0de-93e82649bd2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp\" (UID: \"9597aef4-ef6f-404a-a0de-93e82649bd2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"
Jul 21 01:10:14.682739 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.682719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9597aef4-ef6f-404a-a0de-93e82649bd2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp\" (UID: \"9597aef4-ef6f-404a-a0de-93e82649bd2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"
Jul 21 01:10:14.774409 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.774324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"
Jul 21 01:10:14.899102 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:14.899069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"]
Jul 21 01:10:14.901124 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:10:14.901095    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9597aef4_ef6f_404a_a0de_93e82649bd2d.slice/crio-597ce7af640f86bba9ce3db27131221fcefec696a6d00277c1dabdb2bee199f4 WatchSource:0}: Error finding container 597ce7af640f86bba9ce3db27131221fcefec696a6d00277c1dabdb2bee199f4: Status 404 returned error can't find the container with id 597ce7af640f86bba9ce3db27131221fcefec696a6d00277c1dabdb2bee199f4
Jul 21 01:10:15.581846 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:15.581808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp" event={"ID":"9597aef4-ef6f-404a-a0de-93e82649bd2d","Type":"ContainerStarted","Data":"8a9887f1f1ca2d6ec4a04b9e35cb0115fc192cefb1fe2be7c421660899bf44ea"}
Jul 21 01:10:15.582319 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:15.581872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp" event={"ID":"9597aef4-ef6f-404a-a0de-93e82649bd2d","Type":"ContainerStarted","Data":"597ce7af640f86bba9ce3db27131221fcefec696a6d00277c1dabdb2bee199f4"}
Jul 21 01:10:15.597239 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:15.597187    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp" podStartSLOduration=1.597173811 podStartE2EDuration="1.597173811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:10:15.595281937 +0000 UTC m=+1759.267672305" watchObservedRunningTime="2026-07-21 01:10:15.597173811 +0000 UTC m=+1759.269564177"
Jul 21 01:10:16.587126 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:16.587092    2560 generic.go:356] "Generic (PLEG): container finished" podID="9597aef4-ef6f-404a-a0de-93e82649bd2d" containerID="8a9887f1f1ca2d6ec4a04b9e35cb0115fc192cefb1fe2be7c421660899bf44ea" exitCode=0
Jul 21 01:10:16.587552 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:16.587155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp" event={"ID":"9597aef4-ef6f-404a-a0de-93e82649bd2d","Type":"ContainerDied","Data":"8a9887f1f1ca2d6ec4a04b9e35cb0115fc192cefb1fe2be7c421660899bf44ea"}
Jul 21 01:10:17.719431 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:17.719404    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"
Jul 21 01:10:17.810392 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:17.810356    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9597aef4-ef6f-404a-a0de-93e82649bd2d-maas-api-service-ca\") pod \"9597aef4-ef6f-404a-a0de-93e82649bd2d\" (UID: \"9597aef4-ef6f-404a-a0de-93e82649bd2d\") "
Jul 21 01:10:17.810704 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:17.810682    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9597aef4-ef6f-404a-a0de-93e82649bd2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9597aef4-ef6f-404a-a0de-93e82649bd2d" (UID: "9597aef4-ef6f-404a-a0de-93e82649bd2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:10:17.911203 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:17.911128    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9597aef4-ef6f-404a-a0de-93e82649bd2d-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:18.596441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:18.596400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp" event={"ID":"9597aef4-ef6f-404a-a0de-93e82649bd2d","Type":"ContainerDied","Data":"597ce7af640f86bba9ce3db27131221fcefec696a6d00277c1dabdb2bee199f4"}
Jul 21 01:10:18.596613 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:18.596456    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="597ce7af640f86bba9ce3db27131221fcefec696a6d00277c1dabdb2bee199f4"
Jul 21 01:10:18.596613 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:18.596419    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"
Jul 21 01:10:24.801212 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:24.801178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:29.521754 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:29.521713    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"]
Jul 21 01:10:29.524122 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:29.524095    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb3c8577-hkcbp"]
Jul 21 01:10:29.527128 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:29.527104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:29.663216 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:29.663183    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"]
Jul 21 01:10:29.663413 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:29.663388    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy" containerID="cri-o://0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3" gracePeriod=30
Jul 21 01:10:29.683414 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:29.683385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:29.927849 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:29.927803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:30.187830 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.187730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:30.284595 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.284559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:30.435746 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.435715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:30.738251 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.738214    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"]
Jul 21 01:10:30.738650 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.738635    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9597aef4-ef6f-404a-a0de-93e82649bd2d" containerName="revoke-keys"
Jul 21 01:10:30.738697 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.738653    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9597aef4-ef6f-404a-a0de-93e82649bd2d" containerName="revoke-keys"
Jul 21 01:10:30.738758 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.738747    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9597aef4-ef6f-404a-a0de-93e82649bd2d" containerName="revoke-keys"
Jul 21 01:10:30.741832 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.741810    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.744168 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.744147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b3d9b6c6-gw-openshift-default-dockercfg-nsfq4\""
Jul 21 01:10:30.752877 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.752857    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"]
Jul 21 01:10:30.771192 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.771163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:30.855594 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.855552    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9597aef4-ef6f-404a-a0de-93e82649bd2d" path="/var/lib/kubelet/pods/9597aef4-ef6f-404a-a0de-93e82649bd2d/volumes"
Jul 21 01:10:30.924400 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-credential-socket\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924582 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-certs\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924582 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af42970-02eb-4645-b6a5-d93053702e54-istiod-ca-cert\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924582 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snc2q\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-kube-api-access-snc2q\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924582 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-istio-token\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924726 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-data\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924726 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af42970-02eb-4645-b6a5-d93053702e54-istio-podinfo\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924726 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-socket\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:30.924843 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:30.924726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-envoy\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.012074 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.011994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:31.026138 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-certs\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026256 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af42970-02eb-4645-b6a5-d93053702e54-istiod-ca-cert\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026256 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snc2q\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-kube-api-access-snc2q\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026256 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-istio-token\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026417 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-data\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026466 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af42970-02eb-4645-b6a5-d93053702e54-istio-podinfo\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026522 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-socket\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026522 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-envoy\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026623 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-credential-socket\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026677 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-certs\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.026894 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-credential-socket\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.027045 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.026948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af42970-02eb-4645-b6a5-d93053702e54-istiod-ca-cert\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.027111 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.027082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-socket\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.027111 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.027096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-data\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.028886 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.028865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-envoy\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.029106 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.029089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af42970-02eb-4645-b6a5-d93053702e54-istio-podinfo\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.034834 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.034810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-istio-token\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.035071 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.035054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snc2q\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-kube-api-access-snc2q\") pod \"e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") " pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.051958 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.051938    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:31.185225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.185199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"]
Jul 21 01:10:31.187484 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:10:31.187452    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af42970_02eb_4645_b6a5_d93053702e54.slice/crio-50b3a4d8888afcd37b6f20fbeac89362eba830fd2790a749105a28b9c67cced7 WatchSource:0}: Error finding container 50b3a4d8888afcd37b6f20fbeac89362eba830fd2790a749105a28b9c67cced7: Status 404 returned error can't find the container with id 50b3a4d8888afcd37b6f20fbeac89362eba830fd2790a749105a28b9c67cced7
Jul 21 01:10:31.189667 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.189637    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:31.189720 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.189700    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:31.189754 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.189732    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:31.650760 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.650726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" event={"ID":"1af42970-02eb-4645-b6a5-d93053702e54","Type":"ContainerStarted","Data":"9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9"}
Jul 21 01:10:31.650952 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.650793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" event={"ID":"1af42970-02eb-4645-b6a5-d93053702e54","Type":"ContainerStarted","Data":"50b3a4d8888afcd37b6f20fbeac89362eba830fd2790a749105a28b9c67cced7"}
Jul 21 01:10:31.668653 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:31.668607    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" podStartSLOduration=1.668592104 podStartE2EDuration="1.668592104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:10:31.667676479 +0000 UTC m=+1775.340066845" watchObservedRunningTime="2026-07-21 01:10:31.668592104 +0000 UTC m=+1775.340982538"
Jul 21 01:10:32.052901 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:32.052815    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:32.057632 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:32.057607    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:32.654590 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:32.654555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:32.655616 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:32.655590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:33.124604 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:33.124573    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:33.226729 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:33.226695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:33.405316 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:33.405220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:33.693972 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:33.693889    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:33.793904 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:33.793871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:10:34.911149 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:34.911126    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:10:35.061630 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.061538    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb95h\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-kube-api-access-zb95h\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.061812 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.061632    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-podinfo\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.061812 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.061732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-envoy\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.061812 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.061767    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-credential-socket\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.061974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.061846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-token\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.061974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.061869    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-socket\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.061974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.061903    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b434aa-a9d6-4d4d-b38e-539519595c7b-istiod-ca-cert\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.062159 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062128    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:10:35.062223 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062137    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-certs\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.062223 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062177    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b434aa-a9d6-4d4d-b38e-539519595c7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:10:35.062317 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062225    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-data\") pod \"61b434aa-a9d6-4d4d-b38e-539519595c7b\" (UID: \"61b434aa-a9d6-4d4d-b38e-539519595c7b\") "
Jul 21 01:10:35.062317 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:10:35.062406 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:10:35.062624 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062541    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.062624 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062564    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b434aa-a9d6-4d4d-b38e-539519595c7b-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.062624 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062578    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.062624 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.062589    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.063289 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.063264    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:10:35.064113 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.064082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:10:35.064243 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.064198    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:10:35.064312 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.064271    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-kube-api-access-zb95h" (OuterVolumeSpecName: "kube-api-access-zb95h") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "kube-api-access-zb95h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:10:35.064312 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.064273    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61b434aa-a9d6-4d4d-b38e-539519595c7b" (UID: "61b434aa-a9d6-4d4d-b38e-539519595c7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:10:35.163228 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.163199    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.163228 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.163225    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.163228 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.163235    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb95h\" (UniqueName: \"kubernetes.io/projected/61b434aa-a9d6-4d4d-b38e-539519595c7b-kube-api-access-zb95h\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.163447 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.163245    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.163447 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.163254    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b434aa-a9d6-4d4d-b38e-539519595c7b-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:10:35.667721 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.667688    2560 generic.go:356] "Generic (PLEG): container finished" podID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerID="0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3" exitCode=0
Jul 21 01:10:35.667910 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.667735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"
Jul 21 01:10:35.667910 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.667793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" event={"ID":"61b434aa-a9d6-4d4d-b38e-539519595c7b","Type":"ContainerDied","Data":"0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3"}
Jul 21 01:10:35.667910 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.667852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m" event={"ID":"61b434aa-a9d6-4d4d-b38e-539519595c7b","Type":"ContainerDied","Data":"b55c8fd29d560b8f76a3295dca92c3ae41e8c720ba0c6ad756025aabc924273f"}
Jul 21 01:10:35.667910 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.667874    2560 scope.go:117] "RemoveContainer" containerID="0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3"
Jul 21 01:10:35.676632 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.676617    2560 scope.go:117] "RemoveContainer" containerID="88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31"
Jul 21 01:10:35.683896 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.683879    2560 scope.go:117] "RemoveContainer" containerID="0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3"
Jul 21 01:10:35.684148 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:10:35.684132    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3\": container with ID starting with 0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3 not found: ID does not exist" containerID="0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3"
Jul 21 01:10:35.684190 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.684158    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3"} err="failed to get container status \"0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3\": rpc error: code = NotFound desc = could not find container \"0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3\": container with ID starting with 0025bd8aa62ec858087a8fb88255aac527fb9e86b9749313cadd9c1b0f0c5aa3 not found: ID does not exist"
Jul 21 01:10:35.684190 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.684175    2560 scope.go:117] "RemoveContainer" containerID="88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31"
Jul 21 01:10:35.684387 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:10:35.684369    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31\": container with ID starting with 88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31 not found: ID does not exist" containerID="88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31"
Jul 21 01:10:35.684442 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.684398    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31"} err="failed to get container status \"88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31\": rpc error: code = NotFound desc = could not find container \"88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31\": container with ID starting with 88532e15abf6a878b3d1b564d5a3cabc2e7d595fd2a56a277bab39aedec5bf31 not found: ID does not exist"
Jul 21 01:10:35.690524 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.690499    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"]
Jul 21 01:10:35.695921 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:35.695899    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fb3c8577-openshift-default-7d6c88fbfc-mjm5m"]
Jul 21 01:10:36.853457 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:36.853422    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" path="/var/lib/kubelet/pods/61b434aa-a9d6-4d4d-b38e-539519595c7b/volumes"
Jul 21 01:10:45.712301 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:45.712269    2560 generic.go:356] "Generic (PLEG): container finished" podID="1af42970-02eb-4645-b6a5-d93053702e54" containerID="9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9" exitCode=0
Jul 21 01:10:45.712733 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:45.712323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" event={"ID":"1af42970-02eb-4645-b6a5-d93053702e54","Type":"ContainerDied","Data":"9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9"}
Jul 21 01:10:45.712733 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:45.712695    2560 scope.go:117] "RemoveContainer" containerID="9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9"
Jul 21 01:10:45.713676 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:45.713647    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:45.713750 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:45.713730    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:45.713825 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:45.713807    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:10:46.718412 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:46.718380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" event={"ID":"1af42970-02eb-4645-b6a5-d93053702e54","Type":"ContainerStarted","Data":"a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a"}
Jul 21 01:10:47.052703 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:47.052614    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:47.053926 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:47.053902    2560 patch_prober.go:28] interesting pod/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 21 01:10:47.053982 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:47.053950    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 21 01:10:47.655366 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:47.655320    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:48.053120 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:48.053024    2560 patch_prober.go:28] interesting pod/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 21 01:10:48.053120 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:48.053093    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 21 01:10:49.052691 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:49.052600    2560 patch_prober.go:28] interesting pod/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 21 01:10:49.052691 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:49.052661    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 21 01:10:50.053251 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:50.053205    2560 patch_prober.go:28] interesting pod/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 21 01:10:50.053714 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:50.053268    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 21 01:10:51.056294 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:51.056261    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:51.057234 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:51.057214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:10:58.126391 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.126353    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"]
Jul 21 01:10:58.126766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.126671    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy"
Jul 21 01:10:58.126766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.126681    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy"
Jul 21 01:10:58.126766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.126691    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy"
Jul 21 01:10:58.126766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.126697    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy"
Jul 21 01:10:58.126766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.126746    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy"
Jul 21 01:10:58.126766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.126753    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b434aa-a9d6-4d4d-b38e-539519595c7b" containerName="istio-proxy"
Jul 21 01:10:58.129518 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.129503    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"
Jul 21 01:10:58.131568 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.131530    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:10:58.131568 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.131538    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:10:58.136743 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.136390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"]
Jul 21 01:10:58.266137 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.266098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855f3d64-5f73-4870-988e-b8dc3a2b04e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd\" (UID: \"855f3d64-5f73-4870-988e-b8dc3a2b04e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"
Jul 21 01:10:58.367140 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.367107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855f3d64-5f73-4870-988e-b8dc3a2b04e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd\" (UID: \"855f3d64-5f73-4870-988e-b8dc3a2b04e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"
Jul 21 01:10:58.367733 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.367714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855f3d64-5f73-4870-988e-b8dc3a2b04e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd\" (UID: \"855f3d64-5f73-4870-988e-b8dc3a2b04e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"
Jul 21 01:10:58.440346 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.440257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"
Jul 21 01:10:58.564961 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.564931    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"]
Jul 21 01:10:58.568171 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:10:58.568141    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855f3d64_5f73_4870_988e_b8dc3a2b04e4.slice/crio-660d9405247daed42090ed5bae372f258ea6357fc542d92b66f90565c3bed007 WatchSource:0}: Error finding container 660d9405247daed42090ed5bae372f258ea6357fc542d92b66f90565c3bed007: Status 404 returned error can't find the container with id 660d9405247daed42090ed5bae372f258ea6357fc542d92b66f90565c3bed007
Jul 21 01:10:58.771273 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:58.771240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd" event={"ID":"855f3d64-5f73-4870-988e-b8dc3a2b04e4","Type":"ContainerStarted","Data":"660d9405247daed42090ed5bae372f258ea6357fc542d92b66f90565c3bed007"}
Jul 21 01:10:59.776432 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:59.776390    2560 generic.go:356] "Generic (PLEG): container finished" podID="855f3d64-5f73-4870-988e-b8dc3a2b04e4" containerID="0caafb34182a82ebef90cc69fb1e0c399e8d015822e859e6e4a54af0fa2dc528" exitCode=0
Jul 21 01:10:59.776843 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:10:59.776471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd" event={"ID":"855f3d64-5f73-4870-988e-b8dc3a2b04e4","Type":"ContainerDied","Data":"0caafb34182a82ebef90cc69fb1e0c399e8d015822e859e6e4a54af0fa2dc528"}
Jul 21 01:11:00.906062 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:00.906038    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"
Jul 21 01:11:00.990007 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:00.989974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855f3d64-5f73-4870-988e-b8dc3a2b04e4-maas-api-service-ca\") pod \"855f3d64-5f73-4870-988e-b8dc3a2b04e4\" (UID: \"855f3d64-5f73-4870-988e-b8dc3a2b04e4\") "
Jul 21 01:11:00.990427 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:00.990400    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/855f3d64-5f73-4870-988e-b8dc3a2b04e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "855f3d64-5f73-4870-988e-b8dc3a2b04e4" (UID: "855f3d64-5f73-4870-988e-b8dc3a2b04e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:11:01.091360 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:01.091329    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855f3d64-5f73-4870-988e-b8dc3a2b04e4-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:01.785834 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:01.785804    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"
Jul 21 01:11:01.785834 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:01.785813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd" event={"ID":"855f3d64-5f73-4870-988e-b8dc3a2b04e4","Type":"ContainerDied","Data":"660d9405247daed42090ed5bae372f258ea6357fc542d92b66f90565c3bed007"}
Jul 21 01:11:01.786041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:01.785875    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="660d9405247daed42090ed5bae372f258ea6357fc542d92b66f90565c3bed007"
Jul 21 01:11:08.586081 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:08.586039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:13.188918 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.188879    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"]
Jul 21 01:11:13.191228 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.191169    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b3d9b6c6-rfnrd"]
Jul 21 01:11:13.191463 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.191439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:13.316905 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.316872    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"]
Jul 21 01:11:13.317139 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.317090    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy" containerID="cri-o://a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a" gracePeriod=30
Jul 21 01:11:13.333974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.333949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:13.575289 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.575256    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:13.800214 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:13.800182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:14.103393 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.103355    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"]
Jul 21 01:11:14.103786 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.103752    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="855f3d64-5f73-4870-988e-b8dc3a2b04e4" containerName="revoke-keys"
Jul 21 01:11:14.103882 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.103789    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="855f3d64-5f73-4870-988e-b8dc3a2b04e4" containerName="revoke-keys"
Jul 21 01:11:14.103882 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.103869    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="855f3d64-5f73-4870-988e-b8dc3a2b04e4" containerName="revoke-keys"
Jul 21 01:11:14.106308 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.106288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.108543 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.108523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a2c78d91-openshift-default-dockercfg-p98p9\""
Jul 21 01:11:14.116656 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.116622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"]
Jul 21 01:11:14.126744 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.126715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:14.203307 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fk7z\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-kube-api-access-4fk7z\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-socket\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-credential-socket\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-envoy\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6df8df0-f2e7-4089-8e0a-7149e3498109-istiod-ca-cert\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-podinfo\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-token\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-data\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.203840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.203764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-certs\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305039 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.304999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-certs\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305039 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fk7z\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-kube-api-access-4fk7z\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305249 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-socket\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305249 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-credential-socket\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305249 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-envoy\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305374 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6df8df0-f2e7-4089-8e0a-7149e3498109-istiod-ca-cert\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305374 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-podinfo\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305479 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-token\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305479 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-data\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305479 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-certs\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305623 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-credential-socket\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305623 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-socket\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.305792 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.305758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-data\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.306119 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.306093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6df8df0-f2e7-4089-8e0a-7149e3498109-istiod-ca-cert\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.307451 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.307422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-envoy\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.307894 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.307874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-podinfo\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.313083 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.313057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-token\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.313255 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.313235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fk7z\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-kube-api-access-4fk7z\") pod \"e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") " pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.373481 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.373395    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:14.417895 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.417860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:14.575832 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.575032    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"]
Jul 21 01:11:14.579567 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.579493    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:14.579661 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.579599    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:14.579661 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.579630    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:14.844244 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.844209    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" event={"ID":"a6df8df0-f2e7-4089-8e0a-7149e3498109","Type":"ContainerStarted","Data":"ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943"}
Jul 21 01:11:14.844411 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.844265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" event={"ID":"a6df8df0-f2e7-4089-8e0a-7149e3498109","Type":"ContainerStarted","Data":"e9b0fc4a0df8ff5b12bf61faaba85869edae34803447d284e3e5580723188036"}
Jul 21 01:11:14.854087 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.854052    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="855f3d64-5f73-4870-988e-b8dc3a2b04e4" path="/var/lib/kubelet/pods/855f3d64-5f73-4870-988e-b8dc3a2b04e4/volumes"
Jul 21 01:11:14.866811 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:14.866750    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" podStartSLOduration=0.866735435 podStartE2EDuration="866.735435ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:11:14.864586985 +0000 UTC m=+1818.536977352" watchObservedRunningTime="2026-07-21 01:11:14.866735435 +0000 UTC m=+1818.539125853"
Jul 21 01:11:15.418423 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:15.418382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:15.423012 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:15.422988    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:15.848599 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:15.848563    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:15.849434 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:15.849412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:16.187183 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:16.187104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:16.270766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:16.270728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:16.330183 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:16.330130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:16.824235 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:16.824206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:16.923674 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:16.923632    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:18.557672 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.557651    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:11:18.747174 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747086    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-envoy\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747174 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747135    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snc2q\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-kube-api-access-snc2q\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747174 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747162    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af42970-02eb-4645-b6a5-d93053702e54-istio-podinfo\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747207    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-istio-token\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747264    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-socket\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-credential-socket\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747335    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-data\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747359    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af42970-02eb-4645-b6a5-d93053702e54-istiod-ca-cert\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747408    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-certs\") pod \"1af42970-02eb-4645-b6a5-d93053702e54\" (UID: \"1af42970-02eb-4645-b6a5-d93053702e54\") "
Jul 21 01:11:18.747750 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747610    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:11:18.747750 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:11:18.747750 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747726    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.747750 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.747747    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.748080 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.748054    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af42970-02eb-4645-b6a5-d93053702e54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:11:18.748207 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.748124    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:11:18.748367 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.748344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-data" (OuterVolumeSpecName: "istio-data") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:11:18.749438 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.749416    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:11:18.749583 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.749557    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1af42970-02eb-4645-b6a5-d93053702e54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:11:18.749733 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.749719    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-kube-api-access-snc2q" (OuterVolumeSpecName: "kube-api-access-snc2q") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "kube-api-access-snc2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:11:18.749813 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.749732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-istio-token" (OuterVolumeSpecName: "istio-token") pod "1af42970-02eb-4645-b6a5-d93053702e54" (UID: "1af42970-02eb-4645-b6a5-d93053702e54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:11:18.848939 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.848901    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.848939 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.848936    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.848939 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.848949    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1af42970-02eb-4645-b6a5-d93053702e54-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.849186 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.848962    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.849186 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.848974    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1af42970-02eb-4645-b6a5-d93053702e54-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.849186 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.848990    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snc2q\" (UniqueName: \"kubernetes.io/projected/1af42970-02eb-4645-b6a5-d93053702e54-kube-api-access-snc2q\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.849186 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.849005    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1af42970-02eb-4645-b6a5-d93053702e54-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:18.861489 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.861459    2560 generic.go:356] "Generic (PLEG): container finished" podID="1af42970-02eb-4645-b6a5-d93053702e54" containerID="a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a" exitCode=0
Jul 21 01:11:18.861633 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.861506    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"
Jul 21 01:11:18.861633 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.861534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" event={"ID":"1af42970-02eb-4645-b6a5-d93053702e54","Type":"ContainerDied","Data":"a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a"}
Jul 21 01:11:18.861633 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.861586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p" event={"ID":"1af42970-02eb-4645-b6a5-d93053702e54","Type":"ContainerDied","Data":"50b3a4d8888afcd37b6f20fbeac89362eba830fd2790a749105a28b9c67cced7"}
Jul 21 01:11:18.861633 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.861609    2560 scope.go:117] "RemoveContainer" containerID="a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a"
Jul 21 01:11:18.869742 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.869725    2560 scope.go:117] "RemoveContainer" containerID="9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9"
Jul 21 01:11:18.877427 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.877411    2560 scope.go:117] "RemoveContainer" containerID="a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a"
Jul 21 01:11:18.877708 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:11:18.877690    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a\": container with ID starting with a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a not found: ID does not exist" containerID="a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a"
Jul 21 01:11:18.877759 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.877716    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a"} err="failed to get container status \"a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a\": rpc error: code = NotFound desc = could not find container \"a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a\": container with ID starting with a437ca9743851b2101c389561683567be44964f174a6c229421702e3dec9028a not found: ID does not exist"
Jul 21 01:11:18.877759 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.877732    2560 scope.go:117] "RemoveContainer" containerID="9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9"
Jul 21 01:11:18.878012 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:11:18.877995    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9\": container with ID starting with 9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9 not found: ID does not exist" containerID="9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9"
Jul 21 01:11:18.878072 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.878017    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9"} err="failed to get container status \"9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9\": rpc error: code = NotFound desc = could not find container \"9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9\": container with ID starting with 9a0f176840a073d84a1aa8d46f34679ef29c28ebdf19f94dc798dacdabf36ae9 not found: ID does not exist"
Jul 21 01:11:18.878715 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.878699    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"]
Jul 21 01:11:18.881446 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:18.881422    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b3d9b6c6-gw-openshift-default-58d76f4599-rdk5p"]
Jul 21 01:11:20.854006 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:20.853971    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1af42970-02eb-4645-b6a5-d93053702e54" path="/var/lib/kubelet/pods/1af42970-02eb-4645-b6a5-d93053702e54/volumes"
Jul 21 01:11:31.352011 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.351203    2560 patch_prober.go:28] interesting pod/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": read tcp 10.133.0.2:40840->10.133.0.27:15021: read: connection reset by peer" start-of-body=
Jul 21 01:11:31.352011 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.351274    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": read tcp 10.133.0.2:40840->10.133.0.27:15021: read: connection reset by peer"
Jul 21 01:11:31.918501 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.918468    2560 generic.go:356] "Generic (PLEG): container finished" podID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerID="ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943" exitCode=0
Jul 21 01:11:31.918681 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.918545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" event={"ID":"a6df8df0-f2e7-4089-8e0a-7149e3498109","Type":"ContainerDied","Data":"ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943"}
Jul 21 01:11:31.918951 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.918937    2560 scope.go:117] "RemoveContainer" containerID="ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943"
Jul 21 01:11:31.919920 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.919895    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:31.919972 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.919959    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:31.920005 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:31.919987    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:32.923887 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:32.923848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" event={"ID":"a6df8df0-f2e7-4089-8e0a-7149e3498109","Type":"ContainerStarted","Data":"fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd"}
Jul 21 01:11:33.418701 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:33.418662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:33.418900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:33.418851    2560 patch_prober.go:28] interesting pod/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 21 01:11:33.418946 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:33.418896    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 21 01:11:34.418985 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:34.418947    2560 patch_prober.go:28] interesting pod/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 21 01:11:34.419466 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:34.419023    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 21 01:11:35.418668 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:35.418624    2560 patch_prober.go:28] interesting pod/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 21 01:11:35.418895 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:35.418698    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 21 01:11:36.418736 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:36.418697    2560 patch_prober.go:28] interesting pod/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 21 01:11:36.419164 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:36.418770    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 21 01:11:36.913440 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:36.913403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:36.986936 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:36.986901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:37.422529 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:37.422497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:37.422943 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:37.422753    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:37.423523 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:37.423498    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:11:42.019983 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.019944    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"]
Jul 21 01:11:42.020544 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.020392    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy"
Jul 21 01:11:42.020544 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.020410    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy"
Jul 21 01:11:42.020544 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.020431    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy"
Jul 21 01:11:42.020544 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.020440    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy"
Jul 21 01:11:42.020544 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.020512    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy"
Jul 21 01:11:42.022994 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.022973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"
Jul 21 01:11:42.024977 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.024952    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:11:42.025082 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.025044    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:11:42.028711 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.028685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"]
Jul 21 01:11:42.143272 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.143234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b5ed404-ab87-453a-806f-c73d8b41a9b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v\" (UID: \"4b5ed404-ab87-453a-806f-c73d8b41a9b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"
Jul 21 01:11:42.244486 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.244443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b5ed404-ab87-453a-806f-c73d8b41a9b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v\" (UID: \"4b5ed404-ab87-453a-806f-c73d8b41a9b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"
Jul 21 01:11:42.245081 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.245063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b5ed404-ab87-453a-806f-c73d8b41a9b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v\" (UID: \"4b5ed404-ab87-453a-806f-c73d8b41a9b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"
Jul 21 01:11:42.334504 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.334473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"
Jul 21 01:11:42.456092 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.456067    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"]
Jul 21 01:11:42.458239 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:11:42.458211    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5ed404_ab87_453a_806f_c73d8b41a9b4.slice/crio-46fae8d38c38acd310119d045419dd95f224acf04c07e8c017671176eb9a4e70 WatchSource:0}: Error finding container 46fae8d38c38acd310119d045419dd95f224acf04c07e8c017671176eb9a4e70: Status 404 returned error can't find the container with id 46fae8d38c38acd310119d045419dd95f224acf04c07e8c017671176eb9a4e70
Jul 21 01:11:42.977299 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.977212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v" event={"ID":"4b5ed404-ab87-453a-806f-c73d8b41a9b4","Type":"ContainerStarted","Data":"33301c8e48557f0677d56302f3252b70cb447717948ad2f59db3c9dafda867ed"}
Jul 21 01:11:42.977299 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.977291    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v" event={"ID":"4b5ed404-ab87-453a-806f-c73d8b41a9b4","Type":"ContainerStarted","Data":"46fae8d38c38acd310119d045419dd95f224acf04c07e8c017671176eb9a4e70"}
Jul 21 01:11:42.992241 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:42.992188    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v" podStartSLOduration=0.99217195 podStartE2EDuration="992.17195ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:11:42.99025231 +0000 UTC m=+1846.662642676" watchObservedRunningTime="2026-07-21 01:11:42.99217195 +0000 UTC m=+1846.664562315"
Jul 21 01:11:43.982655 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:43.982616    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b5ed404-ab87-453a-806f-c73d8b41a9b4" containerID="33301c8e48557f0677d56302f3252b70cb447717948ad2f59db3c9dafda867ed" exitCode=0
Jul 21 01:11:43.983093 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:43.982708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v" event={"ID":"4b5ed404-ab87-453a-806f-c73d8b41a9b4","Type":"ContainerDied","Data":"33301c8e48557f0677d56302f3252b70cb447717948ad2f59db3c9dafda867ed"}
Jul 21 01:11:45.109679 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:45.109655    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"
Jul 21 01:11:45.171154 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:45.171125    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b5ed404-ab87-453a-806f-c73d8b41a9b4-maas-api-service-ca\") pod \"4b5ed404-ab87-453a-806f-c73d8b41a9b4\" (UID: \"4b5ed404-ab87-453a-806f-c73d8b41a9b4\") "
Jul 21 01:11:45.171486 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:45.171459    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b5ed404-ab87-453a-806f-c73d8b41a9b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b5ed404-ab87-453a-806f-c73d8b41a9b4" (UID: "4b5ed404-ab87-453a-806f-c73d8b41a9b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:11:45.271931 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:45.271855    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b5ed404-ab87-453a-806f-c73d8b41a9b4-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:11:45.992671 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:45.992647    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"
Jul 21 01:11:45.992671 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:45.992653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v" event={"ID":"4b5ed404-ab87-453a-806f-c73d8b41a9b4","Type":"ContainerDied","Data":"46fae8d38c38acd310119d045419dd95f224acf04c07e8c017671176eb9a4e70"}
Jul 21 01:11:45.992992 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:45.992698    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46fae8d38c38acd310119d045419dd95f224acf04c07e8c017671176eb9a4e70"
Jul 21 01:11:52.482235 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:52.482186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:57.077404 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:57.077371    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"]
Jul 21 01:11:57.080297 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:57.080271    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:57.080464 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:57.080436    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2c78d91-vnh9v"]
Jul 21 01:11:58.299233 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:58.299198    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"]
Jul 21 01:11:58.299705 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:58.299450    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy" containerID="cri-o://fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd" gracePeriod=30
Jul 21 01:11:58.319911 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:58.319888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:58.568168 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:58.568136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:58.796859 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:58.796821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:58.853034 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:58.852967    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b5ed404-ab87-453a-806f-c73d8b41a9b4" path="/var/lib/kubelet/pods/4b5ed404-ab87-453a-806f-c73d8b41a9b4/volumes"
Jul 21 01:11:59.080021 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.079987    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"]
Jul 21 01:11:59.080443 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.080427    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5ed404-ab87-453a-806f-c73d8b41a9b4" containerName="revoke-keys"
Jul 21 01:11:59.080511 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.080446    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5ed404-ab87-453a-806f-c73d8b41a9b4" containerName="revoke-keys"
Jul 21 01:11:59.080564 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.080516    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af42970-02eb-4645-b6a5-d93053702e54" containerName="istio-proxy"
Jul 21 01:11:59.080564 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.080530    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b5ed404-ab87-453a-806f-c73d8b41a9b4" containerName="revoke-keys"
Jul 21 01:11:59.083342 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.083322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.085315 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.085297    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0a237698-openshift-default-dockercfg-8qwfn\""
Jul 21 01:11:59.090984 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.090953    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"]
Jul 21 01:11:59.102421 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.102392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:59.182373 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-socket\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.182634 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-certs\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.182771 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-data\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.182771 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-credential-socket\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.182771 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-token\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.182961 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-envoy\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.182961 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-podinfo\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.182961 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istiod-ca-cert\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.183112 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.182974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcj4f\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-kube-api-access-mcj4f\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.283616 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.283589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-data\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.283796 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.283664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-credential-socket\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.283796 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.283694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-token\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.283796 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.283749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-envoy\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.283987 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.283827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-podinfo\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.283987 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.283857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istiod-ca-cert\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.283987 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.283943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcj4f\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-kube-api-access-mcj4f\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.284145 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.284033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-socket\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.284145 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.284056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-certs\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.284145 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.284082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-data\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.284334 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.284272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-credential-socket\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.284447 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.284428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-socket\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.284511 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.284429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-certs\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.284900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.284871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istiod-ca-cert\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.286128 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.286107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-envoy\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.286209 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.286191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-podinfo\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.291218 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.291191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcj4f\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-kube-api-access-mcj4f\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.291663 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.291647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-token\") pod \"e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") " pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.303291 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.303269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:11:59.395573 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.395543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:11:59.523718 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.523689    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"]
Jul 21 01:11:59.526494 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:11:59.526467    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8dd266e_2c1f_43e6_8bb9_b9d63604f09f.slice/crio-c2a3998560f3a15f9fe97d9a97f0219af993f5b716ef7c71de702194822ae904 WatchSource:0}: Error finding container c2a3998560f3a15f9fe97d9a97f0219af993f5b716ef7c71de702194822ae904: Status 404 returned error can't find the container with id c2a3998560f3a15f9fe97d9a97f0219af993f5b716ef7c71de702194822ae904
Jul 21 01:11:59.528728 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.528697    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:59.528810 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.528760    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:11:59.528854 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:11:59.528831    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:12:00.051158 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:00.051123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" event={"ID":"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f","Type":"ContainerStarted","Data":"bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3"}
Jul 21 01:12:00.051340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:00.051177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" event={"ID":"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f","Type":"ContainerStarted","Data":"c2a3998560f3a15f9fe97d9a97f0219af993f5b716ef7c71de702194822ae904"}
Jul 21 01:12:00.069861 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:00.069813    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" podStartSLOduration=1.069799684 podStartE2EDuration="1.069799684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:11:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:12:00.068460135 +0000 UTC m=+1863.740850504" watchObservedRunningTime="2026-07-21 01:12:00.069799684 +0000 UTC m=+1863.742190051"
Jul 21 01:12:00.396666 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:00.396637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:00.401243 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:00.401216    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:01.059251 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:01.056918    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:01.060591 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:01.060564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:01.489893 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:01.489856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:01.562992 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:01.562960    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:01.634021 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:01.633989    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:01.939861 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:01.939830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:02.134135 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:02.134089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:02.228510 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:02.228436    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:03.543224 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.543199    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:12:03.722293 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722268    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fk7z\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-kube-api-access-4fk7z\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722312    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-socket\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722332    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-token\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722351    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-envoy\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722374    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-podinfo\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722399    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-data\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722656 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722452    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-certs\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722656 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6df8df0-f2e7-4089-8e0a-7149e3498109-istiod-ca-cert\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722656 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722504    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-credential-socket\") pod \"a6df8df0-f2e7-4089-8e0a-7149e3498109\" (UID: \"a6df8df0-f2e7-4089-8e0a-7149e3498109\") "
Jul 21 01:12:03.722656 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722591    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:03.722873 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722735    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.723216 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:03.723216 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.722972    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:03.723216 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.723173    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6df8df0-f2e7-4089-8e0a-7149e3498109-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:12:03.723485 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.723464    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:03.724543 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.724514    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-kube-api-access-4fk7z" (OuterVolumeSpecName: "kube-api-access-4fk7z") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "kube-api-access-4fk7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:12:03.724694 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.724671    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:12:03.724968 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.724943    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:03.725059 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.724966    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6df8df0-f2e7-4089-8e0a-7149e3498109" (UID: "a6df8df0-f2e7-4089-8e0a-7149e3498109"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:12:03.824052 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824019    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.824052 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824046    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.824052 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824055    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.824250 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824065    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.824250 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824073    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.824250 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824081    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6df8df0-f2e7-4089-8e0a-7149e3498109-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.824250 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824089    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6df8df0-f2e7-4089-8e0a-7149e3498109-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:03.824250 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:03.824097    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fk7z\" (UniqueName: \"kubernetes.io/projected/a6df8df0-f2e7-4089-8e0a-7149e3498109-kube-api-access-4fk7z\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:04.071042 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.071012    2560 generic.go:356] "Generic (PLEG): container finished" podID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerID="fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd" exitCode=0
Jul 21 01:12:04.071200 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.071057    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"
Jul 21 01:12:04.071200 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.071092    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" event={"ID":"a6df8df0-f2e7-4089-8e0a-7149e3498109","Type":"ContainerDied","Data":"fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd"}
Jul 21 01:12:04.071200 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.071145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg" event={"ID":"a6df8df0-f2e7-4089-8e0a-7149e3498109","Type":"ContainerDied","Data":"e9b0fc4a0df8ff5b12bf61faaba85869edae34803447d284e3e5580723188036"}
Jul 21 01:12:04.071200 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.071168    2560 scope.go:117] "RemoveContainer" containerID="fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd"
Jul 21 01:12:04.080048 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.080032    2560 scope.go:117] "RemoveContainer" containerID="ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943"
Jul 21 01:12:04.087116 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.087099    2560 scope.go:117] "RemoveContainer" containerID="fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd"
Jul 21 01:12:04.087335 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:12:04.087316    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd\": container with ID starting with fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd not found: ID does not exist" containerID="fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd"
Jul 21 01:12:04.087373 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.087344    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd"} err="failed to get container status \"fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd\": rpc error: code = NotFound desc = could not find container \"fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd\": container with ID starting with fe6c49d05276528021f0e749551433a6fbcb482cbd5dcadbc30eba11e3a381dd not found: ID does not exist"
Jul 21 01:12:04.087373 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.087361    2560 scope.go:117] "RemoveContainer" containerID="ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943"
Jul 21 01:12:04.087577 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:12:04.087560    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943\": container with ID starting with ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943 not found: ID does not exist" containerID="ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943"
Jul 21 01:12:04.087626 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.087584    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943"} err="failed to get container status \"ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943\": rpc error: code = NotFound desc = could not find container \"ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943\": container with ID starting with ad878c0f51a46ccbbf55e581cdcb0b64a145d949006f8d2e5796ff2ccc1bc943 not found: ID does not exist"
Jul 21 01:12:04.092556 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.092538    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"]
Jul 21 01:12:04.097169 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.097150    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a2c78d91-openshift-default-6dd9c9497-sr8mg"]
Jul 21 01:12:04.852994 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:04.852963    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" path="/var/lib/kubelet/pods/a6df8df0-f2e7-4089-8e0a-7149e3498109/volumes"
Jul 21 01:12:15.130281 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:15.130239    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerID="bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3" exitCode=0
Jul 21 01:12:15.130685 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:15.130305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" event={"ID":"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f","Type":"ContainerDied","Data":"bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3"}
Jul 21 01:12:15.130685 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:15.130661    2560 scope.go:117] "RemoveContainer" containerID="bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3"
Jul 21 01:12:15.131583 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:15.131557    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:12:15.131646 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:15.131623    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:12:15.131690 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:15.131654    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:12:16.057057 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:16.057017    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:16.139334 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:16.139262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" event={"ID":"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f","Type":"ContainerStarted","Data":"8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229"}
Jul 21 01:12:16.395909 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:16.395875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:16.396726 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:16.396705    2560 patch_prober.go:28] interesting pod/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 01:12:16.396771 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:16.396751    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 01:12:17.396907 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:17.396868    2560 patch_prober.go:28] interesting pod/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 01:12:17.397324 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:17.396927    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 01:12:18.396471 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:18.396425    2560 patch_prober.go:28] interesting pod/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 01:12:18.396658 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:18.396495    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 01:12:19.396509 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:19.396423    2560 patch_prober.go:28] interesting pod/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 01:12:19.396933 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:19.396505    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 01:12:20.399953 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:20.399921    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:20.400344 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:20.400275    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:20.400914 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:20.400899    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:22.754539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:22.754500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:22.857706 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:22.857675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:23.574178 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:23.574141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:23.675152 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:23.675085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:26.297181 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.297146    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"]
Jul 21 01:12:26.297555 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.297426    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy"
Jul 21 01:12:26.297555 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.297436    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy"
Jul 21 01:12:26.297555 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.297491    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy"
Jul 21 01:12:26.299355 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.299339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"
Jul 21 01:12:26.301350 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.301327    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:12:26.301482 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.301326    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:12:26.305946 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.305925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"]
Jul 21 01:12:26.397113 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.397079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50c5c435-2354-4e7f-be14-6cf43457d61e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0a237698-j6h49\" (UID: \"50c5c435-2354-4e7f-be14-6cf43457d61e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"
Jul 21 01:12:26.498426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.498398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50c5c435-2354-4e7f-be14-6cf43457d61e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0a237698-j6h49\" (UID: \"50c5c435-2354-4e7f-be14-6cf43457d61e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"
Jul 21 01:12:26.498956 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.498939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50c5c435-2354-4e7f-be14-6cf43457d61e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0a237698-j6h49\" (UID: \"50c5c435-2354-4e7f-be14-6cf43457d61e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"
Jul 21 01:12:26.610932 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.610914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"
Jul 21 01:12:26.730798 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:26.730756    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"]
Jul 21 01:12:26.733308 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:12:26.733280    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c5c435_2354_4e7f_be14_6cf43457d61e.slice/crio-5e026429c209998fc3c11aa2dbb6bedb9c2b3ed33d326202732148c19721fdf0 WatchSource:0}: Error finding container 5e026429c209998fc3c11aa2dbb6bedb9c2b3ed33d326202732148c19721fdf0: Status 404 returned error can't find the container with id 5e026429c209998fc3c11aa2dbb6bedb9c2b3ed33d326202732148c19721fdf0
Jul 21 01:12:27.195519 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:27.195432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49" event={"ID":"50c5c435-2354-4e7f-be14-6cf43457d61e","Type":"ContainerStarted","Data":"166b12be980d72b61f8d9628f0d9a5351bbedf76e9468b3286cd823b83686102"}
Jul 21 01:12:27.195519 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:27.195480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49" event={"ID":"50c5c435-2354-4e7f-be14-6cf43457d61e","Type":"ContainerStarted","Data":"5e026429c209998fc3c11aa2dbb6bedb9c2b3ed33d326202732148c19721fdf0"}
Jul 21 01:12:27.211173 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:27.211112    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49" podStartSLOduration=1.21109899 podStartE2EDuration="1.21109899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:12:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:12:27.209106497 +0000 UTC m=+1890.881496863" watchObservedRunningTime="2026-07-21 01:12:27.21109899 +0000 UTC m=+1890.883489378"
Jul 21 01:12:28.201438 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:28.201406    2560 generic.go:356] "Generic (PLEG): container finished" podID="50c5c435-2354-4e7f-be14-6cf43457d61e" containerID="166b12be980d72b61f8d9628f0d9a5351bbedf76e9468b3286cd823b83686102" exitCode=0
Jul 21 01:12:28.201841 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:28.201476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49" event={"ID":"50c5c435-2354-4e7f-be14-6cf43457d61e","Type":"ContainerDied","Data":"166b12be980d72b61f8d9628f0d9a5351bbedf76e9468b3286cd823b83686102"}
Jul 21 01:12:29.334543 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:29.334514    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"
Jul 21 01:12:29.418699 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:29.418671    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50c5c435-2354-4e7f-be14-6cf43457d61e-maas-api-service-ca\") pod \"50c5c435-2354-4e7f-be14-6cf43457d61e\" (UID: \"50c5c435-2354-4e7f-be14-6cf43457d61e\") "
Jul 21 01:12:29.419041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:29.419018    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c5c435-2354-4e7f-be14-6cf43457d61e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50c5c435-2354-4e7f-be14-6cf43457d61e" (UID: "50c5c435-2354-4e7f-be14-6cf43457d61e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:12:29.519990 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:29.519924    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50c5c435-2354-4e7f-be14-6cf43457d61e-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:30.211211 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:30.211173    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"
Jul 21 01:12:30.211355 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:30.211170    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49" event={"ID":"50c5c435-2354-4e7f-be14-6cf43457d61e","Type":"ContainerDied","Data":"5e026429c209998fc3c11aa2dbb6bedb9c2b3ed33d326202732148c19721fdf0"}
Jul 21 01:12:30.211355 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:30.211308    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e026429c209998fc3c11aa2dbb6bedb9c2b3ed33d326202732148c19721fdf0"
Jul 21 01:12:36.660318 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:36.660282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:41.371153 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:41.371116    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"]
Jul 21 01:12:41.373710 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:41.373683    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a237698-j6h49"]
Jul 21 01:12:41.374301 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:41.374280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:41.507317 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:41.507282    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"]
Jul 21 01:12:41.507576 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:41.507550    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy" containerID="cri-o://8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229" gracePeriod=30
Jul 21 01:12:41.544151 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:41.544115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:41.762268 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:41.762127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:42.228514 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:42.228476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:42.325759 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:42.325719    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:42.425630 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:42.425594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:42.853651 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:42.853616    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c5c435-2354-4e7f-be14-6cf43457d61e" path="/var/lib/kubelet/pods/50c5c435-2354-4e7f-be14-6cf43457d61e/volumes"
Jul 21 01:12:43.899811 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:43.899758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:46.748841 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.748818    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:46.871274 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871246    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-token\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871413 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871306    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-socket\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871413 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871333    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istiod-ca-cert\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871413 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-credential-socket\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871413 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871398    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-envoy\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871698 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871424    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcj4f\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-kube-api-access-mcj4f\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871698 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871465    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-podinfo\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871698 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-data\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871698 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871564    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-certs\") pod \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\" (UID: \"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f\") "
Jul 21 01:12:46.871698 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:46.871982 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:46.871982 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871770    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:12:46.871982 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.871915    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:46.872143 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.872020    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.872143 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.872039    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.872143 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.872053    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.872143 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.872065    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.872518 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.872493    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:46.873770 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.873739    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:12:46.873770 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.873787    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-kube-api-access-mcj4f" (OuterVolumeSpecName: "kube-api-access-mcj4f") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "kube-api-access-mcj4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:12:46.874034 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.874009    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:12:46.874034 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.874011    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" (UID: "d8dd266e-2c1f-43e6-8bb9-b9d63604f09f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:12:46.972786 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.972746    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.972934 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.972801    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.972934 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.972810    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.972934 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.972821    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcj4f\" (UniqueName: \"kubernetes.io/projected/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-kube-api-access-mcj4f\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:46.972934 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:46.972831    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:12:47.288627 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.288544    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerID="8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229" exitCode=0
Jul 21 01:12:47.288627 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.288595    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"
Jul 21 01:12:47.288817 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.288635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" event={"ID":"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f","Type":"ContainerDied","Data":"8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229"}
Jul 21 01:12:47.288817 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.288694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs" event={"ID":"d8dd266e-2c1f-43e6-8bb9-b9d63604f09f","Type":"ContainerDied","Data":"c2a3998560f3a15f9fe97d9a97f0219af993f5b716ef7c71de702194822ae904"}
Jul 21 01:12:47.288817 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.288723    2560 scope.go:117] "RemoveContainer" containerID="8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229"
Jul 21 01:12:47.304259 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.304237    2560 scope.go:117] "RemoveContainer" containerID="bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3"
Jul 21 01:12:47.312126 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.312107    2560 scope.go:117] "RemoveContainer" containerID="8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229"
Jul 21 01:12:47.312410 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:12:47.312383    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229\": container with ID starting with 8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229 not found: ID does not exist" containerID="8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229"
Jul 21 01:12:47.312516 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.312420    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229"} err="failed to get container status \"8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229\": rpc error: code = NotFound desc = could not find container \"8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229\": container with ID starting with 8ed9b6db888e82d810a8dcce4e2fd7d61c849d8e76d92995775aad261bcf0229 not found: ID does not exist"
Jul 21 01:12:47.312516 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.312443    2560 scope.go:117] "RemoveContainer" containerID="bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3"
Jul 21 01:12:47.312853 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:12:47.312748    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3\": container with ID starting with bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3 not found: ID does not exist" containerID="bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3"
Jul 21 01:12:47.312853 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.312810    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3"} err="failed to get container status \"bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3\": rpc error: code = NotFound desc = could not find container \"bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3\": container with ID starting with bd817db578c62b8c2f5df0fe5542ea458722277ab6acb196e4fa2b5622fbe1c3 not found: ID does not exist"
Jul 21 01:12:47.313050 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.313008    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"]
Jul 21 01:12:47.314424 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:47.314404    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0a237698-openshift-default-f97f666dc-dp4fs"]
Jul 21 01:12:48.853721 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:48.853677    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" path="/var/lib/kubelet/pods/d8dd266e-2c1f-43e6-8bb9-b9d63604f09f/volumes"
Jul 21 01:12:49.561630 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:49.561579    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:49.613624 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:49.613597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:49.711213 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:49.711175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:49.807711 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:49.807672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:49.909879 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:49.909844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:12:50.332054 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:12:50.332020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:16.313361 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:16.313314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:22.737354 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:22.737317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:22.839466 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:22.839433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:22.938061 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:22.938010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:38.849009 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:38.848958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:44.481943 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:44.481909    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:44.589892 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:44.589857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:44.683220 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:44.683171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:13:54.602991 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:13:54.602914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:00.521387 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:00.521342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:00.621549 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:00.621510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:00.752538 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:00.752509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:00.851912 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:00.851881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:00.950731 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:00.950700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:11.606232 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:11.606194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:17.272675 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:17.272635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:18.318061 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318030    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"]
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318308    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy"
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318346    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy"
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318359    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy"
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318364    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy"
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318372    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c5c435-2354-4e7f-be14-6cf43457d61e" containerName="revoke-keys"
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318378    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c5c435-2354-4e7f-be14-6cf43457d61e" containerName="revoke-keys"
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318389    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy"
Jul 21 01:14:18.318426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318394    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy"
Jul 21 01:14:18.318719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318436    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c5c435-2354-4e7f-be14-6cf43457d61e" containerName="revoke-keys"
Jul 21 01:14:18.318719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318463    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6df8df0-f2e7-4089-8e0a-7149e3498109" containerName="istio-proxy"
Jul 21 01:14:18.318719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318470    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy"
Jul 21 01:14:18.318719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.318477    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8dd266e-2c1f-43e6-8bb9-b9d63604f09f" containerName="istio-proxy"
Jul 21 01:14:18.321382 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.321366    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.323742 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.323718    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f45cf085-openshift-default-dockercfg-gwz9v\""
Jul 21 01:14:18.332699 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.332673    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"]
Jul 21 01:14:18.382561 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.382527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:18.451022 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.450979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-credential-socket\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzr6\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-kube-api-access-wrzr6\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-certs\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-envoy\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-data\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451393 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6898d893-1018-464b-84ca-4e328e2bc254-istiod-ca-cert\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451393 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-socket\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451393 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6898d893-1018-464b-84ca-4e328e2bc254-istio-podinfo\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.451393 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.451364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-istio-token\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.510817 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.510768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:18.552797 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6898d893-1018-464b-84ca-4e328e2bc254-istio-podinfo\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.552998 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-istio-token\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.552998 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-credential-socket\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.552998 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzr6\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-kube-api-access-wrzr6\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.552998 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-certs\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.552998 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-envoy\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.552998 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-data\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.552998 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.552990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6898d893-1018-464b-84ca-4e328e2bc254-istiod-ca-cert\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.553340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.553024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-socket\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.553340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.553312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-credential-socket\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.553453 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.553370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-certs\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.553510 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.553455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-socket\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.553510 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.553494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-data\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.553751 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.553728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6898d893-1018-464b-84ca-4e328e2bc254-istiod-ca-cert\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.555188 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.555169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-envoy\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.555272 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.555258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6898d893-1018-464b-84ca-4e328e2bc254-istio-podinfo\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.560155 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.560130    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-istio-token\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.560259 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.560234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzr6\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-kube-api-access-wrzr6\") pod \"e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") " pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.632218 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.632123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:18.763983 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.763956    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"]
Jul 21 01:14:18.766393 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:14:18.766345    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6898d893_1018_464b_84ca_4e328e2bc254.slice/crio-e6a04b5eb054845b4921b6e8f9e40c6b81a23e58caf46b576a00e8256f289d3b WatchSource:0}: Error finding container e6a04b5eb054845b4921b6e8f9e40c6b81a23e58caf46b576a00e8256f289d3b: Status 404 returned error can't find the container with id e6a04b5eb054845b4921b6e8f9e40c6b81a23e58caf46b576a00e8256f289d3b
Jul 21 01:14:18.768608 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.768576    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:14:18.768682 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.768646    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:14:18.768682 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:18.768674    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:14:19.690325 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:19.690284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc" event={"ID":"6898d893-1018-464b-84ca-4e328e2bc254","Type":"ContainerStarted","Data":"32cb4df3463cfed305fce9be197b9132ea0389bc5aaf3f0d7a5d92c38441d517"}
Jul 21 01:14:19.690722 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:19.690350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc" event={"ID":"6898d893-1018-464b-84ca-4e328e2bc254","Type":"ContainerStarted","Data":"e6a04b5eb054845b4921b6e8f9e40c6b81a23e58caf46b576a00e8256f289d3b"}
Jul 21 01:14:19.709792 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:19.709723    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc" podStartSLOduration=1.709706859 podStartE2EDuration="1.709706859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:14:19.708708597 +0000 UTC m=+2003.381098963" watchObservedRunningTime="2026-07-21 01:14:19.709706859 +0000 UTC m=+2003.382097224"
Jul 21 01:14:20.632323 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:20.632284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:20.636972 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:20.636946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:20.695424 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:20.695395    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:20.696343 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:20.696325    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:31.599055 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:31.599021    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"]
Jul 21 01:14:31.599535 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:31.599262    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc" podUID="6898d893-1018-464b-84ca-4e328e2bc254" containerName="istio-proxy" containerID="cri-o://32cb4df3463cfed305fce9be197b9132ea0389bc5aaf3f0d7a5d92c38441d517" gracePeriod=30
Jul 21 01:14:31.622221 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:31.622192    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:31.861190 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:31.861107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:32.031885 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:32.031848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:32.130697 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:32.130611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:32.284860 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:32.284831    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:35.697818 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:35.697786    2560 patch_prober.go:28] interesting pod/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 01:14:35.698185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:35.697843    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc" podUID="6898d893-1018-464b-84ca-4e328e2bc254" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 01:14:36.768234 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:36.768199    2560 generic.go:356] "Generic (PLEG): container finished" podID="6898d893-1018-464b-84ca-4e328e2bc254" containerID="32cb4df3463cfed305fce9be197b9132ea0389bc5aaf3f0d7a5d92c38441d517" exitCode=0
Jul 21 01:14:36.768672 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:36.768254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc" event={"ID":"6898d893-1018-464b-84ca-4e328e2bc254","Type":"ContainerDied","Data":"32cb4df3463cfed305fce9be197b9132ea0389bc5aaf3f0d7a5d92c38441d517"}
Jul 21 01:14:36.845787 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:36.845751    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:37.019510 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-socket\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019510 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019470    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6898d893-1018-464b-84ca-4e328e2bc254-istiod-ca-cert\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019510 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019490    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-data\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019510 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-envoy\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019878 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019560    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-credential-socket\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019878 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019599    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrzr6\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-kube-api-access-wrzr6\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019878 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019634    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-certs\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019878 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019659    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6898d893-1018-464b-84ca-4e328e2bc254-istio-podinfo\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.019878 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019681    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:14:37.019878 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019794    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-istio-token\") pod \"6898d893-1018-464b-84ca-4e328e2bc254\" (UID: \"6898d893-1018-464b-84ca-4e328e2bc254\") "
Jul 21 01:14:37.020189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019864    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-data" (OuterVolumeSpecName: "istio-data") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:14:37.020189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:14:37.020189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.019974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6898d893-1018-464b-84ca-4e328e2bc254-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:14:37.020189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.020094    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:14:37.020396 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.020243    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.020396 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.020265    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.020396 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.020279    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6898d893-1018-464b-84ca-4e328e2bc254-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.020396 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.020294    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.020396 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.020307    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.021936 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.021906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-kube-api-access-wrzr6" (OuterVolumeSpecName: "kube-api-access-wrzr6") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "kube-api-access-wrzr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:14:37.022045 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.022003    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-istio-token" (OuterVolumeSpecName: "istio-token") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:14:37.022045 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.022003    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:14:37.022045 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.022034    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6898d893-1018-464b-84ca-4e328e2bc254-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6898d893-1018-464b-84ca-4e328e2bc254" (UID: "6898d893-1018-464b-84ca-4e328e2bc254"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:14:37.120938 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.120892    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6898d893-1018-464b-84ca-4e328e2bc254-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.120938 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.120930    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrzr6\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-kube-api-access-wrzr6\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.120938 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.120945    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6898d893-1018-464b-84ca-4e328e2bc254-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.121185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.120957    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6898d893-1018-464b-84ca-4e328e2bc254-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:14:37.774118 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.774086    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"
Jul 21 01:14:37.774118 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.774091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc" event={"ID":"6898d893-1018-464b-84ca-4e328e2bc254","Type":"ContainerDied","Data":"e6a04b5eb054845b4921b6e8f9e40c6b81a23e58caf46b576a00e8256f289d3b"}
Jul 21 01:14:37.774647 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.774146    2560 scope.go:117] "RemoveContainer" containerID="32cb4df3463cfed305fce9be197b9132ea0389bc5aaf3f0d7a5d92c38441d517"
Jul 21 01:14:37.794609 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.794581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"]
Jul 21 01:14:37.799685 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.799658    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f45cf085-openshift-default-7684c9dc-4w6mc"]
Jul 21 01:14:37.928983 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:37.928950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:38.033958 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:38.033883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:38.130114 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:38.130073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:38.324467 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:38.324429    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:38.853315 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:38.853285    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6898d893-1018-464b-84ca-4e328e2bc254" path="/var/lib/kubelet/pods/6898d893-1018-464b-84ca-4e328e2bc254/volumes"
Jul 21 01:14:39.152070 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:39.151995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:39.253097 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:39.253066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:44.772707 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:44.772675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:44.884275 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:44.884242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:51.486032 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.485998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:51.771853 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.771761    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"]
Jul 21 01:14:51.772111 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.772096    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6898d893-1018-464b-84ca-4e328e2bc254" containerName="istio-proxy"
Jul 21 01:14:51.772175 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.772113    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6898d893-1018-464b-84ca-4e328e2bc254" containerName="istio-proxy"
Jul 21 01:14:51.772175 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.772170    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6898d893-1018-464b-84ca-4e328e2bc254" containerName="istio-proxy"
Jul 21 01:14:51.776496 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.776478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.778944 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.778920    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6eed7610-openshift-default-dockercfg-65bjx\""
Jul 21 01:14:51.787464 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.787442    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"]
Jul 21 01:14:51.800189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.800164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:51.933836 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.933793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-token\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.933845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-certs\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.933870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sr9b\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-kube-api-access-8sr9b\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.933894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-envoy\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.933946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istiod-ca-cert\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.934001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-credential-socket\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934256 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.934036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-data\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934256 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.934097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-podinfo\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:51.934256 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:51.934131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-socket\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035210 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-socket\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035210 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-token\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035210 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-certs\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035485 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sr9b\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-kube-api-access-8sr9b\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035485 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035369    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-envoy\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035485 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istiod-ca-cert\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035485 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-credential-socket\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-data\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-socket\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-certs\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-podinfo\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035954 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-credential-socket\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.035954 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.035910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-data\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.036123 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.036107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istiod-ca-cert\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.037683 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.037660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-envoy\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.037876 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.037859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-podinfo\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.040759 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.040739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:52.043481 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.043458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-token\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.044155 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.044134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sr9b\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-kube-api-access-8sr9b\") pod \"e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") " pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.085563 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.085537    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:52.218921 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.218888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"]
Jul 21 01:14:52.222300 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:14:52.222278    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956e4a44_2f7f_48c5_94ff_fbbb4102e2d9.slice/crio-f95b71b965f539a082bd1d525427db69c4e20422d13fe6f4f20c07920f5f10e4 WatchSource:0}: Error finding container f95b71b965f539a082bd1d525427db69c4e20422d13fe6f4f20c07920f5f10e4: Status 404 returned error can't find the container with id f95b71b965f539a082bd1d525427db69c4e20422d13fe6f4f20c07920f5f10e4
Jul 21 01:14:52.224744 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.224692    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:14:52.224858 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.224803    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:14:52.224858 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.224835    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:14:52.838037 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.837997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" event={"ID":"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9","Type":"ContainerStarted","Data":"252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704"}
Jul 21 01:14:52.838424 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.838058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" event={"ID":"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9","Type":"ContainerStarted","Data":"f95b71b965f539a082bd1d525427db69c4e20422d13fe6f4f20c07920f5f10e4"}
Jul 21 01:14:52.858530 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:52.858482    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podStartSLOduration=1.858467605 podStartE2EDuration="1.858467605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:14:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:14:52.857262367 +0000 UTC m=+2036.529652766" watchObservedRunningTime="2026-07-21 01:14:52.858467605 +0000 UTC m=+2036.530857968"
Jul 21 01:14:53.085844 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:53.085809    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:53.090677 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:53.090620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:53.842206 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:53.842168    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:53.843005 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:53.842989    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:14:54.776132 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:54.776099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:54.860016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:54.859977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:54.938702 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:54.938673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:55.159703 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:55.159670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:55.517160 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:55.517071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:55.616949 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:55.616914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:14:59.290420 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:14:59.290392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:15:00.132371 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.132335    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2"]
Jul 21 01:15:00.136706 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.136689    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"]
Jul 21 01:15:00.136840 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.136822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2"
Jul 21 01:15:00.139366 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.139340    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:15:00.140565 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.140543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"
Jul 21 01:15:00.141097 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.141071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"]
Jul 21 01:15:00.143437 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.143415    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2"]
Jul 21 01:15:00.149949 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.149927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2"
Jul 21 01:15:00.156140 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.156005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"
Jul 21 01:15:00.283258 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.283231    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2"]
Jul 21 01:15:00.286898 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:15:00.286850    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3a8128_3ca1_4fb7_beee_f045ca809ae2.slice/crio-386bd815269fa6753309139c8883fc8409557df7d264afd9342174cf2f07f4ea WatchSource:0}: Error finding container 386bd815269fa6753309139c8883fc8409557df7d264afd9342174cf2f07f4ea: Status 404 returned error can't find the container with id 386bd815269fa6753309139c8883fc8409557df7d264afd9342174cf2f07f4ea
Jul 21 01:15:00.304364 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.304339    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"]
Jul 21 01:15:00.308531 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:15:00.308479    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a75244_8cf8_4ce2_b904_ae7d81269963.slice/crio-083cdb25796d3f4552fb1befb8db1118121bfb3db1fc6ac6950c84381bd5ed90 WatchSource:0}: Error finding container 083cdb25796d3f4552fb1befb8db1118121bfb3db1fc6ac6950c84381bd5ed90: Status 404 returned error can't find the container with id 083cdb25796d3f4552fb1befb8db1118121bfb3db1fc6ac6950c84381bd5ed90
Jul 21 01:15:00.871441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.871406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72" event={"ID":"70a75244-8cf8-4ce2-b904-ae7d81269963","Type":"ContainerStarted","Data":"00d3a62d203bdeacb5bacd90dedb8bba607527252cc2e3dfe85c20b9131d9b73"}
Jul 21 01:15:00.871650 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.871461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72" event={"ID":"70a75244-8cf8-4ce2-b904-ae7d81269963","Type":"ContainerStarted","Data":"083cdb25796d3f4552fb1befb8db1118121bfb3db1fc6ac6950c84381bd5ed90"}
Jul 21 01:15:00.872770 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.872745    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2" event={"ID":"5e3a8128-3ca1-4fb7-beee-f045ca809ae2","Type":"ContainerStarted","Data":"e0a4f0c62d19651db82ec4ba89bf56cd2c001f6afc1d71c5b500fb3a73614145"}
Jul 21 01:15:00.872857 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.872813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2" event={"ID":"5e3a8128-3ca1-4fb7-beee-f045ca809ae2","Type":"ContainerStarted","Data":"386bd815269fa6753309139c8883fc8409557df7d264afd9342174cf2f07f4ea"}
Jul 21 01:15:00.903180 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.903134    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2" podStartSLOduration=0.903121591 podStartE2EDuration="903.121591ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:15:00.90205366 +0000 UTC m=+2044.574444025" watchObservedRunningTime="2026-07-21 01:15:00.903121591 +0000 UTC m=+2044.575511956"
Jul 21 01:15:00.903374 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:00.903355    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72" podStartSLOduration=0.903352277 podStartE2EDuration="903.352277ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:15:00.888535336 +0000 UTC m=+2044.560925701" watchObservedRunningTime="2026-07-21 01:15:00.903352277 +0000 UTC m=+2044.575742641"
Jul 21 01:15:01.879522 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:01.879472    2560 generic.go:356] "Generic (PLEG): container finished" podID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerID="00d3a62d203bdeacb5bacd90dedb8bba607527252cc2e3dfe85c20b9131d9b73" exitCode=7
Jul 21 01:15:01.880053 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:01.879580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72" event={"ID":"70a75244-8cf8-4ce2-b904-ae7d81269963","Type":"ContainerDied","Data":"00d3a62d203bdeacb5bacd90dedb8bba607527252cc2e3dfe85c20b9131d9b73"}
Jul 21 01:15:01.880053 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:01.879750    2560 scope.go:117] "RemoveContainer" containerID="00d3a62d203bdeacb5bacd90dedb8bba607527252cc2e3dfe85c20b9131d9b73"
Jul 21 01:15:01.881161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:01.881141    2560 generic.go:356] "Generic (PLEG): container finished" podID="5e3a8128-3ca1-4fb7-beee-f045ca809ae2" containerID="e0a4f0c62d19651db82ec4ba89bf56cd2c001f6afc1d71c5b500fb3a73614145" exitCode=0
Jul 21 01:15:01.881269 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:01.881173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2" event={"ID":"5e3a8128-3ca1-4fb7-beee-f045ca809ae2","Type":"ContainerDied","Data":"e0a4f0c62d19651db82ec4ba89bf56cd2c001f6afc1d71c5b500fb3a73614145"}
Jul 21 01:15:02.886763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:02.886725    2560 generic.go:356] "Generic (PLEG): container finished" podID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerID="1ae71c5f462089841119f30c0800109a837f0bf9d571a7aacb61c99e004d9f57" exitCode=0
Jul 21 01:15:02.887183 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:02.886809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72" event={"ID":"70a75244-8cf8-4ce2-b904-ae7d81269963","Type":"ContainerDied","Data":"1ae71c5f462089841119f30c0800109a837f0bf9d571a7aacb61c99e004d9f57"}
Jul 21 01:15:02.887183 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:02.886863    2560 scope.go:117] "RemoveContainer" containerID="00d3a62d203bdeacb5bacd90dedb8bba607527252cc2e3dfe85c20b9131d9b73"
Jul 21 01:15:03.059142 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:03.059114    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2"
Jul 21 01:15:03.895017 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:03.894995    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2"
Jul 21 01:15:03.895326 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:03.895030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743275-2bqv2" event={"ID":"5e3a8128-3ca1-4fb7-beee-f045ca809ae2","Type":"ContainerDied","Data":"386bd815269fa6753309139c8883fc8409557df7d264afd9342174cf2f07f4ea"}
Jul 21 01:15:03.895326 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:03.895091    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="386bd815269fa6753309139c8883fc8409557df7d264afd9342174cf2f07f4ea"
Jul 21 01:15:04.064982 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:04.064959    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"
Jul 21 01:15:04.899808 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:04.899762    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"
Jul 21 01:15:04.900197 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:04.899804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72" event={"ID":"70a75244-8cf8-4ce2-b904-ae7d81269963","Type":"ContainerDied","Data":"083cdb25796d3f4552fb1befb8db1118121bfb3db1fc6ac6950c84381bd5ed90"}
Jul 21 01:15:04.900197 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:04.899845    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="083cdb25796d3f4552fb1befb8db1118121bfb3db1fc6ac6950c84381bd5ed90"
Jul 21 01:15:07.727613 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:07.727575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:15:08.329872 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:08.329840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:15:09.262036 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.262006    2560 patch_prober.go:28] interesting pod/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:60736->10.133.0.32:15021: read: connection reset by peer" start-of-body=
Jul 21 01:15:09.262605 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.262066    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:60736->10.133.0.32:15021: read: connection reset by peer"
Jul 21 01:15:09.929610 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.929577    2560 generic.go:356] "Generic (PLEG): container finished" podID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerID="252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704" exitCode=0
Jul 21 01:15:09.929610 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.929612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" event={"ID":"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9","Type":"ContainerDied","Data":"252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704"}
Jul 21 01:15:09.929977 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.929963    2560 scope.go:117] "RemoveContainer" containerID="252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704"
Jul 21 01:15:09.930866 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.930837    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:15:09.930929 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.930907    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:15:09.930967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:09.930936    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:15:10.938489 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:10.938445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" event={"ID":"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9","Type":"ContainerStarted","Data":"f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4"}
Jul 21 01:15:11.086798 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:11.086744    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:15:11.087031 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:11.087009    2560 patch_prober.go:28] interesting pod/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 01:15:11.087079 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:11.087058    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 01:15:12.085951 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:12.085915    2560 patch_prober.go:28] interesting pod/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 01:15:12.086420 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:12.085978    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 01:15:13.086298 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:13.086259    2560 patch_prober.go:28] interesting pod/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 01:15:13.086677 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:13.086310    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 01:15:14.086635 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:14.086597    2560 patch_prober.go:28] interesting pod/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 01:15:14.087122 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:14.086656    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 01:15:15.089357 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:15.089328    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:15:15.089753 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:15.089589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:15:15.090262 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:15.090243    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:15:32.772449 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772375    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"]
Jul 21 01:15:32.772900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772677    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3a8128-3ca1-4fb7-beee-f045ca809ae2" containerName="cleanup"
Jul 21 01:15:32.772900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772688    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3a8128-3ca1-4fb7-beee-f045ca809ae2" containerName="cleanup"
Jul 21 01:15:32.772900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772696    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerName="cleanup"
Jul 21 01:15:32.772900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772704    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerName="cleanup"
Jul 21 01:15:32.772900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772791    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3a8128-3ca1-4fb7-beee-f045ca809ae2" containerName="cleanup"
Jul 21 01:15:32.772900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772801    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerName="cleanup"
Jul 21 01:15:32.772900 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.772808    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerName="cleanup"
Jul 21 01:15:32.775711 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.775694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"
Jul 21 01:15:32.777895 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.777874    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:15:32.778010 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.777896    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:15:32.784944 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.784918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"]
Jul 21 01:15:32.796904 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.796881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc83f998-9f16-47c4-a094-b0b43e4db18b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj\" (UID: \"cc83f998-9f16-47c4-a094-b0b43e4db18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"
Jul 21 01:15:32.897347 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.897318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc83f998-9f16-47c4-a094-b0b43e4db18b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj\" (UID: \"cc83f998-9f16-47c4-a094-b0b43e4db18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"
Jul 21 01:15:32.897928 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:32.897909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc83f998-9f16-47c4-a094-b0b43e4db18b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj\" (UID: \"cc83f998-9f16-47c4-a094-b0b43e4db18b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"
Jul 21 01:15:33.086751 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:33.086725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"
Jul 21 01:15:33.212061 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:33.212028    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"]
Jul 21 01:15:33.214859 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:15:33.214831    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc83f998_9f16_47c4_a094_b0b43e4db18b.slice/crio-dbff2b7c8d93ca0d58f7f17472c049f1195cc0194b2ebba279ac0a53ff966bb1 WatchSource:0}: Error finding container dbff2b7c8d93ca0d58f7f17472c049f1195cc0194b2ebba279ac0a53ff966bb1: Status 404 returned error can't find the container with id dbff2b7c8d93ca0d58f7f17472c049f1195cc0194b2ebba279ac0a53ff966bb1
Jul 21 01:15:34.040543 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:34.040511    2560 generic.go:356] "Generic (PLEG): container finished" podID="cc83f998-9f16-47c4-a094-b0b43e4db18b" containerID="5de41ab1b446cec532b5edb99aded4094babdd7eb4f13cc8596605c8d7f08e5d" exitCode=0
Jul 21 01:15:34.040888 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:34.040600    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj" event={"ID":"cc83f998-9f16-47c4-a094-b0b43e4db18b","Type":"ContainerDied","Data":"5de41ab1b446cec532b5edb99aded4094babdd7eb4f13cc8596605c8d7f08e5d"}
Jul 21 01:15:34.040888 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:34.040664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj" event={"ID":"cc83f998-9f16-47c4-a094-b0b43e4db18b","Type":"ContainerStarted","Data":"dbff2b7c8d93ca0d58f7f17472c049f1195cc0194b2ebba279ac0a53ff966bb1"}
Jul 21 01:15:35.170230 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:35.170204    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"
Jul 21 01:15:35.214069 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:35.214040    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc83f998-9f16-47c4-a094-b0b43e4db18b-maas-api-service-ca\") pod \"cc83f998-9f16-47c4-a094-b0b43e4db18b\" (UID: \"cc83f998-9f16-47c4-a094-b0b43e4db18b\") "
Jul 21 01:15:35.214365 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:35.214342    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc83f998-9f16-47c4-a094-b0b43e4db18b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc83f998-9f16-47c4-a094-b0b43e4db18b" (UID: "cc83f998-9f16-47c4-a094-b0b43e4db18b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:15:35.315081 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:35.315060    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc83f998-9f16-47c4-a094-b0b43e4db18b-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:15:36.049932 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:36.049899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj" event={"ID":"cc83f998-9f16-47c4-a094-b0b43e4db18b","Type":"ContainerDied","Data":"dbff2b7c8d93ca0d58f7f17472c049f1195cc0194b2ebba279ac0a53ff966bb1"}
Jul 21 01:15:36.049932 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:36.049921    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"
Jul 21 01:15:36.050128 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:36.049945    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbff2b7c8d93ca0d58f7f17472c049f1195cc0194b2ebba279ac0a53ff966bb1"
Jul 21 01:15:45.359831 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:45.359795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:15:48.341267 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:48.341233    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"]
Jul 21 01:15:48.344748 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:48.344712    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-6eed7610-29743275-csn72"]
Jul 21 01:15:48.351393 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:48.351371    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:15:48.853689 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:48.853658    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70a75244-8cf8-4ce2-b904-ae7d81269963" path="/var/lib/kubelet/pods/70a75244-8cf8-4ce2-b904-ae7d81269963/volumes"
Jul 21 01:15:52.870551 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:52.870518    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"]
Jul 21 01:15:52.873434 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:52.873409    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6eed7610-cb9tj"]
Jul 21 01:15:52.873625 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:52.873609    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:15:54.853719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:54.853687    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc83f998-9f16-47c4-a094-b0b43e4db18b" path="/var/lib/kubelet/pods/cc83f998-9f16-47c4-a094-b0b43e4db18b/volumes"
Jul 21 01:15:55.079675 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:15:55.079639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:00.147836 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:00.147765    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:21.786449 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:21.786411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:21.853937 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:21.853904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:36.321897 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:36.321860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:37.746318 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:37.746287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:43.453170 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:43.453119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:43.521247 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:43.521206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:43.750472 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:43.750383    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"]
Jul 21 01:16:43.750696 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:43.750672    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy" containerID="cri-o://f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4" gracePeriod=30
Jul 21 01:16:43.783916 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:43.783880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:44.023581 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:44.023501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:45.091837 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:45.091796    2560 patch_prober.go:28] interesting pod/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 01:16:45.092222 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:45.091899    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 01:16:45.176104 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:45.176048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:45.264663 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:45.264623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:45.364842 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:45.364735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:46.186167 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:46.186136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:46.300763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:46.300732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:47.784356 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:47.784324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:48.989631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:48.989606    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:16:49.125316 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125283    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sr9b\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-kube-api-access-8sr9b\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125352    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istiod-ca-cert\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125374    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-data\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125407    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-envoy\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125430    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-podinfo\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125455    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-certs\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-socket\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125858 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125511    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-token\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125858 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125538    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-credential-socket\") pod \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\" (UID: \"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9\") "
Jul 21 01:16:49.125858 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125767    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:49.125858 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:49.126083 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.125961    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:49.126246 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.126218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:16:49.126392 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.126372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:49.127689 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.127656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:16:49.127890 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.127735    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:16:49.127965 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.127943    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-kube-api-access-8sr9b" (OuterVolumeSpecName: "kube-api-access-8sr9b") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "kube-api-access-8sr9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:16:49.128050 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.128031    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" (UID: "956e4a44-2f7f-48c5-94ff-fbbb4102e2d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:16:49.226664 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226621    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226664 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226656    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226664 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226665    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226664 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226673    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226681    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226689    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226697    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226705    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.226967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.226714    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sr9b\" (UniqueName: \"kubernetes.io/projected/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9-kube-api-access-8sr9b\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:16:49.367613 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.367580    2560 generic.go:356] "Generic (PLEG): container finished" podID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerID="f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4" exitCode=0
Jul 21 01:16:49.367799 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.367628    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"
Jul 21 01:16:49.367799 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.367667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" event={"ID":"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9","Type":"ContainerDied","Data":"f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4"}
Jul 21 01:16:49.367799 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.367720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn" event={"ID":"956e4a44-2f7f-48c5-94ff-fbbb4102e2d9","Type":"ContainerDied","Data":"f95b71b965f539a082bd1d525427db69c4e20422d13fe6f4f20c07920f5f10e4"}
Jul 21 01:16:49.367799 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.367743    2560 scope.go:117] "RemoveContainer" containerID="f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4"
Jul 21 01:16:49.377074 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.377054    2560 scope.go:117] "RemoveContainer" containerID="252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704"
Jul 21 01:16:49.384645 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.384626    2560 scope.go:117] "RemoveContainer" containerID="f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4"
Jul 21 01:16:49.384932 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:16:49.384914    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4\": container with ID starting with f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4 not found: ID does not exist" containerID="f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4"
Jul 21 01:16:49.384986 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.384941    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4"} err="failed to get container status \"f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4\": rpc error: code = NotFound desc = could not find container \"f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4\": container with ID starting with f3d97425a722e738f81199ee7d9f63d160ff033fdf285c227769cb95e4cb9af4 not found: ID does not exist"
Jul 21 01:16:49.384986 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.384960    2560 scope.go:117] "RemoveContainer" containerID="252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704"
Jul 21 01:16:49.385240 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:16:49.385217    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704\": container with ID starting with 252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704 not found: ID does not exist" containerID="252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704"
Jul 21 01:16:49.385287 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.385245    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704"} err="failed to get container status \"252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704\": rpc error: code = NotFound desc = could not find container \"252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704\": container with ID starting with 252376263cfc6562dff40e317ca1f569c152ca88118a222675b7026d1cb42704 not found: ID does not exist"
Jul 21 01:16:49.388461 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.388440    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"]
Jul 21 01:16:49.395334 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:49.395311    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6eed7610-openshift-default-74cc44cb5f-fbvnn"]
Jul 21 01:16:50.853004 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:50.852973    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" path="/var/lib/kubelet/pods/956e4a44-2f7f-48c5-94ff-fbbb4102e2d9/volumes"
Jul 21 01:16:53.805292 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:53.805259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:53.910040 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:53.910007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:54.511790 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:54.511738    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:16:56.916248 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:16:56.916218    2560 scope.go:117] "RemoveContainer" containerID="8a9887f1f1ca2d6ec4a04b9e35cb0115fc192cefb1fe2be7c421660899bf44ea"
Jul 21 01:17:01.023728 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:01.023691    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:01.133126 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:01.133091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:01.236297 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:01.236263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:11.794635 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:11.794596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:12.153364 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:12.153332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:33.207149 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:33.207114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:39.606759 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:39.606726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:39.706826 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:39.706791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:39.979639 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:39.979552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:40.315918 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.315880    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"]
Jul 21 01:17:40.316346 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316332    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc83f998-9f16-47c4-a094-b0b43e4db18b" containerName="revoke-keys"
Jul 21 01:17:40.316394 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316350    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc83f998-9f16-47c4-a094-b0b43e4db18b" containerName="revoke-keys"
Jul 21 01:17:40.316394 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316364    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy"
Jul 21 01:17:40.316394 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316373    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy"
Jul 21 01:17:40.316394 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316386    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy"
Jul 21 01:17:40.316513 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316394    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy"
Jul 21 01:17:40.316513 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316414    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerName="cleanup"
Jul 21 01:17:40.316513 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316423    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a75244-8cf8-4ce2-b904-ae7d81269963" containerName="cleanup"
Jul 21 01:17:40.316513 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316489    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc83f998-9f16-47c4-a094-b0b43e4db18b" containerName="revoke-keys"
Jul 21 01:17:40.316513 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316500    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy"
Jul 21 01:17:40.316513 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.316511    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="956e4a44-2f7f-48c5-94ff-fbbb4102e2d9" containerName="istio-proxy"
Jul 21 01:17:40.319497 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.319469    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.322990 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.322956    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2eeec3-openshift-default-dockercfg-jn9kx\""
Jul 21 01:17:40.340688 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.340647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"]
Jul 21 01:17:40.461597 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-envoy\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.461597 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-credential-socket\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.461834 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-istio-token\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.461834 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-socket\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.461834 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c04d81-900d-4502-8fb4-4305795d9330-istio-podinfo\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.461937 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-data\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.461937 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcb5p\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-kube-api-access-kcb5p\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.461937 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-certs\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.462031 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.461939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c04d81-900d-4502-8fb4-4305795d9330-istiod-ca-cert\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.478135 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.478102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:40.562609 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c04d81-900d-4502-8fb4-4305795d9330-istio-podinfo\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.562799 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-data\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.562799 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcb5p\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-kube-api-access-kcb5p\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.562921 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-certs\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.562921 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c04d81-900d-4502-8fb4-4305795d9330-istiod-ca-cert\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.562921 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-envoy\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563062 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-credential-socket\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563062 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.562975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-istio-token\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563062 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.563006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-socket\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563215 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.563162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-data\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563215 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.563191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-certs\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563381 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.563364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-socket\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563493 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.563463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-credential-socket\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.563606 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.563587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c04d81-900d-4502-8fb4-4305795d9330-istiod-ca-cert\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.565093 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.565072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-envoy\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.565277 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.565258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c04d81-900d-4502-8fb4-4305795d9330-istio-podinfo\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.579540 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.579459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcb5p\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-kube-api-access-kcb5p\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.579719 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.579701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-istio-token\") pod \"e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") " pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.629007 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.628963    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:40.692976 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.692939    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:40.777290 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.777157    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"]
Jul 21 01:17:40.779918 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:17:40.779888    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c04d81_900d_4502_8fb4_4305795d9330.slice/crio-c81c73dcf40a05e32437cd4da1fc5c94f19b65c7af591de7980484b85ac30ea3 WatchSource:0}: Error finding container c81c73dcf40a05e32437cd4da1fc5c94f19b65c7af591de7980484b85ac30ea3: Status 404 returned error can't find the container with id c81c73dcf40a05e32437cd4da1fc5c94f19b65c7af591de7980484b85ac30ea3
Jul 21 01:17:40.781926 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.781893    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:40.782025 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.781975    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:40.782087 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:40.782023    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:41.590219 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:41.590183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" event={"ID":"e8c04d81-900d-4502-8fb4-4305795d9330","Type":"ContainerStarted","Data":"8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a"}
Jul 21 01:17:41.590367 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:41.590240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" event={"ID":"e8c04d81-900d-4502-8fb4-4305795d9330","Type":"ContainerStarted","Data":"c81c73dcf40a05e32437cd4da1fc5c94f19b65c7af591de7980484b85ac30ea3"}
Jul 21 01:17:41.611639 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:41.611594    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" podStartSLOduration=1.611580559 podStartE2EDuration="1.611580559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:17:41.610178672 +0000 UTC m=+2205.282569037" watchObservedRunningTime="2026-07-21 01:17:41.611580559 +0000 UTC m=+2205.283970925"
Jul 21 01:17:41.629972 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:41.629932    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:41.635123 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:41.635095    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:42.595050 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:42.595011    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:42.596135 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:42.596113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:17:43.561253 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:43.561215    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:43.656182 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:43.656151    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:43.734838 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:43.734806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:44.132910 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:44.132875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:44.252435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:44.252402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:44.346929 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:44.346894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:48.083252 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.083218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:48.491686 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.491594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:48.777299 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.777223    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"]
Jul 21 01:17:48.780497 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.780479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.784134 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.784115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6bfe4a-openshift-default-dockercfg-gnfrd\""
Jul 21 01:17:48.796632 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.796611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"]
Jul 21 01:17:48.809361 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.809328    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:48.831932 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.831911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-token\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832058 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.831947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-certs\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832058 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.831980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-envoy\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832058 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.832038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcjq5\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-kube-api-access-gcjq5\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832230 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.832071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-socket\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832230 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.832114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a19fb23-a0b1-448c-9f26-8cb17242c456-istiod-ca-cert\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832230 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.832155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-credential-socket\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832230 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.832174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-podinfo\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.832230 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.832205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-data\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933103 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-socket\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933302 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a19fb23-a0b1-448c-9f26-8cb17242c456-istiod-ca-cert\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933302 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-credential-socket\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933302 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-podinfo\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-data\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-token\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-certs\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933622 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-envoy\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933622 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcjq5\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-kube-api-access-gcjq5\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933622 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-socket\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933812 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-credential-socket\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.933812 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a19fb23-a0b1-448c-9f26-8cb17242c456-istiod-ca-cert\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.934008 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.933978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-certs\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.934071 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.934053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-data\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.935701 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.935679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-envoy\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.935899 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.935882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-podinfo\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.942396 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.942355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcjq5\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-kube-api-access-gcjq5\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:48.942507 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:48.942468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-token\") pod \"e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") " pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:49.089448 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.089417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:49.091375 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.091359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:49.238358 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.238330    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"]
Jul 21 01:17:49.240948 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:17:49.240919    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a19fb23_a0b1_448c_9f26_8cb17242c456.slice/crio-2defe5db71afa85890651477f5d5bf5d9555f18349db9b25810956307b2d8b01 WatchSource:0}: Error finding container 2defe5db71afa85890651477f5d5bf5d9555f18349db9b25810956307b2d8b01: Status 404 returned error can't find the container with id 2defe5db71afa85890651477f5d5bf5d9555f18349db9b25810956307b2d8b01
Jul 21 01:17:49.243435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.243402    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:49.243529 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.243471    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:49.243529 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.243510    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:49.630574 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.630526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" event={"ID":"8a19fb23-a0b1-448c-9f26-8cb17242c456","Type":"ContainerStarted","Data":"0b26f3b62d924974d12194b902f7ee0b7325ea2945f1d0fde85394d6d4039f31"}
Jul 21 01:17:49.630734 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.630617    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" event={"ID":"8a19fb23-a0b1-448c-9f26-8cb17242c456","Type":"ContainerStarted","Data":"2defe5db71afa85890651477f5d5bf5d9555f18349db9b25810956307b2d8b01"}
Jul 21 01:17:49.656497 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:49.656434    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" podStartSLOduration=1.656414502 podStartE2EDuration="1.656414502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:17:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:17:49.655119639 +0000 UTC m=+2213.327510042" watchObservedRunningTime="2026-07-21 01:17:49.656414502 +0000 UTC m=+2213.328804869"
Jul 21 01:17:50.091670 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:50.091628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:50.096548 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:50.096521    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:50.634552 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:50.634525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:50.635437 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:50.635418    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:17:51.696881 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:51.696852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:51.820159 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:51.820116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:51.963726 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:51.963615    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:52.550929 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:52.550896    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:52.652646 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:52.652609    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:52.757127 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:52.757090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:56.202201 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:56.202170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:17:56.937061 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:56.937029    2560 scope.go:117] "RemoveContainer" containerID="33301c8e48557f0677d56302f3252b70cb447717948ad2f59db3c9dafda867ed"
Jul 21 01:17:56.945418 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:56.945390    2560 scope.go:117] "RemoveContainer" containerID="0caafb34182a82ebef90cc69fb1e0c399e8d015822e859e6e4a54af0fa2dc528"
Jul 21 01:17:58.636950 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:58.636908    2560 patch_prober.go:28] interesting pod/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 01:17:58.637339 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:58.637007    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 01:17:59.680406 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:59.680322    2560 generic.go:356] "Generic (PLEG): container finished" podID="e8c04d81-900d-4502-8fb4-4305795d9330" containerID="8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a" exitCode=0
Jul 21 01:17:59.680406 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:59.680383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" event={"ID":"e8c04d81-900d-4502-8fb4-4305795d9330","Type":"ContainerDied","Data":"8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a"}
Jul 21 01:17:59.680892 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:59.680733    2560 scope.go:117] "RemoveContainer" containerID="8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a"
Jul 21 01:17:59.681716 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:59.681686    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:59.681797 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:59.681756    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:17:59.681844 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:17:59.681801    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:18:00.686417 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:00.686386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" event={"ID":"e8c04d81-900d-4502-8fb4-4305795d9330","Type":"ContainerStarted","Data":"1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841"}
Jul 21 01:18:01.264788 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:01.264732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:18:01.630301 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:01.630257    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:18:01.630516 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:01.630411    2560 patch_prober.go:28] interesting pod/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 21 01:18:01.630516 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:01.630457    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 21 01:18:02.629447 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:02.629403    2560 patch_prober.go:28] interesting pod/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 21 01:18:02.630080 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:02.630045    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 21 01:18:03.630138 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:03.630101    2560 patch_prober.go:28] interesting pod/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 21 01:18:03.630672 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:03.630643    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 21 01:18:04.630042 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:04.629997    2560 patch_prober.go:28] interesting pod/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 21 01:18:04.630260 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:04.630072    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 21 01:18:05.124721 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:05.124682    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:18:05.231806 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:05.231754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:18:05.633961 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:05.633927    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:18:05.634449 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:05.634176    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:18:05.634849 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:05.634827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:18:06.389968 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.389706    2560 patch_prober.go:28] interesting pod/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:57616->10.133.0.37:15021: read: connection reset by peer" start-of-body=
Jul 21 01:18:06.389968 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.389788    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:57616->10.133.0.37:15021: read: connection reset by peer"
Jul 21 01:18:06.717374 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.717290    2560 generic.go:356] "Generic (PLEG): container finished" podID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerID="0b26f3b62d924974d12194b902f7ee0b7325ea2945f1d0fde85394d6d4039f31" exitCode=0
Jul 21 01:18:06.717726 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.717366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" event={"ID":"8a19fb23-a0b1-448c-9f26-8cb17242c456","Type":"ContainerDied","Data":"0b26f3b62d924974d12194b902f7ee0b7325ea2945f1d0fde85394d6d4039f31"}
Jul 21 01:18:06.717862 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.717847    2560 scope.go:117] "RemoveContainer" containerID="0b26f3b62d924974d12194b902f7ee0b7325ea2945f1d0fde85394d6d4039f31"
Jul 21 01:18:06.718786 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.718746    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:18:06.718837 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.718827    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:18:06.718877 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:06.718871    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:18:07.723036 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:07.723001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" event={"ID":"8a19fb23-a0b1-448c-9f26-8cb17242c456","Type":"ContainerStarted","Data":"dde6a30fac49a68c423400926563719bbbdebec4f63ab5c4306cb574f39dd683"}
Jul 21 01:18:08.091522 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:08.091467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:18:08.091830 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:08.091808    2560 patch_prober.go:28] interesting pod/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 21 01:18:08.091888 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:08.091854    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 21 01:18:09.092147 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:09.092107    2560 patch_prober.go:28] interesting pod/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 21 01:18:09.092563 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:09.092159    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 21 01:18:10.092713 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:10.092671    2560 patch_prober.go:28] interesting pod/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 21 01:18:10.093151 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:10.092732    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 21 01:18:11.092372 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:11.092335    2560 patch_prober.go:28] interesting pod/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 21 01:18:11.092560 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:11.092395    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 21 01:18:12.095445 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:12.095414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:18:12.095864 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:12.095784    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:18:12.096394 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:12.096380    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:18:13.566504 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:13.566453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:18:13.661843 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:13.661813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:18:33.993474 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:33.993399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:18:41.133675 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:41.133633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:18:56.969179 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:18:56.969148    2560 scope.go:117] "RemoveContainer" containerID="166b12be980d72b61f8d9628f0d9a5351bbedf76e9468b3286cd823b83686102"
Jul 21 01:19:11.519119 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:11.519082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:31.810183 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:31.810149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:32.853494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:32.853467    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"]
Jul 21 01:19:32.856354 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:32.856336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"
Jul 21 01:19:32.858581 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:32.858558    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:19:32.858956 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:32.858561    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:19:32.859277 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:32.859256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"]
Jul 21 01:19:32.871049 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:32.871010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:32.932368 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:32.932331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4715158f-006d-41b3-ac0d-00f7fc662de6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h\" (UID: \"4715158f-006d-41b3-ac0d-00f7fc662de6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"
Jul 21 01:19:33.032854 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:33.032803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4715158f-006d-41b3-ac0d-00f7fc662de6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h\" (UID: \"4715158f-006d-41b3-ac0d-00f7fc662de6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"
Jul 21 01:19:33.033392 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:33.033369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4715158f-006d-41b3-ac0d-00f7fc662de6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h\" (UID: \"4715158f-006d-41b3-ac0d-00f7fc662de6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"
Jul 21 01:19:33.167166 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:33.167087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"
Jul 21 01:19:33.291153 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:33.291125    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"]
Jul 21 01:19:33.293692 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:19:33.293667    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4715158f_006d_41b3_ac0d_00f7fc662de6.slice/crio-9ded1affbcb01be7d1bf2570b5d6943e22fb03a9e67774aff82c40e587c7cf84 WatchSource:0}: Error finding container 9ded1affbcb01be7d1bf2570b5d6943e22fb03a9e67774aff82c40e587c7cf84: Status 404 returned error can't find the container with id 9ded1affbcb01be7d1bf2570b5d6943e22fb03a9e67774aff82c40e587c7cf84
Jul 21 01:19:33.433345 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:33.433264    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:33.538034 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:33.538003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:34.094916 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:34.094881    2560 generic.go:356] "Generic (PLEG): container finished" podID="4715158f-006d-41b3-ac0d-00f7fc662de6" containerID="c00ecd517dc3c68e6b6ffabcd6e5452f35094fc43595e9942581da9254cdb009" exitCode=0
Jul 21 01:19:34.095291 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:34.094961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h" event={"ID":"4715158f-006d-41b3-ac0d-00f7fc662de6","Type":"ContainerDied","Data":"c00ecd517dc3c68e6b6ffabcd6e5452f35094fc43595e9942581da9254cdb009"}
Jul 21 01:19:34.095291 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:34.095013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h" event={"ID":"4715158f-006d-41b3-ac0d-00f7fc662de6","Type":"ContainerStarted","Data":"9ded1affbcb01be7d1bf2570b5d6943e22fb03a9e67774aff82c40e587c7cf84"}
Jul 21 01:19:35.224465 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:35.224430    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"
Jul 21 01:19:35.352915 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:35.352820    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4715158f-006d-41b3-ac0d-00f7fc662de6-maas-api-service-ca\") pod \"4715158f-006d-41b3-ac0d-00f7fc662de6\" (UID: \"4715158f-006d-41b3-ac0d-00f7fc662de6\") "
Jul 21 01:19:35.353175 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:35.353153    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4715158f-006d-41b3-ac0d-00f7fc662de6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4715158f-006d-41b3-ac0d-00f7fc662de6" (UID: "4715158f-006d-41b3-ac0d-00f7fc662de6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:19:35.453960 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:35.453923    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4715158f-006d-41b3-ac0d-00f7fc662de6-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:36.104595 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:36.104564    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"
Jul 21 01:19:36.104595 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:36.104571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h" event={"ID":"4715158f-006d-41b3-ac0d-00f7fc662de6","Type":"ContainerDied","Data":"9ded1affbcb01be7d1bf2570b5d6943e22fb03a9e67774aff82c40e587c7cf84"}
Jul 21 01:19:36.104849 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:36.104625    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ded1affbcb01be7d1bf2570b5d6943e22fb03a9e67774aff82c40e587c7cf84"
Jul 21 01:19:36.783715 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:36.783663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:39.866502 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:39.866453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:39.981676 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:39.981637    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:43.354969 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:43.354922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:43.452435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:43.452395    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:43.587925 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:43.587892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:47.914584 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:47.914545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:47.927562 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:47.927521    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"]
Jul 21 01:19:47.929423 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:47.929397    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2eeec3-m6d7h"]
Jul 21 01:19:48.331046 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:48.331019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:48.853931 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:48.853899    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4715158f-006d-41b3-ac0d-00f7fc662de6" path="/var/lib/kubelet/pods/4715158f-006d-41b3-ac0d-00f7fc662de6/volumes"
Jul 21 01:19:54.219473 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.219436    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:54.282112 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.282078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:54.468383 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.468345    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"]
Jul 21 01:19:54.468563 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.468540    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy" containerID="cri-o://1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841" gracePeriod=30
Jul 21 01:19:54.495805 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.495716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:54.719845 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.719813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:54.839635 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.839600    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"]
Jul 21 01:19:54.839953 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.839939    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4715158f-006d-41b3-ac0d-00f7fc662de6" containerName="revoke-keys"
Jul 21 01:19:54.840009 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.839957    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4715158f-006d-41b3-ac0d-00f7fc662de6" containerName="revoke-keys"
Jul 21 01:19:54.840045 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.840010    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4715158f-006d-41b3-ac0d-00f7fc662de6" containerName="revoke-keys"
Jul 21 01:19:54.843043 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.843028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"
Jul 21 01:19:54.845079 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.845056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:19:54.845271 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.845102    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:19:54.855275 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.855250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"]
Jul 21 01:19:54.920531 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:54.920498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67797d4-6837-4529-abe8-4ee8691b06c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8\" (UID: \"b67797d4-6837-4529-abe8-4ee8691b06c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"
Jul 21 01:19:55.021648 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:55.021611    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67797d4-6837-4529-abe8-4ee8691b06c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8\" (UID: \"b67797d4-6837-4529-abe8-4ee8691b06c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"
Jul 21 01:19:55.022250 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:55.022229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67797d4-6837-4529-abe8-4ee8691b06c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8\" (UID: \"b67797d4-6837-4529-abe8-4ee8691b06c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"
Jul 21 01:19:55.154968 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:55.154870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"
Jul 21 01:19:55.280793 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:55.280744    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"]
Jul 21 01:19:55.284531 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:19:55.284504    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67797d4_6837_4529_abe8_4ee8691b06c3.slice/crio-900b7041e377f6269079bd919c60c3993123a02e5a5c897333e672a6aed5d8bd WatchSource:0}: Error finding container 900b7041e377f6269079bd919c60c3993123a02e5a5c897333e672a6aed5d8bd: Status 404 returned error can't find the container with id 900b7041e377f6269079bd919c60c3993123a02e5a5c897333e672a6aed5d8bd
Jul 21 01:19:55.384141 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:55.384106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:55.484146 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:55.484104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:19:56.190885 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:56.190797    2560 generic.go:356] "Generic (PLEG): container finished" podID="b67797d4-6837-4529-abe8-4ee8691b06c3" containerID="ac00274b15f419e7167252bffa5834cdf4a226385997ee19b4bb297d715c45fc" exitCode=0
Jul 21 01:19:56.190885 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:56.190828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8" event={"ID":"b67797d4-6837-4529-abe8-4ee8691b06c3","Type":"ContainerDied","Data":"ac00274b15f419e7167252bffa5834cdf4a226385997ee19b4bb297d715c45fc"}
Jul 21 01:19:56.191078 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:56.190885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8" event={"ID":"b67797d4-6837-4529-abe8-4ee8691b06c3","Type":"ContainerStarted","Data":"900b7041e377f6269079bd919c60c3993123a02e5a5c897333e672a6aed5d8bd"}
Jul 21 01:19:57.323991 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:57.323962    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"
Jul 21 01:19:57.339318 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:57.339293    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67797d4-6837-4529-abe8-4ee8691b06c3-maas-api-service-ca\") pod \"b67797d4-6837-4529-abe8-4ee8691b06c3\" (UID: \"b67797d4-6837-4529-abe8-4ee8691b06c3\") "
Jul 21 01:19:57.340092 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:57.339703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b67797d4-6837-4529-abe8-4ee8691b06c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b67797d4-6837-4529-abe8-4ee8691b06c3" (UID: "b67797d4-6837-4529-abe8-4ee8691b06c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:19:57.439953 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:57.439901    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b67797d4-6837-4529-abe8-4ee8691b06c3-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:58.201208 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:58.201175    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"
Jul 21 01:19:58.201377 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:58.201215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8" event={"ID":"b67797d4-6837-4529-abe8-4ee8691b06c3","Type":"ContainerDied","Data":"900b7041e377f6269079bd919c60c3993123a02e5a5c897333e672a6aed5d8bd"}
Jul 21 01:19:58.201377 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:58.201262    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="900b7041e377f6269079bd919c60c3993123a02e5a5c897333e672a6aed5d8bd"
Jul 21 01:19:59.735731 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.735671    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:19:59.757036 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-socket\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757162 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757058    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-envoy\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757162 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c04d81-900d-4502-8fb4-4305795d9330-istiod-ca-cert\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757162 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c04d81-900d-4502-8fb4-4305795d9330-istio-podinfo\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757162 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757145    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-credential-socket\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757375 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757165    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcb5p\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-kube-api-access-kcb5p\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757375 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757228    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-istio-token\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757375 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757253    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-data\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757375 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757273    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-certs\") pod \"e8c04d81-900d-4502-8fb4-4305795d9330\" (UID: \"e8c04d81-900d-4502-8fb4-4305795d9330\") "
Jul 21 01:19:59.757375 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757272    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:59.757655 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757609    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.757960 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.757883    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:59.758358 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.758278    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:59.758702 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.758644    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:59.759244 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.759155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8c04d81-900d-4502-8fb4-4305795d9330-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:19:59.759960 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.759926    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8c04d81-900d-4502-8fb4-4305795d9330-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:19:59.760084 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.760028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:19:59.760197 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.760170    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-kube-api-access-kcb5p" (OuterVolumeSpecName: "kube-api-access-kcb5p") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "kube-api-access-kcb5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:19:59.760841 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.760807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8c04d81-900d-4502-8fb4-4305795d9330" (UID: "e8c04d81-900d-4502-8fb4-4305795d9330"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:19:59.858507 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858466    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.858507 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858502    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c04d81-900d-4502-8fb4-4305795d9330-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.858507 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858516    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c04d81-900d-4502-8fb4-4305795d9330-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.858855 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858531    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.858855 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858543    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcb5p\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-kube-api-access-kcb5p\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.858855 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858557    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c04d81-900d-4502-8fb4-4305795d9330-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.858855 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858570    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:19:59.858855 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:19:59.858583    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c04d81-900d-4502-8fb4-4305795d9330-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:00.211397 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.211366    2560 generic.go:356] "Generic (PLEG): container finished" podID="e8c04d81-900d-4502-8fb4-4305795d9330" containerID="1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841" exitCode=0
Jul 21 01:20:00.211580 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.211412    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"
Jul 21 01:20:00.211580 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.211454    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" event={"ID":"e8c04d81-900d-4502-8fb4-4305795d9330","Type":"ContainerDied","Data":"1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841"}
Jul 21 01:20:00.211580 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.211522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq" event={"ID":"e8c04d81-900d-4502-8fb4-4305795d9330","Type":"ContainerDied","Data":"c81c73dcf40a05e32437cd4da1fc5c94f19b65c7af591de7980484b85ac30ea3"}
Jul 21 01:20:00.211580 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.211553    2560 scope.go:117] "RemoveContainer" containerID="1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841"
Jul 21 01:20:00.220557 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.220535    2560 scope.go:117] "RemoveContainer" containerID="8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a"
Jul 21 01:20:00.227985 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.227967    2560 scope.go:117] "RemoveContainer" containerID="1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841"
Jul 21 01:20:00.228236 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:20:00.228217    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841\": container with ID starting with 1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841 not found: ID does not exist" containerID="1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841"
Jul 21 01:20:00.228288 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.228244    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841"} err="failed to get container status \"1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841\": rpc error: code = NotFound desc = could not find container \"1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841\": container with ID starting with 1e7bb15aa04fa1c857c5e2920a3bc746cd0bf17dae73e6664de70a6383b84841 not found: ID does not exist"
Jul 21 01:20:00.228288 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.228262    2560 scope.go:117] "RemoveContainer" containerID="8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a"
Jul 21 01:20:00.228497 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:20:00.228479    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a\": container with ID starting with 8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a not found: ID does not exist" containerID="8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a"
Jul 21 01:20:00.228537 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.228503    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a"} err="failed to get container status \"8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a\": rpc error: code = NotFound desc = could not find container \"8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a\": container with ID starting with 8c3adae8670e2e545a9bdbf635513472e3f928edfaa660dd731a6c390312590a not found: ID does not exist"
Jul 21 01:20:00.231889 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.231868    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"]
Jul 21 01:20:00.235769 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.235748    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2eeec3-openshift-default-7b977b99f9-llbzq"]
Jul 21 01:20:00.853516 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:00.853481    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" path="/var/lib/kubelet/pods/e8c04d81-900d-4502-8fb4-4305795d9330/volumes"
Jul 21 01:20:05.222755 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:05.222721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:09.898688 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:09.898647    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"]
Jul 21 01:20:09.903786 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:09.903750    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bfe4a-tn6c8"]
Jul 21 01:20:09.904423 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:09.904402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:10.287682 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:10.287599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:10.853117 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:10.853081    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b67797d4-6837-4529-abe8-4ee8691b06c3" path="/var/lib/kubelet/pods/b67797d4-6837-4529-abe8-4ee8691b06c3/volumes"
Jul 21 01:20:15.935304 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:15.935265    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:16.036227 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:16.036184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:16.192229 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:16.192153    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"]
Jul 21 01:20:16.192454 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:16.192429    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy" containerID="cri-o://dde6a30fac49a68c423400926563719bbbdebec4f63ab5c4306cb574f39dd683" gracePeriod=30
Jul 21 01:20:16.214872 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:16.214844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:16.468266 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:16.468184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:16.827137 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:16.827110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:17.143893 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.143816    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"]
Jul 21 01:20:17.144328 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144265    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b67797d4-6837-4529-abe8-4ee8691b06c3" containerName="revoke-keys"
Jul 21 01:20:17.144328 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144281    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b67797d4-6837-4529-abe8-4ee8691b06c3" containerName="revoke-keys"
Jul 21 01:20:17.144328 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144298    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy"
Jul 21 01:20:17.144328 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144308    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy"
Jul 21 01:20:17.144539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144335    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy"
Jul 21 01:20:17.144539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144345    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy"
Jul 21 01:20:17.144539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144411    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b67797d4-6837-4529-abe8-4ee8691b06c3" containerName="revoke-keys"
Jul 21 01:20:17.144539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144423    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy"
Jul 21 01:20:17.144539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.144433    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c04d81-900d-4502-8fb4-4305795d9330" containerName="istio-proxy"
Jul 21 01:20:17.147769 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.147749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.149925 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.149906    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1ec8c6-openshift-default-dockercfg-dl8fc\""
Jul 21 01:20:17.158174 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.158149    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"]
Jul 21 01:20:17.171149 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.171107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:17.214063 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-certs\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-credential-socket\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7256389d-33e3-4c49-9f02-50247001ff0e-istiod-ca-cert\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-socket\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214225 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-envoy\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214506 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stpcz\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-kube-api-access-stpcz\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214506 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7256389d-33e3-4c49-9f02-50247001ff0e-istio-podinfo\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214506 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-istio-token\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.214506 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.214372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-data\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.314814 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.314758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7256389d-33e3-4c49-9f02-50247001ff0e-istiod-ca-cert\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315021 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.314824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-socket\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315021 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.314849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-envoy\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315021 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.314866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stpcz\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-kube-api-access-stpcz\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315021 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.314884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7256389d-33e3-4c49-9f02-50247001ff0e-istio-podinfo\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315236 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-istio-token\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315236 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-data\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315236 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-certs\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315236 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-credential-socket\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315449 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-socket\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315449 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-data\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315566 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-credential-socket\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315622 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-certs\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.315622 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.315577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7256389d-33e3-4c49-9f02-50247001ff0e-istiod-ca-cert\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.317183 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.317162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-envoy\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.317480 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.317461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7256389d-33e3-4c49-9f02-50247001ff0e-istio-podinfo\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.322362 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.322342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-istio-token\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.322525 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.322508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stpcz\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-kube-api-access-stpcz\") pod \"e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") " pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.448530 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.448450    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:17.458517 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.458488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:17.592042 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.592002    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"]
Jul 21 01:20:17.594950 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:20:17.594917    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7256389d_33e3_4c49_9f02_50247001ff0e.slice/crio-64c859241421e9beffecf6ce388b25a6283e66db09f0c6ee8b3d7b3048d00bb9 WatchSource:0}: Error finding container 64c859241421e9beffecf6ce388b25a6283e66db09f0c6ee8b3d7b3048d00bb9: Status 404 returned error can't find the container with id 64c859241421e9beffecf6ce388b25a6283e66db09f0c6ee8b3d7b3048d00bb9
Jul 21 01:20:17.597117 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.597082    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:17.597202 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.597148    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:17.597202 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:17.597177    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:18.290849 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:18.290814    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" event={"ID":"7256389d-33e3-4c49-9f02-50247001ff0e","Type":"ContainerStarted","Data":"e32785a01f3cf86f2e4e77756fc8e619b91b07751701dc00f44256f769b128ff"}
Jul 21 01:20:18.291260 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:18.290867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" event={"ID":"7256389d-33e3-4c49-9f02-50247001ff0e","Type":"ContainerStarted","Data":"64c859241421e9beffecf6ce388b25a6283e66db09f0c6ee8b3d7b3048d00bb9"}
Jul 21 01:20:18.310328 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:18.310278    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podStartSLOduration=1.310262905 podStartE2EDuration="1.310262905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:20:18.308590126 +0000 UTC m=+2361.980980492" watchObservedRunningTime="2026-07-21 01:20:18.310262905 +0000 UTC m=+2361.982653270"
Jul 21 01:20:18.458808 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:18.458759    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:18.463560 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:18.463532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:19.301058 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:19.301025    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:19.301933 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:19.301910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:20.286249 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:20.286217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:20.439441 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:20.439408    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:20.547923 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:20.547840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:21.018811 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.018759    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:21.118664 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.118626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:21.226536 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:20:21.226501    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a19fb23_a0b1_448c_9f26_8cb17242c456.slice/crio-dde6a30fac49a68c423400926563719bbbdebec4f63ab5c4306cb574f39dd683.scope\": RecentStats: unable to find data in memory cache]"
Jul 21 01:20:21.312097 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.312066    2560 generic.go:356] "Generic (PLEG): container finished" podID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerID="dde6a30fac49a68c423400926563719bbbdebec4f63ab5c4306cb574f39dd683" exitCode=0
Jul 21 01:20:21.312257 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.312135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" event={"ID":"8a19fb23-a0b1-448c-9f26-8cb17242c456","Type":"ContainerDied","Data":"dde6a30fac49a68c423400926563719bbbdebec4f63ab5c4306cb574f39dd683"}
Jul 21 01:20:21.312257 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.312191    2560 scope.go:117] "RemoveContainer" containerID="0b26f3b62d924974d12194b902f7ee0b7325ea2945f1d0fde85394d6d4039f31"
Jul 21 01:20:21.442085 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.442055    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:20:21.555796 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.555677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a19fb23-a0b1-448c-9f26-8cb17242c456-istiod-ca-cert\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.555796 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.555759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-socket\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.555833    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcjq5\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-kube-api-access-gcjq5\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.555863    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-data\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.555917    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-envoy\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.555942    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-credential-socket\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.555969    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-podinfo\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556041 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556012    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-certs\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556359 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-token\") pod \"8a19fb23-a0b1-448c-9f26-8cb17242c456\" (UID: \"8a19fb23-a0b1-448c-9f26-8cb17242c456\") "
Jul 21 01:20:21.556359 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556107    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:20:21.556359 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556224    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a19fb23-a0b1-448c-9f26-8cb17242c456-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:20:21.556359 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556345    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a19fb23-a0b1-448c-9f26-8cb17242c456-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.556539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556398    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.556539 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556426    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:20:21.556612 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556559    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:20:21.556648 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.556620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:20:21.558312 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.558284    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-kube-api-access-gcjq5" (OuterVolumeSpecName: "kube-api-access-gcjq5") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "kube-api-access-gcjq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:20:21.558541 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.558515    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:20:21.558635 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.558578    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:20:21.558635 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.558579    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a19fb23-a0b1-448c-9f26-8cb17242c456" (UID: "8a19fb23-a0b1-448c-9f26-8cb17242c456"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:20:21.657263 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.657216    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.657263 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.657254    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcjq5\" (UniqueName: \"kubernetes.io/projected/8a19fb23-a0b1-448c-9f26-8cb17242c456-kube-api-access-gcjq5\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.657263 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.657265    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.657263 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.657274    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.657538 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.657282    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.657538 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.657291    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a19fb23-a0b1-448c-9f26-8cb17242c456-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:21.657538 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:21.657299    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a19fb23-a0b1-448c-9f26-8cb17242c456-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:22.318424 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:22.318378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns" event={"ID":"8a19fb23-a0b1-448c-9f26-8cb17242c456","Type":"ContainerDied","Data":"2defe5db71afa85890651477f5d5bf5d9555f18349db9b25810956307b2d8b01"}
Jul 21 01:20:22.318626 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:22.318443    2560 scope.go:117] "RemoveContainer" containerID="dde6a30fac49a68c423400926563719bbbdebec4f63ab5c4306cb574f39dd683"
Jul 21 01:20:22.318626 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:22.318401    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"
Jul 21 01:20:22.338702 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:22.338675    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"]
Jul 21 01:20:22.342417 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:22.342397    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6bfe4a-openshift-default-59458cff5-dqlns"]
Jul 21 01:20:22.853036 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:22.852999    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" path="/var/lib/kubelet/pods/8a19fb23-a0b1-448c-9f26-8cb17242c456/volumes"
Jul 21 01:20:24.798793 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:24.798754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:25.240667 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.240623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:25.508124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.508040    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"]
Jul 21 01:20:25.508372 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.508359    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy"
Jul 21 01:20:25.508416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.508374    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy"
Jul 21 01:20:25.508416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.508383    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy"
Jul 21 01:20:25.508416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.508388    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy"
Jul 21 01:20:25.508508 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.508451    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy"
Jul 21 01:20:25.508508 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.508461    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a19fb23-a0b1-448c-9f26-8cb17242c456" containerName="istio-proxy"
Jul 21 01:20:25.512796 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.512761    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.515202 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.515181    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-92d4e9-openshift-default-dockercfg-w5ckx\""
Jul 21 01:20:25.525117 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.525095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"]
Jul 21 01:20:25.539629 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.539598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:25.588516 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-data\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588701 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpmcb\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-kube-api-access-xpmcb\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588701 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-credential-socket\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588701 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-podinfo\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588701 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-envoy\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588885 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8186-0ace-4253-aa24-da2d80d5f04d-istiod-ca-cert\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588885 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-token\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588885 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-socket\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.588885 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.588838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-certs\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpmcb\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-kube-api-access-xpmcb\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-credential-socket\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-podinfo\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-envoy\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8186-0ace-4253-aa24-da2d80d5f04d-istiod-ca-cert\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-token\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-socket\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-certs\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690470 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-data\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690837 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-credential-socket\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690837 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-data\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690837 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-socket\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.690837 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.690711    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-certs\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.691165 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.691141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8186-0ace-4253-aa24-da2d80d5f04d-istiod-ca-cert\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.692526 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.692505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-envoy\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.693012 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.692993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-podinfo\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.698139 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.698113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpmcb\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-kube-api-access-xpmcb\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.698261 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.698188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-token\") pod \"e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") " pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.751286 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.751249    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:25.823237 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.823206    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:25.962818 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.962763    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"]
Jul 21 01:20:25.965362 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:20:25.965335    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ea8186_0ace_4253_aa24_da2d80d5f04d.slice/crio-fa083e42bc19d72478293a1a45040b6a23099fc22e9526045567c54caa83560c WatchSource:0}: Error finding container fa083e42bc19d72478293a1a45040b6a23099fc22e9526045567c54caa83560c: Status 404 returned error can't find the container with id fa083e42bc19d72478293a1a45040b6a23099fc22e9526045567c54caa83560c
Jul 21 01:20:25.968165 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.968091    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:25.968284 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.968217    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:25.968284 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:25.968258    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:26.341711 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:26.341676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" event={"ID":"05ea8186-0ace-4253-aa24-da2d80d5f04d","Type":"ContainerStarted","Data":"e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428"}
Jul 21 01:20:26.341904 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:26.341736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" event={"ID":"05ea8186-0ace-4253-aa24-da2d80d5f04d","Type":"ContainerStarted","Data":"fa083e42bc19d72478293a1a45040b6a23099fc22e9526045567c54caa83560c"}
Jul 21 01:20:26.362642 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:26.362591    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podStartSLOduration=1.36257414 podStartE2EDuration="1.36257414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:20:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:20:26.360887654 +0000 UTC m=+2370.033278020" watchObservedRunningTime="2026-07-21 01:20:26.36257414 +0000 UTC m=+2370.034964505"
Jul 21 01:20:26.824306 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:26.824264    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:27.828897 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:27.828865    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:28.264941 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:28.264813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:28.350597 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:28.350569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:28.351596 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:28.351575    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:28.403284 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:28.403245    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:28.529883 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:28.529765    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:28.668574 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:28.668523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:29.185763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:29.185727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:29.286723 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:29.286690    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:32.767391 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:32.767356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:35.342991 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:35.342941    2560 patch_prober.go:28] interesting pod/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 01:20:35.343476 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:35.343015    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 01:20:37.398625 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:37.398587    2560 generic.go:356] "Generic (PLEG): container finished" podID="7256389d-33e3-4c49-9f02-50247001ff0e" containerID="e32785a01f3cf86f2e4e77756fc8e619b91b07751701dc00f44256f769b128ff" exitCode=0
Jul 21 01:20:37.399072 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:37.398669    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" event={"ID":"7256389d-33e3-4c49-9f02-50247001ff0e","Type":"ContainerDied","Data":"e32785a01f3cf86f2e4e77756fc8e619b91b07751701dc00f44256f769b128ff"}
Jul 21 01:20:37.399212 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:37.399195    2560 scope.go:117] "RemoveContainer" containerID="e32785a01f3cf86f2e4e77756fc8e619b91b07751701dc00f44256f769b128ff"
Jul 21 01:20:37.400270 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:37.400240    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:37.400317 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:37.400308    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:37.400352 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:37.400340    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:38.405192 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:38.405163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" event={"ID":"7256389d-33e3-4c49-9f02-50247001ff0e","Type":"ContainerStarted","Data":"bda4e0243d519fe22f2b619ba6a549502cafde94142c10b62bb1ee16c712b022"}
Jul 21 01:20:38.459248 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:38.459200    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:38.459473 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:38.459344    2560 patch_prober.go:28] interesting pod/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 21 01:20:38.459473 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:38.459388    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 21 01:20:39.459657 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:39.459614    2560 patch_prober.go:28] interesting pod/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 21 01:20:39.460264 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:39.460233    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 21 01:20:40.459972 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.459925    2560 patch_prober.go:28] interesting pod/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 21 01:20:40.460484 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.459995    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 21 01:20:40.911695 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.911660    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"]
Jul 21 01:20:40.914034 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.914018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"
Jul 21 01:20:40.916211 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.916189    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:20:40.916431 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.916417    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:20:40.921164 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.920910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"]
Jul 21 01:20:40.929519 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:40.929367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735048a7-3ca6-4615-98f1-bb414746ddc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5\" (UID: \"735048a7-3ca6-4615-98f1-bb414746ddc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"
Jul 21 01:20:41.034800 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.030137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735048a7-3ca6-4615-98f1-bb414746ddc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5\" (UID: \"735048a7-3ca6-4615-98f1-bb414746ddc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"
Jul 21 01:20:41.034800 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.031120    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735048a7-3ca6-4615-98f1-bb414746ddc7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5\" (UID: \"735048a7-3ca6-4615-98f1-bb414746ddc7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"
Jul 21 01:20:41.225542 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.225437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"
Jul 21 01:20:41.422359 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.422324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:41.447807 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.442794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"]
Jul 21 01:20:41.462368 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.461904    2560 patch_prober.go:28] interesting pod/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 21 01:20:41.462368 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.461975    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 21 01:20:41.475029 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:20:41.474286    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735048a7_3ca6_4615_98f1_bb414746ddc7.slice/crio-da6a4a53d94b784a0ed9afe4de14ee4f58d1fd1f7a1745a1be453a9da2a00b8f WatchSource:0}: Error finding container da6a4a53d94b784a0ed9afe4de14ee4f58d1fd1f7a1745a1be453a9da2a00b8f: Status 404 returned error can't find the container with id da6a4a53d94b784a0ed9afe4de14ee4f58d1fd1f7a1745a1be453a9da2a00b8f
Jul 21 01:20:41.523766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:41.523735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:42.426870 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:42.426823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5" event={"ID":"735048a7-3ca6-4615-98f1-bb414746ddc7","Type":"ContainerStarted","Data":"1f69cbb986a7c656d71c1a2ab4d797d1dc6cdcc2066ca86c5a4ccc08f5c35ef9"}
Jul 21 01:20:42.427085 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:42.426936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5" event={"ID":"735048a7-3ca6-4615-98f1-bb414746ddc7","Type":"ContainerStarted","Data":"da6a4a53d94b784a0ed9afe4de14ee4f58d1fd1f7a1745a1be453a9da2a00b8f"}
Jul 21 01:20:42.441557 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:42.441211    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5" podStartSLOduration=2.441190551 podStartE2EDuration="2.441190551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:20:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:20:42.43951387 +0000 UTC m=+2386.111904224" watchObservedRunningTime="2026-07-21 01:20:42.441190551 +0000 UTC m=+2386.113580919"
Jul 21 01:20:42.459085 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:42.459056    2560 patch_prober.go:28] interesting pod/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 21 01:20:42.459216 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:42.459117    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 21 01:20:43.433405 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:43.433372    2560 generic.go:356] "Generic (PLEG): container finished" podID="735048a7-3ca6-4615-98f1-bb414746ddc7" containerID="1f69cbb986a7c656d71c1a2ab4d797d1dc6cdcc2066ca86c5a4ccc08f5c35ef9" exitCode=0
Jul 21 01:20:43.433841 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:43.433457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5" event={"ID":"735048a7-3ca6-4615-98f1-bb414746ddc7","Type":"ContainerDied","Data":"1f69cbb986a7c656d71c1a2ab4d797d1dc6cdcc2066ca86c5a4ccc08f5c35ef9"}
Jul 21 01:20:43.463190 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:43.463151    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:43.463612 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:43.463591    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:43.464254 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:43.464231    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:20:44.391990 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:44.391949    2560 patch_prober.go:28] interesting pod/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 01:20:44.392176 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:44.392027    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 01:20:44.573969 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:44.573945    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"
Jul 21 01:20:44.672672 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:44.672581    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735048a7-3ca6-4615-98f1-bb414746ddc7-maas-api-service-ca\") pod \"735048a7-3ca6-4615-98f1-bb414746ddc7\" (UID: \"735048a7-3ca6-4615-98f1-bb414746ddc7\") "
Jul 21 01:20:44.672958 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:44.672935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735048a7-3ca6-4615-98f1-bb414746ddc7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "735048a7-3ca6-4615-98f1-bb414746ddc7" (UID: "735048a7-3ca6-4615-98f1-bb414746ddc7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:20:44.773594 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:44.773515    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735048a7-3ca6-4615-98f1-bb414746ddc7-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:20:45.443922 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.443889    2560 generic.go:356] "Generic (PLEG): container finished" podID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerID="e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428" exitCode=0
Jul 21 01:20:45.444173 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.443966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" event={"ID":"05ea8186-0ace-4253-aa24-da2d80d5f04d","Type":"ContainerDied","Data":"e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428"}
Jul 21 01:20:45.444457 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.444437    2560 scope.go:117] "RemoveContainer" containerID="e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428"
Jul 21 01:20:45.445261 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.445247    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"
Jul 21 01:20:45.445322 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.445301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5" event={"ID":"735048a7-3ca6-4615-98f1-bb414746ddc7","Type":"ContainerDied","Data":"da6a4a53d94b784a0ed9afe4de14ee4f58d1fd1f7a1745a1be453a9da2a00b8f"}
Jul 21 01:20:45.445371 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.445342    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da6a4a53d94b784a0ed9afe4de14ee4f58d1fd1f7a1745a1be453a9da2a00b8f"
Jul 21 01:20:45.445545 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.445511    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:45.445674 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.445609    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:45.445674 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:45.445663    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:20:46.453310 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:46.453269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" event={"ID":"05ea8186-0ace-4253-aa24-da2d80d5f04d","Type":"ContainerStarted","Data":"69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3"}
Jul 21 01:20:46.824183 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:46.824147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:46.824438 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:46.824415    2560 patch_prober.go:28] interesting pod/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 01:20:46.824489 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:46.824466    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 01:20:47.823832 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:47.823767    2560 patch_prober.go:28] interesting pod/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 01:20:47.824231 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:47.823855    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 01:20:48.824042 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:48.824005    2560 patch_prober.go:28] interesting pod/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 01:20:48.824439 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:48.824065    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 01:20:49.824104 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:49.824071    2560 patch_prober.go:28] interesting pod/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 01:20:49.824508 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:49.824124    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 01:20:49.896640 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:49.896611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:49.998943 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:49.998906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:50.827362 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:50.827332    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:50.827811 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:50.827596    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:50.828261 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:50.828244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:20:51.407053 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:51.407014    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:51.506880 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:51.506846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:20:56.660620 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:20:56.660586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:00.989013 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:00.988940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:00.989901 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:00.989873    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"]
Jul 21 01:21:00.991323 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:00.991301    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1ec8c6-78qf5"]
Jul 21 01:21:01.412861 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:01.412822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:02.854440 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:02.854405    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="735048a7-3ca6-4615-98f1-bb414746ddc7" path="/var/lib/kubelet/pods/735048a7-3ca6-4615-98f1-bb414746ddc7/volumes"
Jul 21 01:21:07.082174 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.082134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:07.159396 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.159363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:07.322802 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.322751    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"]
Jul 21 01:21:07.323062 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.323033    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy" containerID="cri-o://bda4e0243d519fe22f2b619ba6a549502cafde94142c10b62bb1ee16c712b022" gracePeriod=30
Jul 21 01:21:07.348744 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.348667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:07.579545 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.579502    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:07.697006 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.696924    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"]
Jul 21 01:21:07.697232 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.697220    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735048a7-3ca6-4615-98f1-bb414746ddc7" containerName="revoke-keys"
Jul 21 01:21:07.697274 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.697233    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="735048a7-3ca6-4615-98f1-bb414746ddc7" containerName="revoke-keys"
Jul 21 01:21:07.697314 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.697285    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="735048a7-3ca6-4615-98f1-bb414746ddc7" containerName="revoke-keys"
Jul 21 01:21:07.700239 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.700223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"
Jul 21 01:21:07.702818 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.702792    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:21:07.702948 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.702822    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:21:07.706245 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.706220    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"]
Jul 21 01:21:07.782516 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.782482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f384-4293-4c29-af8d-1e8d8cd1631a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v\" (UID: \"6af6f384-4293-4c29-af8d-1e8d8cd1631a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"
Jul 21 01:21:07.883831 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.883771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f384-4293-4c29-af8d-1e8d8cd1631a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v\" (UID: \"6af6f384-4293-4c29-af8d-1e8d8cd1631a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"
Jul 21 01:21:07.884398 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:07.884375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f384-4293-4c29-af8d-1e8d8cd1631a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v\" (UID: \"6af6f384-4293-4c29-af8d-1e8d8cd1631a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"
Jul 21 01:21:08.011945 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:08.011870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"
Jul 21 01:21:08.143367 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:08.143230    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"]
Jul 21 01:21:08.146099 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:21:08.146071    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af6f384_4293_4c29_af8d_1e8d8cd1631a.slice/crio-bea5eaea376ef0862ca8a4d689e288fd9c95423f5634961cb7ea3234e96efc3f WatchSource:0}: Error finding container bea5eaea376ef0862ca8a4d689e288fd9c95423f5634961cb7ea3234e96efc3f: Status 404 returned error can't find the container with id bea5eaea376ef0862ca8a4d689e288fd9c95423f5634961cb7ea3234e96efc3f
Jul 21 01:21:08.333827 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:08.333801    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:08.436935 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:08.436905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:08.553606 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:08.553572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v" event={"ID":"6af6f384-4293-4c29-af8d-1e8d8cd1631a","Type":"ContainerStarted","Data":"d44255a695dd576f258e11b8c9cbca179965a95d32c57c2cc1f1cf187b52c841"}
Jul 21 01:21:08.553810 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:08.553630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v" event={"ID":"6af6f384-4293-4c29-af8d-1e8d8cd1631a","Type":"ContainerStarted","Data":"bea5eaea376ef0862ca8a4d689e288fd9c95423f5634961cb7ea3234e96efc3f"}
Jul 21 01:21:08.568569 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:08.568510    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v" podStartSLOduration=1.568491123 podStartE2EDuration="1.568491123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:21:08.567667185 +0000 UTC m=+2412.240057551" watchObservedRunningTime="2026-07-21 01:21:08.568491123 +0000 UTC m=+2412.240881490"
Jul 21 01:21:09.559746 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:09.559711    2560 generic.go:356] "Generic (PLEG): container finished" podID="6af6f384-4293-4c29-af8d-1e8d8cd1631a" containerID="d44255a695dd576f258e11b8c9cbca179965a95d32c57c2cc1f1cf187b52c841" exitCode=0
Jul 21 01:21:09.560158 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:09.559754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v" event={"ID":"6af6f384-4293-4c29-af8d-1e8d8cd1631a","Type":"ContainerDied","Data":"d44255a695dd576f258e11b8c9cbca179965a95d32c57c2cc1f1cf187b52c841"}
Jul 21 01:21:10.692752 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:10.692728    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"
Jul 21 01:21:10.810570 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:10.810526    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f384-4293-4c29-af8d-1e8d8cd1631a-maas-api-service-ca\") pod \"6af6f384-4293-4c29-af8d-1e8d8cd1631a\" (UID: \"6af6f384-4293-4c29-af8d-1e8d8cd1631a\") "
Jul 21 01:21:10.810895 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:10.810870    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af6f384-4293-4c29-af8d-1e8d8cd1631a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6af6f384-4293-4c29-af8d-1e8d8cd1631a" (UID: "6af6f384-4293-4c29-af8d-1e8d8cd1631a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:21:10.911357 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:10.911324    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f384-4293-4c29-af8d-1e8d8cd1631a-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:11.568846 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:11.568813    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"
Jul 21 01:21:11.568846 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:11.568837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v" event={"ID":"6af6f384-4293-4c29-af8d-1e8d8cd1631a","Type":"ContainerDied","Data":"bea5eaea376ef0862ca8a4d689e288fd9c95423f5634961cb7ea3234e96efc3f"}
Jul 21 01:21:11.569052 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:11.568883    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bea5eaea376ef0862ca8a4d689e288fd9c95423f5634961cb7ea3234e96efc3f"
Jul 21 01:21:12.575180 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.575151    2560 generic.go:356] "Generic (PLEG): container finished" podID="7256389d-33e3-4c49-9f02-50247001ff0e" containerID="bda4e0243d519fe22f2b619ba6a549502cafde94142c10b62bb1ee16c712b022" exitCode=0
Jul 21 01:21:12.575491 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.575205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" event={"ID":"7256389d-33e3-4c49-9f02-50247001ff0e","Type":"ContainerDied","Data":"bda4e0243d519fe22f2b619ba6a549502cafde94142c10b62bb1ee16c712b022"}
Jul 21 01:21:12.575491 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.575250    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t" event={"ID":"7256389d-33e3-4c49-9f02-50247001ff0e","Type":"ContainerDied","Data":"64c859241421e9beffecf6ce388b25a6283e66db09f0c6ee8b3d7b3048d00bb9"}
Jul 21 01:21:12.575491 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.575267    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64c859241421e9beffecf6ce388b25a6283e66db09f0c6ee8b3d7b3048d00bb9"
Jul 21 01:21:12.575491 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.575282    2560 scope.go:117] "RemoveContainer" containerID="e32785a01f3cf86f2e4e77756fc8e619b91b07751701dc00f44256f769b128ff"
Jul 21 01:21:12.581451 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.581429    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:21:12.726116 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7256389d-33e3-4c49-9f02-50247001ff0e-istio-podinfo\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726116 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726068    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-data\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726116 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726095    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-istio-token\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-certs\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-socket\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stpcz\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-kube-api-access-stpcz\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726220    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7256389d-33e3-4c49-9f02-50247001ff0e-istiod-ca-cert\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726242    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-envoy\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726416 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726307    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-credential-socket\") pod \"7256389d-33e3-4c49-9f02-50247001ff0e\" (UID: \"7256389d-33e3-4c49-9f02-50247001ff0e\") "
Jul 21 01:21:12.726732 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726455    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:12.726732 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726470    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:12.726732 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726593    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.726732 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726610    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.726732 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726695    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:12.727016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.726830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7256389d-33e3-4c49-9f02-50247001ff0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:21:12.727272 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.727244    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:12.728377 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.728356    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7256389d-33e3-4c49-9f02-50247001ff0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:21:12.728476 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.728380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:21:12.728538 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.728471    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-kube-api-access-stpcz" (OuterVolumeSpecName: "kube-api-access-stpcz") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "kube-api-access-stpcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:21:12.728581 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.728562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7256389d-33e3-4c49-9f02-50247001ff0e" (UID: "7256389d-33e3-4c49-9f02-50247001ff0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:12.828014 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.827962    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.828014 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.828006    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.828014 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.828018    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stpcz\" (UniqueName: \"kubernetes.io/projected/7256389d-33e3-4c49-9f02-50247001ff0e-kube-api-access-stpcz\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.828014 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.828027    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7256389d-33e3-4c49-9f02-50247001ff0e-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.828014 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.828036    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.828331 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.828044    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7256389d-33e3-4c49-9f02-50247001ff0e-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:12.828331 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:12.828052    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7256389d-33e3-4c49-9f02-50247001ff0e-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:13.581090 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:13.581064    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"
Jul 21 01:21:13.615677 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:13.615635    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"]
Jul 21 01:21:13.626648 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:13.626617    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1ec8c6-openshift-default-5c4784dfb7-nkw5t"]
Jul 21 01:21:14.853709 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:14.853676    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" path="/var/lib/kubelet/pods/7256389d-33e3-4c49-9f02-50247001ff0e/volumes"
Jul 21 01:21:23.207624 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:23.207538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:27.757812 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:27.757765    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"]
Jul 21 01:21:27.761108 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:27.761081    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92d4e9-9cn7v"]
Jul 21 01:21:27.763627 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:27.763604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:28.159181 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:28.159146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:28.853066 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:28.853032    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6af6f384-4293-4c29-af8d-1e8d8cd1631a" path="/var/lib/kubelet/pods/6af6f384-4293-4c29-af8d-1e8d8cd1631a/volumes"
Jul 21 01:21:33.841506 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:33.841474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:33.942594 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:33.942568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:34.115688 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:34.115600    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"]
Jul 21 01:21:34.115865 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:34.115832    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy" containerID="cri-o://69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3" gracePeriod=30
Jul 21 01:21:34.139550 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:34.139522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:34.385033 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:34.384937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:34.771577 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:34.771474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:35.112724 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.112693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"]
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.112994    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113005    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113018    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af6f384-4293-4c29-af8d-1e8d8cd1631a" containerName="revoke-keys"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113024    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af6f384-4293-4c29-af8d-1e8d8cd1631a" containerName="revoke-keys"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113034    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113041    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113082    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113090    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7256389d-33e3-4c49-9f02-50247001ff0e" containerName="istio-proxy"
Jul 21 01:21:35.113161 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.113098    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af6f384-4293-4c29-af8d-1e8d8cd1631a" containerName="revoke-keys"
Jul 21 01:21:35.115768 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.115749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.118033 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.118010    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a7997d-openshift-default-dockercfg-xmtzx\""
Jul 21 01:21:35.127124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.127100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"]
Jul 21 01:21:35.134897 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.134876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:35.206636 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.206600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8tr2\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-kube-api-access-h8tr2\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.206902 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.206882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-envoy\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.207020 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.207006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a64e145-3f9e-4048-9108-bfbea1499f6b-istiod-ca-cert\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.207146 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.207133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-data\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.207237 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.207225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-token\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.207333 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.207321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-certs\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.207438 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.207426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-podinfo\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.207599 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.207585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-credential-socket\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.207708 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.207695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-socket\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.308927 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.308896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-data\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.308927 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.308928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-token\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.308947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-certs\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.308970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-podinfo\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-credential-socket\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-socket\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8tr2\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-kube-api-access-h8tr2\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309185 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-envoy\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a64e145-3f9e-4048-9108-bfbea1499f6b-istiod-ca-cert\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309351    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-data\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-certs\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309494 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-socket\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309718 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-credential-socket\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.309923 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.309905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a64e145-3f9e-4048-9108-bfbea1499f6b-istiod-ca-cert\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.311453 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.311431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-envoy\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.311570 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.311472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-podinfo\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.316578 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.316557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8tr2\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-kube-api-access-h8tr2\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.316669 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.316633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-token\") pod \"e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") " pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.404252 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.404177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:35.426447 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.426425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:35.555546 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.555522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"]
Jul 21 01:21:35.557523 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:21:35.557494    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a64e145_3f9e_4048_9108_bfbea1499f6b.slice/crio-4aa166aa5552266d9e4e2a704ba9b353c12e659782a75e28622837b7eb0b376d WatchSource:0}: Error finding container 4aa166aa5552266d9e4e2a704ba9b353c12e659782a75e28622837b7eb0b376d: Status 404 returned error can't find the container with id 4aa166aa5552266d9e4e2a704ba9b353c12e659782a75e28622837b7eb0b376d
Jul 21 01:21:35.559646 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.559614    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:35.559739 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.559699    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:35.559827 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.559748    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:35.677067 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.676984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" event={"ID":"2a64e145-3f9e-4048-9108-bfbea1499f6b","Type":"ContainerStarted","Data":"9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920"}
Jul 21 01:21:35.677222 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.677070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" event={"ID":"2a64e145-3f9e-4048-9108-bfbea1499f6b","Type":"ContainerStarted","Data":"4aa166aa5552266d9e4e2a704ba9b353c12e659782a75e28622837b7eb0b376d"}
Jul 21 01:21:35.695200 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.695143    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" podStartSLOduration=0.695126229 podStartE2EDuration="695.126229ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:21:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:21:35.694968097 +0000 UTC m=+2439.367358465" watchObservedRunningTime="2026-07-21 01:21:35.695126229 +0000 UTC m=+2439.367516597"
Jul 21 01:21:35.830439 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.830402    2560 patch_prober.go:28] interesting pod/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 01:21:35.830619 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:35.830505    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 01:21:36.426764 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:36.426729    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:36.431481 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:36.431459    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:36.681174 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:36.681096    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:36.681994 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:36.681974    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:37.678861 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:37.678815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:37.811323 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:37.811290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:37.911598 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:37.911568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:38.334191 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:38.334155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:38.439680 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:38.439645    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:39.359015 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.358990    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:21:39.443124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443057    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpmcb\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-kube-api-access-xpmcb\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443087    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-podinfo\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443105    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-certs\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443124 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443123    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-token\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443355 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443265    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-data\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443355 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443303    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-socket\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443457 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-credential-socket\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443457 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443396    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:39.443457 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443418    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-envoy\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443457 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443445    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8186-0ace-4253-aa24-da2d80d5f04d-istiod-ca-cert\") pod \"05ea8186-0ace-4253-aa24-da2d80d5f04d\" (UID: \"05ea8186-0ace-4253-aa24-da2d80d5f04d\") "
Jul 21 01:21:39.443675 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443581    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:39.443853 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443724    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.443853 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443758    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.443853 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:39.444016 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.443894    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05ea8186-0ace-4253-aa24-da2d80d5f04d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:21:39.444158 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.444139    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-data" (OuterVolumeSpecName: "istio-data") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:39.445693 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.445671    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:21:39.445693 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.445680    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-kube-api-access-xpmcb" (OuterVolumeSpecName: "kube-api-access-xpmcb") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "kube-api-access-xpmcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:21:39.445847 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.445829    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-token" (OuterVolumeSpecName: "istio-token") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:21:39.445847 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.445824    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05ea8186-0ace-4253-aa24-da2d80d5f04d" (UID: "05ea8186-0ace-4253-aa24-da2d80d5f04d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:21:39.544317 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.544289    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.544317 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.544313    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea8186-0ace-4253-aa24-da2d80d5f04d-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.544317 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.544324    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpmcb\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-kube-api-access-xpmcb\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.544535 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.544333    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.544535 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.544341    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.544535 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.544351    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.544535 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.544360    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea8186-0ace-4253-aa24-da2d80d5f04d-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:21:39.695804 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.695703    2560 generic.go:356] "Generic (PLEG): container finished" podID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerID="69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3" exitCode=0
Jul 21 01:21:39.695804 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.695754    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"
Jul 21 01:21:39.695976 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.695755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" event={"ID":"05ea8186-0ace-4253-aa24-da2d80d5f04d","Type":"ContainerDied","Data":"69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3"}
Jul 21 01:21:39.695976 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.695900    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb" event={"ID":"05ea8186-0ace-4253-aa24-da2d80d5f04d","Type":"ContainerDied","Data":"fa083e42bc19d72478293a1a45040b6a23099fc22e9526045567c54caa83560c"}
Jul 21 01:21:39.695976 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.695927    2560 scope.go:117] "RemoveContainer" containerID="69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3"
Jul 21 01:21:39.705234 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.705219    2560 scope.go:117] "RemoveContainer" containerID="e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428"
Jul 21 01:21:39.712630 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.712611    2560 scope.go:117] "RemoveContainer" containerID="69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3"
Jul 21 01:21:39.712905 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:21:39.712876    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3\": container with ID starting with 69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3 not found: ID does not exist" containerID="69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3"
Jul 21 01:21:39.712986 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.712916    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3"} err="failed to get container status \"69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3\": rpc error: code = NotFound desc = could not find container \"69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3\": container with ID starting with 69e47adffebd979ba5ab4b7448c51316056ab9eb514915f9dabf60cbfbfbf2a3 not found: ID does not exist"
Jul 21 01:21:39.712986 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.712938    2560 scope.go:117] "RemoveContainer" containerID="e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428"
Jul 21 01:21:39.713192 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:21:39.713172    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428\": container with ID starting with e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428 not found: ID does not exist" containerID="e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428"
Jul 21 01:21:39.713231 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.713198    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428"} err="failed to get container status \"e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428\": rpc error: code = NotFound desc = could not find container \"e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428\": container with ID starting with e2a3c76df1f6dfdc8a84f8f7f96e121bfd9420e75c2831fe3b232d03da37a428 not found: ID does not exist"
Jul 21 01:21:39.716941 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.716922    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"]
Jul 21 01:21:39.721435 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:39.721414    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-92d4e9-openshift-default-66dd78dc8c-sjpzb"]
Jul 21 01:21:40.853557 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:40.853525    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" path="/var/lib/kubelet/pods/05ea8186-0ace-4253-aa24-da2d80d5f04d/volumes"
Jul 21 01:21:42.271481 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.271446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:42.589847 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.589820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:42.920669 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.920588    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"]
Jul 21 01:21:42.920997 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.920977    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy"
Jul 21 01:21:42.921061 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.921001    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy"
Jul 21 01:21:42.921133 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.921121    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy"
Jul 21 01:21:42.925756 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.925733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.928018 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.928000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-03c5cb-openshift-default-dockercfg-9nsr8\""
Jul 21 01:21:42.934482 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.934461    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"]
Jul 21 01:21:42.948266 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.948238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:42.971074 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-certs\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971179 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-token\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971179 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-credential-socket\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971304 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-envoy\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971304 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f04ae22-98c7-4532-89e5-b99571da42fe-istiod-ca-cert\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971304 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnhb\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-kube-api-access-2fnhb\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971455 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-data\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971455 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-socket\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:42.971455 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:42.971416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-podinfo\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.065138 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.065111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:43.071799 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.071759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-envoy\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.071918 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.071814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f04ae22-98c7-4532-89e5-b99571da42fe-istiod-ca-cert\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.071918 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.071846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnhb\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-kube-api-access-2fnhb\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.071918 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.071893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-data\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072079 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.071921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-socket\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072079 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.071969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-podinfo\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072079 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-certs\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072079 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-token\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072280 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-credential-socket\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072339 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-data\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072394 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-socket\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072455 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-certs\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072501 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-credential-socket\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.072955 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.072935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f04ae22-98c7-4532-89e5-b99571da42fe-istiod-ca-cert\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.074129 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.074105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-envoy\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.074386 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.074365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-podinfo\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.080170 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.080144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnhb\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-kube-api-access-2fnhb\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.080399 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.080379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-token\") pod \"e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") " pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.236199 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.236099    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:43.370072 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.370043    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"]
Jul 21 01:21:43.371389 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:21:43.371354    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f04ae22_98c7_4532_89e5_b99571da42fe.slice/crio-380cba46750450f15ad78504232825eb754040e787f3f24b484f812b9a3e3784 WatchSource:0}: Error finding container 380cba46750450f15ad78504232825eb754040e787f3f24b484f812b9a3e3784: Status 404 returned error can't find the container with id 380cba46750450f15ad78504232825eb754040e787f3f24b484f812b9a3e3784
Jul 21 01:21:43.373421 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.373381    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:43.373501 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.373446    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:43.373501 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.373474    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:43.719404 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.719361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" event={"ID":"7f04ae22-98c7-4532-89e5-b99571da42fe","Type":"ContainerStarted","Data":"4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a"}
Jul 21 01:21:43.719559 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.719425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" event={"ID":"7f04ae22-98c7-4532-89e5-b99571da42fe","Type":"ContainerStarted","Data":"380cba46750450f15ad78504232825eb754040e787f3f24b484f812b9a3e3784"}
Jul 21 01:21:43.738555 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:43.738468    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" podStartSLOduration=1.738448526 podStartE2EDuration="1.738448526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:21:43.73779433 +0000 UTC m=+2447.410184692" watchObservedRunningTime="2026-07-21 01:21:43.738448526 +0000 UTC m=+2447.410838894"
Jul 21 01:21:44.237286 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:44.237256    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:44.242103 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:44.242080    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:44.724350 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:44.724318    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:44.725353 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:44.725332    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:21:45.712946 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:45.712916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:45.822053 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:45.822012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:45.944040 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:45.943993    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:46.180018 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:46.179984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:46.371687 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:46.371649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:46.472409 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:46.472329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:50.276995 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:50.276965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:52.721947 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:52.721902    2560 patch_prober.go:28] interesting pod/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 01:21:52.722330 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:52.721976    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 01:21:53.777155 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:53.777115    2560 generic.go:356] "Generic (PLEG): container finished" podID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerID="9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920" exitCode=0
Jul 21 01:21:53.777693 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:53.777188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" event={"ID":"2a64e145-3f9e-4048-9108-bfbea1499f6b","Type":"ContainerDied","Data":"9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920"}
Jul 21 01:21:53.777866 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:53.777805    2560 scope.go:117] "RemoveContainer" containerID="9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920"
Jul 21 01:21:53.779325 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:53.779282    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:53.779552 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:53.779525    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:53.779733 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:53.779690    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:21:54.787593 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:54.787547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" event={"ID":"2a64e145-3f9e-4048-9108-bfbea1499f6b","Type":"ContainerStarted","Data":"dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73"}
Jul 21 01:21:55.427313 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:55.427258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:55.427611 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:55.427580    2560 patch_prober.go:28] interesting pod/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 21 01:21:55.427767 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:55.427743    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 21 01:21:56.427894 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:56.427837    2560 patch_prober.go:28] interesting pod/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 21 01:21:56.428391 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:56.427924    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 21 01:21:57.011320 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:57.011288    2560 scope.go:117] "RemoveContainer" containerID="5de41ab1b446cec532b5edb99aded4094babdd7eb4f13cc8596605c8d7f08e5d"
Jul 21 01:21:57.019288 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:57.019269    2560 scope.go:117] "RemoveContainer" containerID="1ae71c5f462089841119f30c0800109a837f0bf9d571a7aacb61c99e004d9f57"
Jul 21 01:21:57.429253 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:57.429214    2560 patch_prober.go:28] interesting pod/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 21 01:21:57.429864 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:57.429832    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 21 01:21:58.427751 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:58.427709    2560 patch_prober.go:28] interesting pod/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 21 01:21:58.428065 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:58.428030    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 21 01:21:59.232149 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:59.232114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:59.332805 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:59.332753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:21:59.431077 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:59.431046    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:59.431327 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:59.431306    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:21:59.432164 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:21:59.432140    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:22:00.765980 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:00.765940    2560 patch_prober.go:28] interesting pod/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 01:22:00.767650 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:00.766012    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 01:22:01.824213 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:01.824179    2560 generic.go:356] "Generic (PLEG): container finished" podID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerID="4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a" exitCode=0
Jul 21 01:22:01.824599 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:01.824256    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" event={"ID":"7f04ae22-98c7-4532-89e5-b99571da42fe","Type":"ContainerDied","Data":"4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a"}
Jul 21 01:22:01.824657 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:01.824643    2560 scope.go:117] "RemoveContainer" containerID="4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a"
Jul 21 01:22:01.825663 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:01.825638    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:22:01.825723 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:01.825707    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:22:01.825766 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:01.825740    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 01:22:02.834523 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:02.833613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" event={"ID":"7f04ae22-98c7-4532-89e5-b99571da42fe","Type":"ContainerStarted","Data":"43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868"}
Jul 21 01:22:03.237631 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:03.237516    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:22:03.237846 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:03.237699    2560 patch_prober.go:28] interesting pod/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 21 01:22:03.237846 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:03.237800    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 21 01:22:04.237129 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:04.237031    2560 patch_prober.go:28] interesting pod/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 21 01:22:04.237717 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:04.237684    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 21 01:22:04.746134 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:04.746085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:05.237068 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:05.237031    2560 patch_prober.go:28] interesting pod/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 21 01:22:05.237343 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:05.237316    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 21 01:22:06.236547 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:06.236510    2560 patch_prober.go:28] interesting pod/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 21 01:22:06.236846 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:06.236819    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 21 01:22:07.092667 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:07.092628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:07.209514 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:07.209484    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:07.240684 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:07.240650    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:22:07.240987 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:07.240970    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:22:07.241706 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:07.241689    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:22:32.533518 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:22:32.533484    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:48.877674 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:23:48.877638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:48.949833 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:23:48.949797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:18.879622 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:24:18.879589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:18.934281 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:24:18.934248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:40.635462 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:24:40.635424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:41.964707 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:24:41.964668    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:43.676696 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:24:43.676663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:00.633526 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:25:00.633493    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:39.717073 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:25:39.717038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:52.056426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:25:52.056393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:57.077295 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:25:57.077255    2560 scope.go:117] "RemoveContainer" containerID="c00ecd517dc3c68e6b6ffabcd6e5452f35094fc43595e9942581da9254cdb009"
Jul 21 01:25:57.085015 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:25:57.084994    2560 scope.go:117] "RemoveContainer" containerID="ac00274b15f419e7167252bffa5834cdf4a226385997ee19b4bb297d715c45fc"
Jul 21 01:26:13.852750 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:13.852718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:13.950135 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:13.950100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:27.925927 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:27.925895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:28.746059 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:28.746027    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:51.937040 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:51.937011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:57.103913 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:57.103877    2560 scope.go:117] "RemoveContainer" containerID="1f69cbb986a7c656d71c1a2ab4d797d1dc6cdcc2066ca86c5a4ccc08f5c35ef9"
Jul 21 01:26:57.113036 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:57.112927    2560 scope.go:117] "RemoveContainer" containerID="bda4e0243d519fe22f2b619ba6a549502cafde94142c10b62bb1ee16c712b022"
Jul 21 01:26:59.925058 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:26:59.925010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:00.023745 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:00.023704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:08.022336 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:08.022299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:08.121671 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:08.121638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:09.956309 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:09.956278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:16.051201 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:16.051165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:16.159976 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:16.159940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:48.272738 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:48.272663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:49.429562 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:49.429527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:57.134163 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:27:57.134127    2560 scope.go:117] "RemoveContainer" containerID="d44255a695dd576f258e11b8c9cbca179965a95d32c57c2cc1f1cf187b52c841"
Jul 21 01:28:08.968474 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.968441    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"]
Jul 21 01:28:08.968945 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.968736    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy"
Jul 21 01:28:08.968945 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.968745    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy"
Jul 21 01:28:08.968945 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.968826    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ea8186-0ace-4253-aa24-da2d80d5f04d" containerName="istio-proxy"
Jul 21 01:28:08.971575 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.971560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"
Jul 21 01:28:08.973822 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.973801    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m7v8\""
Jul 21 01:28:08.973924 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.973840    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:28:08.979669 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:08.979640    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"]
Jul 21 01:28:09.063990 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.063960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086c58b2-48cd-49b5-90a0-32afb23c63cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg\" (UID: \"086c58b2-48cd-49b5-90a0-32afb23c63cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"
Jul 21 01:28:09.164849 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.164807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086c58b2-48cd-49b5-90a0-32afb23c63cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg\" (UID: \"086c58b2-48cd-49b5-90a0-32afb23c63cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"
Jul 21 01:28:09.165451 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.165431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086c58b2-48cd-49b5-90a0-32afb23c63cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg\" (UID: \"086c58b2-48cd-49b5-90a0-32afb23c63cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"
Jul 21 01:28:09.282387 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.282305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"
Jul 21 01:28:09.409076 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.409052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"]
Jul 21 01:28:09.410992 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:28:09.410963    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086c58b2_48cd_49b5_90a0_32afb23c63cb.slice/crio-79ab5fe7b08766e8f57d07e9c02621cb4b6cfd2af67e22975ef1efbe36197298 WatchSource:0}: Error finding container 79ab5fe7b08766e8f57d07e9c02621cb4b6cfd2af67e22975ef1efbe36197298: Status 404 returned error can't find the container with id 79ab5fe7b08766e8f57d07e9c02621cb4b6cfd2af67e22975ef1efbe36197298
Jul 21 01:28:09.427135 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.427077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg" event={"ID":"086c58b2-48cd-49b5-90a0-32afb23c63cb","Type":"ContainerStarted","Data":"79ab5fe7b08766e8f57d07e9c02621cb4b6cfd2af67e22975ef1efbe36197298"}
Jul 21 01:28:09.558605 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.558529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:09.658279 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:09.658252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:10.432349 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:10.432312    2560 generic.go:356] "Generic (PLEG): container finished" podID="086c58b2-48cd-49b5-90a0-32afb23c63cb" containerID="8c651fbbc271194ef3dbbedfc7adb573b832e7d2b58a3eb442763e8b601bcbea" exitCode=0
Jul 21 01:28:10.432765 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:10.432394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg" event={"ID":"086c58b2-48cd-49b5-90a0-32afb23c63cb","Type":"ContainerDied","Data":"8c651fbbc271194ef3dbbedfc7adb573b832e7d2b58a3eb442763e8b601bcbea"}
Jul 21 01:28:11.563239 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:11.563217    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"
Jul 21 01:28:11.588277 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:11.588251    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086c58b2-48cd-49b5-90a0-32afb23c63cb-maas-api-service-ca\") pod \"086c58b2-48cd-49b5-90a0-32afb23c63cb\" (UID: \"086c58b2-48cd-49b5-90a0-32afb23c63cb\") "
Jul 21 01:28:11.588598 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:11.588574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/086c58b2-48cd-49b5-90a0-32afb23c63cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "086c58b2-48cd-49b5-90a0-32afb23c63cb" (UID: "086c58b2-48cd-49b5-90a0-32afb23c63cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:28:11.689765 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:11.689698    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086c58b2-48cd-49b5-90a0-32afb23c63cb-maas-api-service-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:12.441827 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:12.441794    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"
Jul 21 01:28:12.442002 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:12.441831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg" event={"ID":"086c58b2-48cd-49b5-90a0-32afb23c63cb","Type":"ContainerDied","Data":"79ab5fe7b08766e8f57d07e9c02621cb4b6cfd2af67e22975ef1efbe36197298"}
Jul 21 01:28:12.442002 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:12.441876    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79ab5fe7b08766e8f57d07e9c02621cb4b6cfd2af67e22975ef1efbe36197298"
Jul 21 01:28:19.397197 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:19.397165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:24.040579 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:24.040543    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:24.041540 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:24.041503    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"]
Jul 21 01:28:24.043061 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:24.043037    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a7997d-bxpsg"]
Jul 21 01:28:24.437911 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:24.437882    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:24.853887 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:24.853857    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="086c58b2-48cd-49b5-90a0-32afb23c63cb" path="/var/lib/kubelet/pods/086c58b2-48cd-49b5-90a0-32afb23c63cb/volumes"
Jul 21 01:28:30.965882 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:30.965848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:31.066145 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:31.066113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:31.241397 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:31.241313    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"]
Jul 21 01:28:31.241604 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:31.241577    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy" containerID="cri-o://dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73" gracePeriod=30
Jul 21 01:28:31.263916 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:31.263886    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:31.494901 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:31.494810    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:32.234656 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:32.234614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:32.333537 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:32.333507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:36.493371 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.493338    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:28:36.546587 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.546506    2560 generic.go:356] "Generic (PLEG): container finished" podID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerID="dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73" exitCode=0
Jul 21 01:28:36.546587 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.546548    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"
Jul 21 01:28:36.546797 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.546544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" event={"ID":"2a64e145-3f9e-4048-9108-bfbea1499f6b","Type":"ContainerDied","Data":"dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73"}
Jul 21 01:28:36.546797 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.546665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm" event={"ID":"2a64e145-3f9e-4048-9108-bfbea1499f6b","Type":"ContainerDied","Data":"4aa166aa5552266d9e4e2a704ba9b353c12e659782a75e28622837b7eb0b376d"}
Jul 21 01:28:36.546797 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.546690    2560 scope.go:117] "RemoveContainer" containerID="dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73"
Jul 21 01:28:36.556299 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.556251    2560 scope.go:117] "RemoveContainer" containerID="9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920"
Jul 21 01:28:36.563942 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.563920    2560 scope.go:117] "RemoveContainer" containerID="dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73"
Jul 21 01:28:36.564169 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:28:36.564152    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73\": container with ID starting with dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73 not found: ID does not exist" containerID="dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73"
Jul 21 01:28:36.564219 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.564177    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73"} err="failed to get container status \"dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73\": rpc error: code = NotFound desc = could not find container \"dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73\": container with ID starting with dc1b174372f8791756bcca94a76dbdef5dd4674a14824f079c2097532459fb73 not found: ID does not exist"
Jul 21 01:28:36.564219 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.564192    2560 scope.go:117] "RemoveContainer" containerID="9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920"
Jul 21 01:28:36.564393 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:28:36.564374    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920\": container with ID starting with 9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920 not found: ID does not exist" containerID="9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920"
Jul 21 01:28:36.564434 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.564399    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920"} err="failed to get container status \"9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920\": rpc error: code = NotFound desc = could not find container \"9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920\": container with ID starting with 9f93629f5c27fbd772e380be74137c6f18f1ff1970b3d5b4190ba4955dda1920 not found: ID does not exist"
Jul 21 01:28:36.616305 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-socket\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616305 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-envoy\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616498 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616325    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-token\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616498 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616347    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-podinfo\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616498 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-credential-socket\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616498 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616412    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-certs\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616498 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616492    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-data\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616519    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8tr2\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-kube-api-access-h8tr2\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616549    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a64e145-3f9e-4048-9108-bfbea1499f6b-istiod-ca-cert\") pod \"2a64e145-3f9e-4048-9108-bfbea1499f6b\" (UID: \"2a64e145-3f9e-4048-9108-bfbea1499f6b\") "
Jul 21 01:28:36.616763 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616600    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:36.616967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616811    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:36.616967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616873    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.616967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.616937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a64e145-3f9e-4048-9108-bfbea1499f6b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:28:36.617135 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.617005    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:36.617443 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.617419    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:36.618549 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.618528    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:36.618754 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.618737    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-kube-api-access-h8tr2" (OuterVolumeSpecName: "kube-api-access-h8tr2") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "kube-api-access-h8tr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:36.618958 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.618845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:36.618958 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.618854    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a64e145-3f9e-4048-9108-bfbea1499f6b" (UID: "2a64e145-3f9e-4048-9108-bfbea1499f6b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:28:36.717681 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717644    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.717681 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717675    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.717681 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717684    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.717681 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717692    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.717974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717700    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8tr2\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-kube-api-access-h8tr2\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.717974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717709    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a64e145-3f9e-4048-9108-bfbea1499f6b-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.717974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717718    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.717974 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.717725    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a64e145-3f9e-4048-9108-bfbea1499f6b-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:36.870722 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.870693    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"]
Jul 21 01:28:36.874252 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:36.874225    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a7997d-openshift-default-66c85d8955-h58tm"]
Jul 21 01:28:38.853648 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:38.853616    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" path="/var/lib/kubelet/pods/2a64e145-3f9e-4048-9108-bfbea1499f6b/volumes"
Jul 21 01:28:42.058243 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:42.058205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:46.680573 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:46.680540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:47.070285 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:47.070251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:52.793722 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:52.793681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:52.895133 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:52.895103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:53.102051 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:53.102017    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"]
Jul 21 01:28:53.102290 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:53.102268    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy" containerID="cri-o://43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868" gracePeriod=30
Jul 21 01:28:53.147557 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:53.147523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:53.309279 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:53.309250    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:58.347675 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.347650    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:28:58.389487 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389415    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-data\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389487 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389447    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-certs\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389487 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389479    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-socket\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389735 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389501    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-podinfo\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389735 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389534    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-credential-socket\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389735 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389548    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-envoy\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389735 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389574    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-token\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389962 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389737    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:58.389962 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389750    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f04ae22-98c7-4532-89e5-b99571da42fe-istiod-ca-cert\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389962 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389811    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fnhb\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-kube-api-access-2fnhb\") pod \"7f04ae22-98c7-4532-89e5-b99571da42fe\" (UID: \"7f04ae22-98c7-4532-89e5-b99571da42fe\") "
Jul 21 01:28:58.389962 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389910    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:58.389962 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.389926    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:58.390235 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.390080    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f04ae22-98c7-4532-89e5-b99571da42fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:28:58.390304 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.390283    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:58.390361 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.390302    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-certs\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.390361 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.390325    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-workload-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.390361 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.390339    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-credential-socket\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.390361 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.390353    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f04ae22-98c7-4532-89e5-b99571da42fe-istiod-ca-cert\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.391839 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.391808    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:58.391953 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.391880    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:28:58.391953 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.391895    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 01:28:58.392036 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.391954    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-kube-api-access-2fnhb" (OuterVolumeSpecName: "kube-api-access-2fnhb") pod "7f04ae22-98c7-4532-89e5-b99571da42fe" (UID: "7f04ae22-98c7-4532-89e5-b99571da42fe"). InnerVolumeSpecName "kube-api-access-2fnhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:28:58.491138 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.491102    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-podinfo\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.491138 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.491130    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-envoy\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.491138 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.491139    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.491368 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.491148    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fnhb\" (UniqueName: \"kubernetes.io/projected/7f04ae22-98c7-4532-89e5-b99571da42fe-kube-api-access-2fnhb\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.491368 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.491157    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f04ae22-98c7-4532-89e5-b99571da42fe-istio-data\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\""
Jul 21 01:28:58.645468 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.645382    2560 generic.go:356] "Generic (PLEG): container finished" podID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerID="43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868" exitCode=0
Jul 21 01:28:58.645468 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.645425    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"
Jul 21 01:28:58.645637 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.645429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" event={"ID":"7f04ae22-98c7-4532-89e5-b99571da42fe","Type":"ContainerDied","Data":"43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868"}
Jul 21 01:28:58.645637 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.645535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht" event={"ID":"7f04ae22-98c7-4532-89e5-b99571da42fe","Type":"ContainerDied","Data":"380cba46750450f15ad78504232825eb754040e787f3f24b484f812b9a3e3784"}
Jul 21 01:28:58.645637 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.645557    2560 scope.go:117] "RemoveContainer" containerID="43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868"
Jul 21 01:28:58.655594 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.655578    2560 scope.go:117] "RemoveContainer" containerID="4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a"
Jul 21 01:28:58.663057 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.663037    2560 scope.go:117] "RemoveContainer" containerID="43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868"
Jul 21 01:28:58.663313 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:28:58.663296    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868\": container with ID starting with 43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868 not found: ID does not exist" containerID="43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868"
Jul 21 01:28:58.663381 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.663318    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868"} err="failed to get container status \"43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868\": rpc error: code = NotFound desc = could not find container \"43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868\": container with ID starting with 43b114fe19775ca1df9dc1b8ed6b41aa8a59cd017e0a421ec0fa2b6705af7868 not found: ID does not exist"
Jul 21 01:28:58.663381 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.663334    2560 scope.go:117] "RemoveContainer" containerID="4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a"
Jul 21 01:28:58.663575 ip-10-0-138-241 kubenswrapper[2560]: E0721 01:28:58.663560    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a\": container with ID starting with 4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a not found: ID does not exist" containerID="4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a"
Jul 21 01:28:58.663618 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.663581    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a"} err="failed to get container status \"4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a\": rpc error: code = NotFound desc = could not find container \"4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a\": container with ID starting with 4276b0e40192d75a551bcead10e058f5c4f6e8f9341f2778314a4218b8ab424a not found: ID does not exist"
Jul 21 01:28:58.667392 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.667370    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"]
Jul 21 01:28:58.671968 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.671947    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-03c5cb-openshift-default-d87b4d4cf-v28ht"]
Jul 21 01:28:58.854526 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:28:58.854492    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" path="/var/lib/kubelet/pods/7f04ae22-98c7-4532-89e5-b99571da42fe/volumes"
Jul 21 01:29:00.171923 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:00.171896    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-vnc59_62f58f04-760b-4b22-8b1d-a3e3cc55d7af/copy-manifests/0.log"
Jul 21 01:29:00.178426 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:00.178405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-vnc59_62f58f04-760b-4b22-8b1d-a3e3cc55d7af/manager/0.log"
Jul 21 01:29:00.656549 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:00.656517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743260-w246w_f9b18697-88e7-411b-ad96-feed8ea01d3f/cleanup/0.log"
Jul 21 01:29:00.774449 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:00.774423    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743275-2bqv2_5e3a8128-3ca1-4fb7-beee-f045ca809ae2/cleanup/0.log"
Jul 21 01:29:03.549308 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:03.549276    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6786c7n9_4c432abd-cedb-48cf-861a-12c1c6538dfa/istio-proxy/0.log"
Jul 21 01:29:03.673545 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:03.673517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jls8d_e8c5a9b9-4ae0-4d2b-a962-f48d20e03581/discovery/0.log"
Jul 21 01:29:04.057729 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:04.057699    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hq6cg_af9d9b46-f690-4dc2-afd0-4b0917fa1ec2/istio-proxy/1.log"
Jul 21 01:29:04.326728 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:04.326703    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-jk945_4f2f808e-e307-42c0-8ccc-ea0a5b2bc855/payload-processing/0.log"
Jul 21 01:29:05.068170 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:05.068139    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gmd66_3f4ad6ce-a023-432c-82a9-c2541136d45d/main/0.log"
Jul 21 01:29:11.180825 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:11.180790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:11.272234 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:11.272201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:14.620895 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:14.620866    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-76c2g_b2c6f987-646c-4341-9190-3fa552d5fe92/global-pull-secret-syncer/0.log"
Jul 21 01:29:14.840809 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:14.840553    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log"
Jul 21 01:29:15.081420 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:15.081394    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-241.ec2.internal_1b4717978e5444ed26107fe6a970140c/haproxy/0.log"
Jul 21 01:29:22.736741 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:22.736709    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4nqk_b3e8ae89-97d3-459c-a466-735c81dbc3d8/node-exporter/0.log"
Jul 21 01:29:22.756752 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:22.756723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4nqk_b3e8ae89-97d3-459c-a466-735c81dbc3d8/kube-rbac-proxy/0.log"
Jul 21 01:29:22.777473 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:22.777445    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4nqk_b3e8ae89-97d3-459c-a466-735c81dbc3d8/init-textfile/0.log"
Jul 21 01:29:24.694850 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.694814    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"]
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695218    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695236    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695257    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086c58b2-48cd-49b5-90a0-32afb23c63cb" containerName="revoke-keys"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695266    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="086c58b2-48cd-49b5-90a0-32afb23c63cb" containerName="revoke-keys"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695280    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695288    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695297    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695305    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695316    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy"
Jul 21 01:29:24.695340 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695324    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy"
Jul 21 01:29:24.695967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695396    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a64e145-3f9e-4048-9108-bfbea1499f6b" containerName="istio-proxy"
Jul 21 01:29:24.695967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695410    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy"
Jul 21 01:29:24.695967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695421    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f04ae22-98c7-4532-89e5-b99571da42fe" containerName="istio-proxy"
Jul 21 01:29:24.695967 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.695432    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="086c58b2-48cd-49b5-90a0-32afb23c63cb" containerName="revoke-keys"
Jul 21 01:29:24.698654 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.698626    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.700649 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.700627    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs98\"/\"kube-root-ca.crt\""
Jul 21 01:29:24.701315 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.701298    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6qs98\"/\"default-dockercfg-78gjl\""
Jul 21 01:29:24.701409 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.701322    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs98\"/\"openshift-service-ca.crt\""
Jul 21 01:29:24.707342 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.707312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"]
Jul 21 01:29:24.805493 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.805453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-proc\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.805691 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.805541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-podres\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.805691 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.805580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-lib-modules\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.805691 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.805602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvkbp\" (UniqueName: \"kubernetes.io/projected/bce69770-24d1-4ea9-84b2-c81760cc0fb7-kube-api-access-fvkbp\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.805691 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.805672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-sys\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907005 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.906972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-podres\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-lib-modules\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvkbp\" (UniqueName: \"kubernetes.io/projected/bce69770-24d1-4ea9-84b2-c81760cc0fb7-kube-api-access-fvkbp\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-sys\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-proc\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907189 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-podres\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907369 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-lib-modules\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907369 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-sys\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.907369 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.907212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bce69770-24d1-4ea9-84b2-c81760cc0fb7-proc\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:24.914630 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:24.914603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvkbp\" (UniqueName: \"kubernetes.io/projected/bce69770-24d1-4ea9-84b2-c81760cc0fb7-kube-api-access-fvkbp\") pod \"perf-node-gather-daemonset-gvph8\" (UID: \"bce69770-24d1-4ea9-84b2-c81760cc0fb7\") " pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:25.008479 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:25.008383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:25.137377 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:25.137344    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"]
Jul 21 01:29:25.140201 ip-10-0-138-241 kubenswrapper[2560]: W0721 01:29:25.140171    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbce69770_24d1_4ea9_84b2_c81760cc0fb7.slice/crio-e8edd4f35f444bcf0b5018b45a9399f23f9526e7d15e0a7a73f9ae8cd32712de WatchSource:0}: Error finding container e8edd4f35f444bcf0b5018b45a9399f23f9526e7d15e0a7a73f9ae8cd32712de: Status 404 returned error can't find the container with id e8edd4f35f444bcf0b5018b45a9399f23f9526e7d15e0a7a73f9ae8cd32712de
Jul 21 01:29:25.760535 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:25.760479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8" event={"ID":"bce69770-24d1-4ea9-84b2-c81760cc0fb7","Type":"ContainerStarted","Data":"728e73b7dd52084c71953763f077f3b93da0f67958b54a1e1e8934a8f26f9668"}
Jul 21 01:29:25.760964 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:25.760558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8" event={"ID":"bce69770-24d1-4ea9-84b2-c81760cc0fb7","Type":"ContainerStarted","Data":"e8edd4f35f444bcf0b5018b45a9399f23f9526e7d15e0a7a73f9ae8cd32712de"}
Jul 21 01:29:25.760964 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:25.760584    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:25.775245 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:25.775172    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8" podStartSLOduration=1.775154117 podStartE2EDuration="1.775154117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:29:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:25.774622219 +0000 UTC m=+2909.447012586" watchObservedRunningTime="2026-07-21 01:29:25.775154117 +0000 UTC m=+2909.447544485"
Jul 21 01:29:27.647155 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:27.647123    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntlfq_cde337ab-bd30-48ce-b01c-2f2582c6cff0/dns/0.log"
Jul 21 01:29:27.670177 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:27.670148    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntlfq_cde337ab-bd30-48ce-b01c-2f2582c6cff0/kube-rbac-proxy/0.log"
Jul 21 01:29:27.754428 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:27.754396    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7sxq_836b0627-f6be-42b9-b8bc-e12dcba46ccf/dns-node-resolver/0.log"
Jul 21 01:29:28.341153 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:28.341128    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m688j_08434792-4357-45d1-8b53-ce207c60e3e4/node-ca/0.log"
Jul 21 01:29:29.279457 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:29.279430    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6786c7n9_4c432abd-cedb-48cf-861a-12c1c6538dfa/istio-proxy/0.log"
Jul 21 01:29:29.401211 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:29.401175    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jls8d_e8c5a9b9-4ae0-4d2b-a962-f48d20e03581/discovery/0.log"
Jul 21 01:29:29.481072 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:29.481046    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hq6cg_af9d9b46-f690-4dc2-afd0-4b0917fa1ec2/istio-proxy/0.log"
Jul 21 01:29:29.507014 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:29.506982    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hq6cg_af9d9b46-f690-4dc2-afd0-4b0917fa1ec2/istio-proxy/1.log"
Jul 21 01:29:29.568211 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:29.568180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-jk945_4f2f808e-e307-42c0-8ccc-ea0a5b2bc855/payload-processing/0.log"
Jul 21 01:29:30.308120 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:30.308082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcgfm_0fa73e2a-1f8c-40f7-a489-96821178deab/serve-healthcheck-canary/0.log"
Jul 21 01:29:30.911694 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:30.911666    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2cnk_9cfaeaa3-fe5b-4c30-a28f-a647170decba/kube-rbac-proxy/0.log"
Jul 21 01:29:30.931251 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:30.931223    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2cnk_9cfaeaa3-fe5b-4c30-a28f-a647170decba/exporter/0.log"
Jul 21 01:29:30.953252 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:30.953224    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2cnk_9cfaeaa3-fe5b-4c30-a28f-a647170decba/extractor/0.log"
Jul 21 01:29:31.774558 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:31.774530    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6qs98/perf-node-gather-daemonset-gvph8"
Jul 21 01:29:33.737377 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:33.737346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-vnc59_62f58f04-760b-4b22-8b1d-a3e3cc55d7af/manager/0.log"
Jul 21 01:29:33.761427 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:33.761400    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f889c5d8-vnc59_62f58f04-760b-4b22-8b1d-a3e3cc55d7af/copy-manifests/0.log"
Jul 21 01:29:35.230139 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:35.230110    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-656b686d8c-4msfl_03ebde3d-1b9e-42b1-9912-03f1a734889d/manager/0.log"
Jul 21 01:29:36.116005 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:36.115970    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6786c7n9_4c432abd-cedb-48cf-861a-12c1c6538dfa/istio-proxy/0.log"
Jul 21 01:29:36.232003 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:36.231971    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jls8d_e8c5a9b9-4ae0-4d2b-a962-f48d20e03581/discovery/0.log"
Jul 21 01:29:36.296290 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:36.296212    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hq6cg_af9d9b46-f690-4dc2-afd0-4b0917fa1ec2/istio-proxy/0.log"
Jul 21 01:29:36.332256 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:36.332227    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hq6cg_af9d9b46-f690-4dc2-afd0-4b0917fa1ec2/istio-proxy/1.log"
Jul 21 01:29:36.377705 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:36.377673    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-jk945_4f2f808e-e307-42c0-8ccc-ea0a5b2bc855/payload-processing/0.log"
Jul 21 01:29:37.592808 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:37.592762    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6786c7n9_4c432abd-cedb-48cf-861a-12c1c6538dfa/istio-proxy/0.log"
Jul 21 01:29:37.714552 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:37.714494    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jls8d_e8c5a9b9-4ae0-4d2b-a962-f48d20e03581/discovery/0.log"
Jul 21 01:29:37.770593 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:37.770567    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hq6cg_af9d9b46-f690-4dc2-afd0-4b0917fa1ec2/istio-proxy/0.log"
Jul 21 01:29:37.797795 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:37.797749    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hq6cg_af9d9b46-f690-4dc2-afd0-4b0917fa1ec2/istio-proxy/1.log"
Jul 21 01:29:37.843697 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:37.843617    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-jk945_4f2f808e-e307-42c0-8ccc-ea0a5b2bc855/payload-processing/0.log"
Jul 21 01:29:40.386919 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:40.386890    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-gd7hm_579833fa-c4b9-4f8b-8270-2967c6eb143f/migrator/0.log"
Jul 21 01:29:40.406089 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:40.406059    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-gd7hm_579833fa-c4b9-4f8b-8270-2967c6eb143f/graceful-termination/0.log"
Jul 21 01:29:41.326908 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:41.326873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:41.426480 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:41.426447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lblfv_602efe0c-543b-4a83-b637-633f5e4ce0e0/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:41.968365 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:41.968334    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xhsl_7d6a9e8c-f46f-4701-8b64-3e9682adba10/kube-multus-additional-cni-plugins/0.log"
Jul 21 01:29:41.989422 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:41.989392    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xhsl_7d6a9e8c-f46f-4701-8b64-3e9682adba10/egress-router-binary-copy/0.log"
Jul 21 01:29:42.011123 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.011090    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xhsl_7d6a9e8c-f46f-4701-8b64-3e9682adba10/cni-plugins/0.log"
Jul 21 01:29:42.030980 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.030952    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xhsl_7d6a9e8c-f46f-4701-8b64-3e9682adba10/bond-cni-plugin/0.log"
Jul 21 01:29:42.051546 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.051515    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xhsl_7d6a9e8c-f46f-4701-8b64-3e9682adba10/routeoverride-cni/0.log"
Jul 21 01:29:42.073767 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.073735    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xhsl_7d6a9e8c-f46f-4701-8b64-3e9682adba10/whereabouts-cni-bincopy/0.log"
Jul 21 01:29:42.093475 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.093447    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xhsl_7d6a9e8c-f46f-4701-8b64-3e9682adba10/whereabouts-cni/0.log"
Jul 21 01:29:42.314960 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.314937    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wjsmv_b0258730-45d0-4621-9e51-3e41710eb652/kube-multus/0.log"
Jul 21 01:29:42.383142 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.383111    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94k2f_fcf87c52-a489-48f9-b382-1e22ec687300/network-metrics-daemon/0.log"
Jul 21 01:29:42.403261 ip-10-0-138-241 kubenswrapper[2560]: I0721 01:29:42.403233    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94k2f_fcf87c52-a489-48f9-b382-1e22ec687300/kube-rbac-proxy/0.log"