Jul 31 12:13:11.123891 ip-10-0-138-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 12:13:11.123907 ip-10-0-138-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 12:13:11.123919 ip-10-0-138-37 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 12:13:11.124491 ip-10-0-138-37 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 12:13:21.316007 ip-10-0-138-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 31 12:13:21.316024 ip-10-0-138-37 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b2973c2efd104b2393688254c0ac25cf --
Jul 31 12:15:22.525512 ip-10-0-138-37 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 12:15:22.886367 ip-10-0-138-37 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 12:15:22.886367 ip-10-0-138-37 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 12:15:22.886367 ip-10-0-138-37 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 12:15:22.886367 ip-10-0-138-37 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 12:15:22.886367 ip-10-0-138-37 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 12:15:22.888804 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.888700    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 12:15:22.893233 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893210    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 12:15:22.893233 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893232    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893237    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893241    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893244    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893246    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893249    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893252    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893256    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893259    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893262    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893265    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893267    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893270    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893274    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893276    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893279    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893282    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893284    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893287    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893289    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 12:15:22.893316 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893293    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893296    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893298    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893301    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893303    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893307    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893311    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893314    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893317    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893320    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893322    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893325    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893328    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893331    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893334    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893336    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893339    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893341    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893344    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893346    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 12:15:22.893790 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893349    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893351    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893353    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893358    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893362    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893364    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893368    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893370    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893373    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893376    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893379    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893381    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893384    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893387    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893391    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893394    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893396    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893399    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893401    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 12:15:22.894310 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893404    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893408    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893412    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893415    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893418    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893421    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893424    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893428    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893431    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893433    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893436    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893439    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893442    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893444    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893447    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893449    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893452    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893454    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893457    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893460    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 12:15:22.894875 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893463    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893465    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893468    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893471    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893473    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893476    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893480    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893483    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893486    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893488    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893491    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893493    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893495    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893498    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893501    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893503    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893506    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893509    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 12:15:22.895692 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.893511    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 12:15:22.896572 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896554    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 12:15:22.896572 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896572    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 12:15:22.896572 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896576    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896579    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896583    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896588    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896593    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896596    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896599    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896602    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896606    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896609    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896611    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896614    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896617    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896620    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896622    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896625    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896633    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896636    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896638    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 12:15:22.896666 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896641    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896643    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896646    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896649    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896651    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896654    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896656    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896659    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896661    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896664    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896667    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896670    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896672    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896676    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896678    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896681    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896684    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896686    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896689    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896691    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 12:15:22.897273 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896693    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896696    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896699    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896701    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896704    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896706    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896710    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896714    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896717    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896722    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896724    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896727    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896729    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896733    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896737    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896740    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896742    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896745    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896748    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 12:15:22.897797 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896751    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896753    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896756    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896758    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896760    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896763    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896766    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896770    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896772    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896774    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896777    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896779    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896782    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896785    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896787    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896790    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896792    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896795    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896797    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896801    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 12:15:22.898311 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896804    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896806    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896809    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896812    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896815    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896818    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896821    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896824    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896826    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896829    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896831    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896834    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896837    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896839    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896842    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896844    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896846    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896849    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.896851    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897288    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 12:15:22.898810 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897294    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897297    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897300    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897303    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897307    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897311    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897314    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897317    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897320    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897323    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897326    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897329    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897332    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897334    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897337    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897340    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897343    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897346    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897349    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 12:15:22.899326 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897353    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897355    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897358    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897361    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897364    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897366    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897369    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897371    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897374    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897376    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897379    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897381    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897384    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897387    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897390    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897393    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897395    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897397    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897400    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897402    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 12:15:22.899808 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897405    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897408    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897410    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897413    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897416    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897418    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897421    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897424    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897426    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897429    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897432    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897434    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897438    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897440    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897443    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897447    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897450    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897453    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897456    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 12:15:22.900312 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897458    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897461    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897464    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897466    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897469    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897471    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897474    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897476    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897479    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897481    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897484    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897486    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897489    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897491    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897494    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897496    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897500    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897505    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897509    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897511    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 12:15:22.900787 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897514    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897517    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897519    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897524    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897527    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897529    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897532    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897534    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897537    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897539    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897542    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897544    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897547    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897549    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897552    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897555    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897557    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897560    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897562    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.897564    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 12:15:22.901324 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897642    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897650    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897656    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897661    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897665    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897669    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897673    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897677    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897681    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897684    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897688    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897691    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897694    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897697    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897700    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897703    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897707    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897710    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897723    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897726    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897729    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897732    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897736    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897744    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 12:15:22.901816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897747    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897751    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897754    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897757    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897760    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897763    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897767    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897770    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897774    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897777    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897780    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897783    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897786    2584 flags.go:64] FLAG: --enable-server="true"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897789    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897793    2584 flags.go:64] FLAG: --event-burst="100"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897796    2584 flags.go:64] FLAG: --event-qps="50"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897802    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897805    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897808    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897812    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897815    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897818    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897822    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897824    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897827    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 12:15:22.902412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897831    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897835    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897838    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897841    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897843    2584 flags.go:64] FLAG: --feature-gates=""
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897852    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897855    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897858    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897861    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897864    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897867    2584 flags.go:64] FLAG: --help="false"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897870    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-138-37.ec2.internal"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897873    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897876    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897879    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897882    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897886    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897889    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897892    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897894    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897897    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897900    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897903    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897908    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 31 12:15:22.903088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897911    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897913    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897916    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897919    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897922    2584 flags.go:64] FLAG: --lock-file=""
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897926    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897929    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897937    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897942    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897946    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897949    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897952    2584 flags.go:64] FLAG: --logging-format="text"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897955    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897959    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897962    2584 flags.go:64] FLAG: --manifest-url=""
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897964    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897969    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897972    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897976    2584 flags.go:64] FLAG: --max-pods="110"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897979    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897982    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897985    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897988    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897991    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897994    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 12:15:22.903734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.897997    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898005    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898008    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898011    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898014    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898017    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898023    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898027    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898030    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898033    2584 flags.go:64] FLAG: --port="10250"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898036    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898039    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-012587a849dc4fa0d"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898044    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898047    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898050    2584 flags.go:64] FLAG: --register-node="true"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898053    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898057    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898061    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898064    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898067    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898070    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898073    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898076    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898079    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898082    2584 flags.go:64] FLAG: --runonce="false"
Jul 31 12:15:22.904374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898085    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898088    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898091    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898093    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898096    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898099    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898102    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898105    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898108    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898111    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898113    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898116    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898119    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898121    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898127    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898133    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898136    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898139    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898144    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898148    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898151    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898173    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898177    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898180    2584 flags.go:64] FLAG: --v="2"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898185    2584 flags.go:64] FLAG: --version="false"
Jul 31 12:15:22.905050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898190    2584 flags.go:64] FLAG: --vmodule=""
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898193    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.898197    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898318    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898323    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898326    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898329    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898331    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898334    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898336    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898339    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898341    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898344    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898346    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898349    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898352    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898354    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898357    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898359    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898362    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 12:15:22.905699 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898364    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898369    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898372    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898374    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898377    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898379    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898383    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898386    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898388    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898391    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898393    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898396    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898400    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898404    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898407    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898409    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898412    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898415    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898418    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898421    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 12:15:22.906207 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898423    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898426    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898428    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898431    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898434    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898436    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898439    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898442    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898444    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898447    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898450    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898453    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898457    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898461    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898464    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898467    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898469    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898473    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898477    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 12:15:22.906700 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898480    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898483    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898486    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898489    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898492    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898495    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898497    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898500    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898503    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898505    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898508    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898510    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898513    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898516    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898518    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898521    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898525    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898528    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898531    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898533    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 12:15:22.907201 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898536    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898538    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898541    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898543    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898546    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898548    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898552    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898555    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898558    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898560    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898562    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898567    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898569    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898571    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898574    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898577    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898579    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898582    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898584    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 12:15:22.907703 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898587    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898590    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898592    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.898595    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.899257    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.906402    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.906421    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.906442    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.906449    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906507    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906512    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906515    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906519    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906522    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 12:15:22.908230 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906525    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906527    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906530    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906533    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906535    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906538    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906540    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906543    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906546    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906550    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906554    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906558    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906560    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906563    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906565    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906568    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906570    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906573    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906576    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906578    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 12:15:22.908590 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906581    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906583    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906586    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906589    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906594    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906596    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906599    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906602    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906605    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906608    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906610    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906612    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906615    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906618    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906621    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906623    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906626    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906628    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906632    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 12:15:22.909083 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906636    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906639    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906642    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906645    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906648    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906650    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906653    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906656    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906659    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906661    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906664    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906667    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906670    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906672    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906675    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906678    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906681    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906684    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906688    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906690    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 12:15:22.909651 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906693    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906695    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906698    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906700    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906703    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906706    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906709    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906711    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906714    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906718    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906720    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906723    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906726    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906728    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906730    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906733    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906736    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906738    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906741    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906743    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 12:15:22.910142 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906746    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906749    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906753    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906756    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906759    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906762    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906764    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906767    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906770    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906774    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906777    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906780    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906783    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906785    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906788    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 12:15:22.910652 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.906793    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906915    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906920    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906924    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906927    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906931    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906935    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906938    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906941    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906944    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906947    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906950    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906953    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906956    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906958    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906961    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906964    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906966    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906969    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 12:15:22.911029 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906971    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906975    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906977    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906980    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906984    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906987    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906989    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906993    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906995    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.906998    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907001    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907004    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907007    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907009    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907012    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907014    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907017    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907019    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907022    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907025    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 12:15:22.911519 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907027    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907030    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907032    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907035    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907038    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907040    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907043    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907045    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907048    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907051    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907054    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907056    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907058    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907061    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907064    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907067    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907069    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907072    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907075    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907078    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 12:15:22.912003 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907081    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907083    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907086    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907089    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907092    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907095    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907097    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907100    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907102    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907104    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907107    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907110    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907112    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907115    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907117    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907120    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907122    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907125    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907127    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907130    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 12:15:22.912514 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907132    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907135    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907138    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907140    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907143    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907145    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907148    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907151    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907169    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907174    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907177    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907180    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907182    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907185    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907188    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907190    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907194    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907196    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907200    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907204    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 12:15:22.912980 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:22.907207    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 12:15:22.913484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.907212    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 12:15:22.913484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.907341    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 12:15:22.913484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.910492    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 12:15:22.913484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.912069    2584 server.go:1019] "Starting client certificate rotation"
Jul 31 12:15:22.913484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.912186    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 12:15:22.913484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.912951    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 12:15:22.914338 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.914322    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 12:15:22.918229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.918187    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 12:15:22.926844 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.926823    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 31 12:15:22.928939 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.928920    2584 log.go:25] "Validated CRI v1 image API"
Jul 31 12:15:22.931475 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.931451    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 12:15:22.933778 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.933756    2584 fs.go:135] Filesystem UUIDs: map[08bd0589-d88e-42b4-9181-53c91fe3f257:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 96ca417b-179f-4cf8-a310-ec148def4c26:/dev/nvme0n1p3]
Jul 31 12:15:22.933861 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.933777    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 12:15:22.938868 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.938741    2584 manager.go:216] Machine: {Timestamp:2026-07-31 12:15:22.937546799 +0000 UTC m=+0.301528570 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2944723 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d8c6ace79453784868f4465eae4d3 SystemUUID:ec2d8c6a-ce79-4537-8486-8f4465eae4d3 BootID:b2973c2e-fd10-4b23-9368-8254c0ac25cf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:8c:b9:90:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:8c:b9:90:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:96:8c:6f:d5:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 12:15:22.938868 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.938865    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 12:15:22.938983 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.938955    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 12:15:22.942147 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.942117    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 12:15:22.942307 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.942149    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 12:15:22.942706 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.942691    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 12:15:22.942764 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.942752    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 12:15:22.942811 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.942770    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 12:15:22.942811 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.942782    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 12:15:22.943283 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.943271    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 12:15:22.944438 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.944426    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 12:15:22.948415 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.948400    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 12:15:22.948550 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.948540    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 12:15:22.948588 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.948576    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 12:15:22.948622 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.948593    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 12:15:22.948622 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.948608    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 12:15:22.948622 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.948620    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 31 12:15:22.948704 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.948630    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 12:15:22.949048 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.949036    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 12:15:22.949121 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.949055    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 12:15:22.951241 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.951223    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 12:15:22.952814 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.952799    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 12:15:22.952860 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.952831    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 12:15:22.954137 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954125    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 12:15:22.954202 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954143    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 12:15:22.954202 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954150    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 12:15:22.954202 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954171    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 12:15:22.954202 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954185    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 12:15:22.954202 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954191    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 12:15:22.954202 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954199    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 12:15:22.954202 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954204    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 12:15:22.954391 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954211    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 12:15:22.954391 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954216    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 12:15:22.954391 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954230    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 12:15:22.954391 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.954236    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 12:15:22.955599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.955586    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 12:15:22.955599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.955599    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 12:15:22.959142 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.959114    2584 server.go:1268] "Started kubelet"
Jul 31 12:15:22.959272 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.959217    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 12:15:22.959350 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.959301    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 12:15:22.959803 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.959776    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 12:15:22.960248 ip-10-0-138-37 systemd[1]: Started Kubernetes Kubelet.
Jul 31 12:15:22.960384 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.960310    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 12:15:22.960384 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.960364    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 12:15:22.962339 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.962295    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 12:15:22.962601 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.962578    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 12:15:22.964046 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.964023    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 12:15:22.964657 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.964631    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 12:15:22.966576 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.966556    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmmdv"
Jul 31 12:15:22.969137 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.968252    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-37.ec2.internal.18c75ee6df64807f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-37.ec2.internal,UID:ip-10-0-138-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-37.ec2.internal,},FirstTimestamp:2026-07-31 12:15:22.959085695 +0000 UTC m=+0.323067466,LastTimestamp:2026-07-31 12:15:22.959085695 +0000 UTC m=+0.323067466,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-37.ec2.internal,}"
Jul 31 12:15:22.969779 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.969758    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 12:15:22.969779 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.969759    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 12:15:22.969918 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.969881    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:22.970435 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.970405    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 12:15:22.970435 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.970437    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 12:15:22.970599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.970424    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 12:15:22.970599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.970569    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 12:15:22.970599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.970579    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 12:15:22.970959 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.970946    2584 factory.go:153] Registering CRI-O factory
Jul 31 12:15:22.970959 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.970961    2584 factory.go:223] Registration of the crio container factory successfully
Jul 31 12:15:22.971042 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.971006    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 12:15:22.971042 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.971013    2584 factory.go:55] Registering systemd factory
Jul 31 12:15:22.971042 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.971018    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 31 12:15:22.971042 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.971035    2584 factory.go:103] Registering Raw factory
Jul 31 12:15:22.971141 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.971045    2584 manager.go:1196] Started watching for new ooms in manager
Jul 31 12:15:22.971555 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.971539    2584 manager.go:349] Starting recovery of all containers
Jul 31 12:15:22.974827 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.974741    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmmdv"
Jul 31 12:15:22.975697 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.975655    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 12:15:22.975845 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.975799    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 12:15:22.981914 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.981779    2584 manager.go:354] Recovery completed
Jul 31 12:15:22.983768 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.983730    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 31 12:15:22.987077 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.987062    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 12:15:22.988897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.988882    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 12:15:22.988963 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.988912    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 12:15:22.988963 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.988923    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientPID"
Jul 31 12:15:22.989558 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.989541    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 12:15:22.989558 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.989554    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 12:15:22.989700 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.989569    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 12:15:22.989700 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.989571    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 12:15:22.990338 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.990322    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 12:15:22.990412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.990353    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 12:15:22.990412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.990367    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientPID"
Jul 31 12:15:22.990966 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:22.990879    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-37.ec2.internal.18c75ee6e12b630d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-37.ec2.internal,UID:ip-10-0-138-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-37.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-37.ec2.internal,},FirstTimestamp:2026-07-31 12:15:22.988897037 +0000 UTC m=+0.352878811,LastTimestamp:2026-07-31 12:15:22.988897037 +0000 UTC m=+0.352878811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-37.ec2.internal,}"
Jul 31 12:15:22.991220 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.991209    2584 policy_none.go:49] "None policy: Start"
Jul 31 12:15:22.991284 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.991227    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 12:15:22.991284 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.991237    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 12:15:22.992241 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:22.992228    2584 policy_none.go:47] "Start"
Jul 31 12:15:23.029901 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.029882    2584 manager.go:337] "Starting Device Plugin manager"
Jul 31 12:15:23.030017 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.029945    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 12:15:23.030017 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.029960    2584 server.go:87] "Starting device plugin registration server"
Jul 31 12:15:23.030325 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.030309    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 12:15:23.030422 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.030327    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 12:15:23.030422 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.030415    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 12:15:23.030522 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.030504    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 12:15:23.030522 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.030514    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 12:15:23.031089 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.031068    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 12:15:23.031176 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.031120    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.130666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.130625    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 12:15:23.131803 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.131772    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 12:15:23.131920 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.131817    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 12:15:23.131920 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.131830    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientPID"
Jul 31 12:15:23.131920 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.131860    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.139650 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.139591    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.139650 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.139619    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-37.ec2.internal\": node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.155877 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.155848    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.157998 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.157969    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 12:15:23.159600 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.159578    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 12:15:23.159707 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.159623    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 12:15:23.159707 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.159651    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 12:15:23.159707 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.159693    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 12:15:23.161886 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.161857    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 12:15:23.256520 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.256469    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.260643 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.260619    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal"]
Jul 31 12:15:23.260712 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.260698    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 12:15:23.262640 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.262617    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 12:15:23.262745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.262653    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 12:15:23.262745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.262668    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientPID"
Jul 31 12:15:23.263821 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.263809    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 12:15:23.263962 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.263949    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.263998 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.263980    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 12:15:23.265915 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.265894    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 12:15:23.266013 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.265921    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 12:15:23.266013 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.265932    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientPID"
Jul 31 12:15:23.266013 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.265905    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 12:15:23.266013 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.266001    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 12:15:23.266218 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.266016    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientPID"
Jul 31 12:15:23.267281 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.267266    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.267360 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.267295    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 12:15:23.268059 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.268040    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 12:15:23.268176 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.268076    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 12:15:23.268176 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.268091    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeHasSufficientPID"
Jul 31 12:15:23.272088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.272070    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54a85cf51d5501222ef690dfbb2ff6f9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-37.ec2.internal\" (UID: \"54a85cf51d5501222ef690dfbb2ff6f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.272151 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.272095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5755871ed28212fcdc8815ae10f1f907-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal\" (UID: \"5755871ed28212fcdc8815ae10f1f907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.272151 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.272116    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5755871ed28212fcdc8815ae10f1f907-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal\" (UID: \"5755871ed28212fcdc8815ae10f1f907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.297991 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.297964    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-37.ec2.internal\" not found" node="ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.302373 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.302352    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-37.ec2.internal\" not found" node="ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.357190 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.357139    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.372584 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.372554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5755871ed28212fcdc8815ae10f1f907-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal\" (UID: \"5755871ed28212fcdc8815ae10f1f907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.372663 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.372620    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5755871ed28212fcdc8815ae10f1f907-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal\" (UID: \"5755871ed28212fcdc8815ae10f1f907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.372663 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.372648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5755871ed28212fcdc8815ae10f1f907-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal\" (UID: \"5755871ed28212fcdc8815ae10f1f907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.372733 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.372675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54a85cf51d5501222ef690dfbb2ff6f9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-37.ec2.internal\" (UID: \"54a85cf51d5501222ef690dfbb2ff6f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.372733 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.372716    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54a85cf51d5501222ef690dfbb2ff6f9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-37.ec2.internal\" (UID: \"54a85cf51d5501222ef690dfbb2ff6f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.372805 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.372741    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5755871ed28212fcdc8815ae10f1f907-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal\" (UID: \"5755871ed28212fcdc8815ae10f1f907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.457723 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.457637    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.558202 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.558145    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.602286 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.602255    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.606169 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.606150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:23.659232 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.659188    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.766316 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.766235    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.857297 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.857256    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 12:15:23.866730 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.866697    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.911849 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.911817    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 12:15:23.912501 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.912031    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 12:15:23.912501 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.912059    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 12:15:23.967893 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:23.967857    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:23.979889 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.979853    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 12:10:23 +0000 UTC" deadline="2028-03-21 22:41:06.585159146 +0000 UTC"
Jul 31 12:15:23.979889 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:23.979884    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14386h25m42.605278498s"
Jul 31 12:15:24.068733 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:24.068622    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:24.169402 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:24.169365    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:24.235844 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:24.235800    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5755871ed28212fcdc8815ae10f1f907.slice/crio-e2f68a9fb3b8597dbba6f918acb83332938ebc43bf7fa5243c2ed013df38948d WatchSource:0}: Error finding container e2f68a9fb3b8597dbba6f918acb83332938ebc43bf7fa5243c2ed013df38948d: Status 404 returned error can't find the container with id e2f68a9fb3b8597dbba6f918acb83332938ebc43bf7fa5243c2ed013df38948d
Jul 31 12:15:24.236251 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:24.236229    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a85cf51d5501222ef690dfbb2ff6f9.slice/crio-ef66c27f3b95a05a14733a896abe3c7084458c009ea68c43c20ba4b1a420a9b7 WatchSource:0}: Error finding container ef66c27f3b95a05a14733a896abe3c7084458c009ea68c43c20ba4b1a420a9b7: Status 404 returned error can't find the container with id ef66c27f3b95a05a14733a896abe3c7084458c009ea68c43c20ba4b1a420a9b7
Jul 31 12:15:24.241979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.241961    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 12:15:24.269891 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:24.269849    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-37.ec2.internal\" not found"
Jul 31 12:15:24.272423 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.272402    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 12:15:24.283486 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.283461    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 12:15:24.374492 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.374409    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:24.387516 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.387477    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 12:15:24.389393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.388669    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal"
Jul 31 12:15:24.397225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.397195    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 12:15:24.951452 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.951415    2584 apiserver.go:52] "Watching apiserver"
Jul 31 12:15:24.959897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.959680    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 12:15:24.960127 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.960101    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mbflb","kube-system/konnectivity-agent-fmd8k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf","openshift-dns/node-resolver-nnkbg","openshift-image-registry/node-ca-9b8wp","openshift-multus/multus-additional-cni-plugins-hcr66","openshift-multus/network-metrics-daemon-zz2qs","openshift-network-diagnostics/network-check-target-cnhmr","kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qdp9r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal","openshift-multus/multus-6w8bq","openshift-network-operator/iptables-alerter-hnlq8","openshift-ovn-kubernetes/ovnkube-node-6hwtx"]
Jul 31 12:15:24.961843 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.961806    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:24.961973 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:24.961908    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:24.963025 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.963000    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:24.964533 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.964511    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.966080 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.965653    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 12:15:24.966080 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.965699    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nkktr\""
Jul 31 12:15:24.966080 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.965927    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 12:15:24.966080 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.965945    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 12:15:24.966354 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.966189    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:24.966819 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.966777    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 12:15:24.966819 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.966808    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dgj52\""
Jul 31 12:15:24.967022 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.967003    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 12:15:24.967664 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.967647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:24.968383 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.968364    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 12:15:24.968808 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.968786    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:24.969395 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.969377    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 12:15:24.969587 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.969564    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tl586\""
Jul 31 12:15:24.970037 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.970015    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.970307    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.970644    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9zhn4\""
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.970952    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.971196    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.971408    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kmrbj\""
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.971460    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.971562    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.971818    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.972356    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:24.972604 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:24.972441    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:24.973592 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.973569    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:24.974482 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.974457    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 12:15:24.974627 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.974566    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 12:15:24.974844 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.974813    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 12:15:24.974925 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.974841    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 12:15:24.974925 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.974898    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 12:15:24.975035 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.974900    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5bg96\""
Jul 31 12:15:24.976735 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.976714    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:24.977072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.977055    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 12:15:24.977785 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.977762    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 12:15:24.978043 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.978028    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fscsb\""
Jul 31 12:15:24.978231 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.978215    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 12:15:24.979569 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.979545    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 12:15:24.979667 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.979652    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nktfx\""
Jul 31 12:15:24.981169 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.981116    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.981293 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.981192    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-modprobe-d\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.982346 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982316    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:24.982438 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:24.982411    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982736    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysconfig\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982798    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982832    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54lks\" (UniqueName: \"kubernetes.io/projected/7e0270da-c956-4820-aa42-c274b29395e3-kube-api-access-54lks\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982861    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqb2w\" (UniqueName: \"kubernetes.io/projected/ada61769-047f-4df3-9da9-4ea29b50364a-kube-api-access-cqb2w\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcqs6\" (UniqueName: \"kubernetes.io/projected/557922f6-6f9d-4a00-92ce-71d8452b6645-kube-api-access-tcqs6\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982932    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-var-lib-kubelet\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.982973    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-host\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983016    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ce66c0-6888-41e7-9b10-7cb2183022c1-tmp\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983052    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983087    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysctl-d\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983145 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-lib-modules\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983198    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4qr6\" (UniqueName: \"kubernetes.io/projected/82ce66c0-6888-41e7-9b10-7cb2183022c1-kube-api-access-c4qr6\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983228    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/065bcf50-4b01-4c1e-8250-057318bb5c65-agent-certs\") pod \"konnectivity-agent-fmd8k\" (UID: \"065bcf50-4b01-4c1e-8250-057318bb5c65\") " pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/065bcf50-4b01-4c1e-8250-057318bb5c65-konnectivity-ca\") pod \"konnectivity-agent-fmd8k\" (UID: \"065bcf50-4b01-4c1e-8250-057318bb5c65\") " pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983303    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e84e8374-1010-4349-94f2-c25277188f41-dbus\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-sys\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983348    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e0270da-c956-4820-aa42-c274b29395e3-hosts-file\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983365    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0270da-c956-4820-aa42-c274b29395e3-tmp-dir\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983381    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnhg\" (UniqueName: \"kubernetes.io/projected/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-kube-api-access-7qnhg\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983402    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-system-cni-dir\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983417    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-os-release\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983483    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-kubernetes\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983514    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-systemd\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983544    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ada61769-047f-4df3-9da9-4ea29b50364a-iptables-alerter-script\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ada61769-047f-4df3-9da9-4ea29b50364a-host-slash\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983598    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-cnibin\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.983893 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-run\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df889202-3bef-48b6-89d0-1efdda4100a1-host\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983670    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df889202-3bef-48b6-89d0-1efdda4100a1-serviceca\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk45z\" (UniqueName: \"kubernetes.io/projected/df889202-3bef-48b6-89d0-1efdda4100a1-kube-api-access-lk45z\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e84e8374-1010-4349-94f2-c25277188f41-kubelet-config\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983794    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983817    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysctl-conf\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-tuned\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:24.984666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.983943    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:24.986170 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.986148    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 12:15:24.986734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.986714    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 12:15:24.986886 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.986866    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 12:15:24.986943 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.986924    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 12:15:24.988085 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.988056    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 12:15:24.988206 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.988055    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jn95k\""
Jul 31 12:15:24.988206 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.988148    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 12:15:24.988368 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:24.988326    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 12:15:25.007240 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.007170    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l8qhh"
Jul 31 12:15:25.017831 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.017804    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l8qhh"
Jul 31 12:15:25.072294 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.072259    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 12:15:25.084036 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084002    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e84e8374-1010-4349-94f2-c25277188f41-dbus\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:25.084036 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084044    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e0270da-c956-4820-aa42-c274b29395e3-hosts-file\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-socket-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084143    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-hostroot\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084172    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-system-cni-dir\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-os-release\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084246    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-systemd\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084272    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-systemd-units\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.084300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df889202-3bef-48b6-89d0-1efdda4100a1-host\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk45z\" (UniqueName: \"kubernetes.io/projected/df889202-3bef-48b6-89d0-1efdda4100a1-kube-api-access-lk45z\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e84e8374-1010-4349-94f2-c25277188f41-dbus\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084350    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-var-lib-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084421    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e0270da-c956-4820-aa42-c274b29395e3-hosts-file\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-socket-dir-parent\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084477    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-system-cni-dir\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084541    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-os-release\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084581    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df889202-3bef-48b6-89d0-1efdda4100a1-host\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084630    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-multus-certs\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysctl-conf\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084704    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-cni-netd\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084730    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fe447c6-fb71-44fb-9791-d81c06899e5c-cni-binary-copy\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.084753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084754    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-conf-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-systemd\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysctl-conf\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.084961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysconfig\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085001    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-kubelet\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085029    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-cni-bin\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085084    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysconfig\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085130    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-ovn\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-var-lib-kubelet\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-host\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085223    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-var-lib-kubelet\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085291    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-host\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085321    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ce66c0-6888-41e7-9b10-7cb2183022c1-tmp\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085383    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovn-node-metrics-cert\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.085433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-cnibin\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.085990 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085711    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.085442    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-os-release\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-kubelet\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-daemon-config\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088872    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-systemd\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-netns\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-sys\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088949    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0270da-c956-4820-aa42-c274b29395e3-tmp-dir\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.088980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnhg\" (UniqueName: \"kubernetes.io/projected/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-kube-api-access-7qnhg\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-log-socket\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089042    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovnkube-script-lib\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089080    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-kubernetes\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089115    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovnkube-config\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089188    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq48f\" (UniqueName: \"kubernetes.io/projected/647ff5d9-7c76-4167-89f5-72506f3c4b83-kube-api-access-cq48f\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn4zg\" (UniqueName: \"kubernetes.io/projected/a332db7f-14ef-4ab3-8740-035dd40db79e-kube-api-access-kn4zg\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.092225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-cni-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089312    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-k8s-cni-cncf-io\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089352    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ada61769-047f-4df3-9da9-4ea29b50364a-iptables-alerter-script\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ada61769-047f-4df3-9da9-4ea29b50364a-host-slash\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-cnibin\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-run\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df889202-3bef-48b6-89d0-1efdda4100a1-serviceca\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-run-ovn-kubernetes\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e84e8374-1010-4349-94f2-c25277188f41-kubelet-config\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089603    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089634    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-tuned\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089682    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-sys-fs\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-etc-kubernetes\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-modprobe-d\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.093198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-slash\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-run-netns\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-etc-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089863    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-node-log\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089893    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-device-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089946    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.089981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54lks\" (UniqueName: \"kubernetes.io/projected/7e0270da-c956-4820-aa42-c274b29395e3-kube-api-access-54lks\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.090009    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.090041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-env-overrides\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.090073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-system-cni-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.090103    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-run\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.090105    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-cni-multus\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.090698    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df889202-3bef-48b6-89d0-1efdda4100a1-serviceca\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.090877    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.090942    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:25.590925509 +0000 UTC m=+2.954907268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.091030    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e84e8374-1010-4349-94f2-c25277188f41-kubelet-config\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:25.094088 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.091298    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.091364    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret podName:e84e8374-1010-4349-94f2-c25277188f41 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:25.591344215 +0000 UTC m=+2.955325991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret") pod "global-pull-secret-syncer-mbflb" (UID: "e84e8374-1010-4349-94f2-c25277188f41") : object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.091719    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-sys\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.091827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0270da-c956-4820-aa42-c274b29395e3-tmp-dir\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092343    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092471    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-kubernetes\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092552    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092629    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/557922f6-6f9d-4a00-92ce-71d8452b6645-cnibin\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092671    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ada61769-047f-4df3-9da9-4ea29b50364a-iptables-alerter-script\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092703    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ada61769-047f-4df3-9da9-4ea29b50364a-host-slash\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqb2w\" (UniqueName: \"kubernetes.io/projected/ada61769-047f-4df3-9da9-4ea29b50364a-kube-api-access-cqb2w\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqs6\" (UniqueName: \"kubernetes.io/projected/557922f6-6f9d-4a00-92ce-71d8452b6645-kube-api-access-tcqs6\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.092863    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-modprobe-d\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093037    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-registration-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093087    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-cni-bin\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.095001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf49w\" (UniqueName: \"kubernetes.io/projected/2fe447c6-fb71-44fb-9791-d81c06899e5c-kube-api-access-tf49w\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysctl-d\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093245    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-lib-modules\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093321    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-sysctl-d\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82ce66c0-6888-41e7-9b10-7cb2183022c1-lib-modules\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4qr6\" (UniqueName: \"kubernetes.io/projected/82ce66c0-6888-41e7-9b10-7cb2183022c1-kube-api-access-c4qr6\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/065bcf50-4b01-4c1e-8250-057318bb5c65-agent-certs\") pod \"konnectivity-agent-fmd8k\" (UID: \"065bcf50-4b01-4c1e-8250-057318bb5c65\") " pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.093517    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/557922f6-6f9d-4a00-92ce-71d8452b6645-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.095030    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/065bcf50-4b01-4c1e-8250-057318bb5c65-konnectivity-ca\") pod \"konnectivity-agent-fmd8k\" (UID: \"065bcf50-4b01-4c1e-8250-057318bb5c65\") " pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.095059    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk45z\" (UniqueName: \"kubernetes.io/projected/df889202-3bef-48b6-89d0-1efdda4100a1-kube-api-access-lk45z\") pod \"node-ca-9b8wp\" (UID: \"df889202-3bef-48b6-89d0-1efdda4100a1\") " pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:25.095837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.095690    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/065bcf50-4b01-4c1e-8250-057318bb5c65-konnectivity-ca\") pod \"konnectivity-agent-fmd8k\" (UID: \"065bcf50-4b01-4c1e-8250-057318bb5c65\") " pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:25.097719 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.097690    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/065bcf50-4b01-4c1e-8250-057318bb5c65-agent-certs\") pod \"konnectivity-agent-fmd8k\" (UID: \"065bcf50-4b01-4c1e-8250-057318bb5c65\") " pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:25.097987 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.097963    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82ce66c0-6888-41e7-9b10-7cb2183022c1-etc-tuned\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.098992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.098967    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ce66c0-6888-41e7-9b10-7cb2183022c1-tmp\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.101723 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.101697    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54lks\" (UniqueName: \"kubernetes.io/projected/7e0270da-c956-4820-aa42-c274b29395e3-kube-api-access-54lks\") pod \"node-resolver-nnkbg\" (UID: \"7e0270da-c956-4820-aa42-c274b29395e3\") " pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:25.102062 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.102039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqs6\" (UniqueName: \"kubernetes.io/projected/557922f6-6f9d-4a00-92ce-71d8452b6645-kube-api-access-tcqs6\") pod \"multus-additional-cni-plugins-hcr66\" (UID: \"557922f6-6f9d-4a00-92ce-71d8452b6645\") " pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.102725 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.102701    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqb2w\" (UniqueName: \"kubernetes.io/projected/ada61769-047f-4df3-9da9-4ea29b50364a-kube-api-access-cqb2w\") pod \"iptables-alerter-hnlq8\" (UID: \"ada61769-047f-4df3-9da9-4ea29b50364a\") " pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:25.104093 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.104066    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnhg\" (UniqueName: \"kubernetes.io/projected/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-kube-api-access-7qnhg\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:25.104323 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.104301    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4qr6\" (UniqueName: \"kubernetes.io/projected/82ce66c0-6888-41e7-9b10-7cb2183022c1-kube-api-access-c4qr6\") pod \"tuned-qdp9r\" (UID: \"82ce66c0-6888-41e7-9b10-7cb2183022c1\") " pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.168876 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.168808    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal" event={"ID":"54a85cf51d5501222ef690dfbb2ff6f9","Type":"ContainerStarted","Data":"ef66c27f3b95a05a14733a896abe3c7084458c009ea68c43c20ba4b1a420a9b7"}
Jul 31 12:15:25.170488 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.170456    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal" event={"ID":"5755871ed28212fcdc8815ae10f1f907","Type":"ContainerStarted","Data":"e2f68a9fb3b8597dbba6f918acb83332938ebc43bf7fa5243c2ed013df38948d"}
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195493    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195535    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-socket-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-hostroot\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-systemd-units\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-var-lib-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-socket-dir-parent\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195701    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-multus-certs\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-cni-netd\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fe447c6-fb71-44fb-9791-d81c06899e5c-cni-binary-copy\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-conf-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-kubelet\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-cni-bin\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-ovn\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195860    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovn-node-metrics-cert\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195886    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-cnibin\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195905    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-os-release\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.198481 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195920    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-kubelet\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195936    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-daemon-config\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-systemd\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.195999    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-netns\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196017    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-log-socket\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovnkube-script-lib\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovnkube-config\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196155    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq48f\" (UniqueName: \"kubernetes.io/projected/647ff5d9-7c76-4167-89f5-72506f3c4b83-kube-api-access-cq48f\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196195    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn4zg\" (UniqueName: \"kubernetes.io/projected/a332db7f-14ef-4ab3-8740-035dd40db79e-kube-api-access-kn4zg\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196221    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-cni-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-k8s-cni-cncf-io\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196262    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196326    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-k8s-cni-cncf-io\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-run-ovn-kubernetes\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-sys-fs\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-conf-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.199599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-etc-kubernetes\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-slash\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-sys-fs\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-run-netns\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-etc-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-node-log\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-device-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196617    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-socket-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196623    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196691    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-hostroot\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196740    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-env-overrides\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196753    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fe447c6-fb71-44fb-9791-d81c06899e5c-cni-binary-copy\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-system-cni-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-cni-multus\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-registration-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-cni-bin\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.200460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196900    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf49w\" (UniqueName: \"kubernetes.io/projected/2fe447c6-fb71-44fb-9791-d81c06899e5c-kube-api-access-tf49w\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196958    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-kubelet\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197003    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-cni-bin\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197032    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-ovn\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197213    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-systemd-units\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-var-lib-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197346    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-socket-dir-parent\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197374    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-cnibin\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-multus-certs\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197421    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-kubelet\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-os-release\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197503    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-run-systemd\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197558    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-cni-netd\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197600    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-run-netns\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197641    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-log-socket\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197681    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-cni-multus\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197736    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-system-cni-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197925    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-env-overrides\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.197991    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-registration-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-host-var-lib-cni-bin\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-cni-dir\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198108    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fe447c6-fb71-44fb-9791-d81c06899e5c-etc-kubernetes\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198147    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-slash\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198210    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-run-netns\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-etc-openvswitch\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.196495    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198308    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-node-log\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198325    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovnkube-script-lib\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198357    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-device-dir\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198405    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/647ff5d9-7c76-4167-89f5-72506f3c4b83-host-run-ovn-kubernetes\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198449    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a332db7f-14ef-4ab3-8740-035dd40db79e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198520    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovnkube-config\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.198750    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fe447c6-fb71-44fb-9791-d81c06899e5c-multus-daemon-config\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.201697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.200668    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/647ff5d9-7c76-4167-89f5-72506f3c4b83-ovn-node-metrics-cert\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.202868 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.202833    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 12:15:25.202868 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.202861    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 12:15:25.203066 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.202876    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mbxdr for pod openshift-network-diagnostics/network-check-target-cnhmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:25.203066 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.202952    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr podName:ae6ab437-1a4b-465b-95b8-c78ae61037ea nodeName:}" failed. No retries permitted until 2026-07-31 12:15:25.702933057 +0000 UTC m=+3.066914835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mbxdr" (UniqueName: "kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr") pod "network-check-target-cnhmr" (UID: "ae6ab437-1a4b-465b-95b8-c78ae61037ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:25.206530 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.206457    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf49w\" (UniqueName: \"kubernetes.io/projected/2fe447c6-fb71-44fb-9791-d81c06899e5c-kube-api-access-tf49w\") pod \"multus-6w8bq\" (UID: \"2fe447c6-fb71-44fb-9791-d81c06899e5c\") " pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.215198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.215166    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn4zg\" (UniqueName: \"kubernetes.io/projected/a332db7f-14ef-4ab3-8740-035dd40db79e-kube-api-access-kn4zg\") pod \"aws-ebs-csi-driver-node-6rqdf\" (UID: \"a332db7f-14ef-4ab3-8740-035dd40db79e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.216913 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.216882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq48f\" (UniqueName: \"kubernetes.io/projected/647ff5d9-7c76-4167-89f5-72506f3c4b83-kube-api-access-cq48f\") pod \"ovnkube-node-6hwtx\" (UID: \"647ff5d9-7c76-4167-89f5-72506f3c4b83\") " pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.280952 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.280903    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnlq8"
Jul 31 12:15:25.287674 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.287594    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qdp9r"
Jul 31 12:15:25.298244 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.297726    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nnkbg"
Jul 31 12:15:25.299208 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:25.299128    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ce66c0_6888_41e7_9b10_7cb2183022c1.slice/crio-d08caa84b43dd7b0aae249028d3362b38698eb242211e2b4a9ef745cf8ead1b3 WatchSource:0}: Error finding container d08caa84b43dd7b0aae249028d3362b38698eb242211e2b4a9ef745cf8ead1b3: Status 404 returned error can't find the container with id d08caa84b43dd7b0aae249028d3362b38698eb242211e2b4a9ef745cf8ead1b3
Jul 31 12:15:25.303567 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.303541    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9b8wp"
Jul 31 12:15:25.308407 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:25.308376    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada61769_047f_4df3_9da9_4ea29b50364a.slice/crio-5b186ab24f22a26a3134a3be3b70085e7b52694ea90eebc4eee58c6169d65516 WatchSource:0}: Error finding container 5b186ab24f22a26a3134a3be3b70085e7b52694ea90eebc4eee58c6169d65516: Status 404 returned error can't find the container with id 5b186ab24f22a26a3134a3be3b70085e7b52694ea90eebc4eee58c6169d65516
Jul 31 12:15:25.311357 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.311326    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:25.319905 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:25.319866    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0270da_c956_4820_aa42_c274b29395e3.slice/crio-a1e761d63331038f1658a90d97ee02c22f2451b9ebd822c800e76b4f5978f3a3 WatchSource:0}: Error finding container a1e761d63331038f1658a90d97ee02c22f2451b9ebd822c800e76b4f5978f3a3: Status 404 returned error can't find the container with id a1e761d63331038f1658a90d97ee02c22f2451b9ebd822c800e76b4f5978f3a3
Jul 31 12:15:25.320072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.320054    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcr66"
Jul 31 12:15:25.326494 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.326466    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf"
Jul 31 12:15:25.326952 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.326800    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 12:15:25.335414 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.335372    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6w8bq"
Jul 31 12:15:25.340506 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.340477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:25.601685 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.601594    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:25.601685 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.601665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:25.601932 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.601772    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:25.601932 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.601783    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:25.601932 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.601882    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret podName:e84e8374-1010-4349-94f2-c25277188f41 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:26.601848927 +0000 UTC m=+3.965830695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret") pod "global-pull-secret-syncer-mbflb" (UID: "e84e8374-1010-4349-94f2-c25277188f41") : object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:25.602106 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.601934    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:26.601913399 +0000 UTC m=+3.965895176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:25.703309 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.703268    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:25.703525 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.703491    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 12:15:25.703525 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.703524    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 12:15:25.703746 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.703542    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mbxdr for pod openshift-network-diagnostics/network-check-target-cnhmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:25.703746 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:25.703630    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr podName:ae6ab437-1a4b-465b-95b8-c78ae61037ea nodeName:}" failed. No retries permitted until 2026-07-31 12:15:26.703607125 +0000 UTC m=+4.067588889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbxdr" (UniqueName: "kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr") pod "network-check-target-cnhmr" (UID: "ae6ab437-1a4b-465b-95b8-c78ae61037ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:25.719238 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:25.719173    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 12:15:26.019867 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.019754    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 12:10:25 +0000 UTC" deadline="2028-01-13 09:40:36.01166899 +0000 UTC"
Jul 31 12:15:26.019867 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.019800    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12741h25m9.99187408s"
Jul 31 12:15:26.160590 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.160547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:26.160760 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.160673    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:26.161080 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.161063    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:26.161198 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.161156    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:26.179884 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.179837    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nnkbg" event={"ID":"7e0270da-c956-4820-aa42-c274b29395e3","Type":"ContainerStarted","Data":"a1e761d63331038f1658a90d97ee02c22f2451b9ebd822c800e76b4f5978f3a3"}
Jul 31 12:15:26.184487 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.184403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdp9r" event={"ID":"82ce66c0-6888-41e7-9b10-7cb2183022c1","Type":"ContainerStarted","Data":"d08caa84b43dd7b0aae249028d3362b38698eb242211e2b4a9ef745cf8ead1b3"}
Jul 31 12:15:26.187216 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.187168    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnlq8" event={"ID":"ada61769-047f-4df3-9da9-4ea29b50364a","Type":"ContainerStarted","Data":"5b186ab24f22a26a3134a3be3b70085e7b52694ea90eebc4eee58c6169d65516"}
Jul 31 12:15:26.188591 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.188558    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9b8wp" event={"ID":"df889202-3bef-48b6-89d0-1efdda4100a1","Type":"ContainerStarted","Data":"2d93916958189fd0c757a675f988e39ffddbc61c7d8c444219a83c743a163ab7"}
Jul 31 12:15:26.611102 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.611049    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:26.611334 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.611131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:26.611334 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.611321    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:26.611467 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.611399    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:28.611377561 +0000 UTC m=+5.975359345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:26.611878 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.611851    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:26.612000 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.611915    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret podName:e84e8374-1010-4349-94f2-c25277188f41 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:28.611898105 +0000 UTC m=+5.975879879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret") pod "global-pull-secret-syncer-mbflb" (UID: "e84e8374-1010-4349-94f2-c25277188f41") : object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:26.712432 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:26.712387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:26.712633 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.712551    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 12:15:26.712633 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.712573    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 12:15:26.712633 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.712587    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mbxdr for pod openshift-network-diagnostics/network-check-target-cnhmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:26.712800 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:26.712653    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr podName:ae6ab437-1a4b-465b-95b8-c78ae61037ea nodeName:}" failed. No retries permitted until 2026-07-31 12:15:28.712632365 +0000 UTC m=+6.076614150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbxdr" (UniqueName: "kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr") pod "network-check-target-cnhmr" (UID: "ae6ab437-1a4b-465b-95b8-c78ae61037ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:26.884869 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:26.884834    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda332db7f_14ef_4ab3_8740_035dd40db79e.slice/crio-b69bc9e57a1cab537456d43699bc43fa60cd785129caf0fed61c27b74be2bf6b WatchSource:0}: Error finding container b69bc9e57a1cab537456d43699bc43fa60cd785129caf0fed61c27b74be2bf6b: Status 404 returned error can't find the container with id b69bc9e57a1cab537456d43699bc43fa60cd785129caf0fed61c27b74be2bf6b
Jul 31 12:15:26.887423 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:26.887388    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557922f6_6f9d_4a00_92ce_71d8452b6645.slice/crio-bea0198b8291000b9b8d3ff6d7ee990d0e37b520cb8c25c9643df9edf92dcafb WatchSource:0}: Error finding container bea0198b8291000b9b8d3ff6d7ee990d0e37b520cb8c25c9643df9edf92dcafb: Status 404 returned error can't find the container with id bea0198b8291000b9b8d3ff6d7ee990d0e37b520cb8c25c9643df9edf92dcafb
Jul 31 12:15:26.904613 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:26.904565    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647ff5d9_7c76_4167_89f5_72506f3c4b83.slice/crio-a543b3c2432145a3707211a2823acc897ed30736da5b162bfc85005c15e6c889 WatchSource:0}: Error finding container a543b3c2432145a3707211a2823acc897ed30736da5b162bfc85005c15e6c889: Status 404 returned error can't find the container with id a543b3c2432145a3707211a2823acc897ed30736da5b162bfc85005c15e6c889
Jul 31 12:15:26.908482 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:26.907550    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe447c6_fb71_44fb_9791_d81c06899e5c.slice/crio-a54d2d1ef636eda0c95e364f9f319bdee1be426ffc93a717affb6a3ca242fa46 WatchSource:0}: Error finding container a54d2d1ef636eda0c95e364f9f319bdee1be426ffc93a717affb6a3ca242fa46: Status 404 returned error can't find the container with id a54d2d1ef636eda0c95e364f9f319bdee1be426ffc93a717affb6a3ca242fa46
Jul 31 12:15:27.020944 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.020866    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 12:10:25 +0000 UTC" deadline="2028-04-20 17:13:27.10929483 +0000 UTC"
Jul 31 12:15:27.020944 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.020940    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15100h58m0.088359016s"
Jul 31 12:15:27.162380 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.162282    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:27.162558 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:27.162443    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:27.195848 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.195803    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"a543b3c2432145a3707211a2823acc897ed30736da5b162bfc85005c15e6c889"}
Jul 31 12:15:27.197494 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.197460    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerStarted","Data":"bea0198b8291000b9b8d3ff6d7ee990d0e37b520cb8c25c9643df9edf92dcafb"}
Jul 31 12:15:27.200556 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.200524    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf" event={"ID":"a332db7f-14ef-4ab3-8740-035dd40db79e","Type":"ContainerStarted","Data":"b69bc9e57a1cab537456d43699bc43fa60cd785129caf0fed61c27b74be2bf6b"}
Jul 31 12:15:27.202975 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.202942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6w8bq" event={"ID":"2fe447c6-fb71-44fb-9791-d81c06899e5c","Type":"ContainerStarted","Data":"a54d2d1ef636eda0c95e364f9f319bdee1be426ffc93a717affb6a3ca242fa46"}
Jul 31 12:15:27.204869 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:27.204837    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fmd8k" event={"ID":"065bcf50-4b01-4c1e-8250-057318bb5c65","Type":"ContainerStarted","Data":"c70730b47dbd6096ceed3b1cd5252502b29e5780a82aca7794abc85b13b718bc"}
Jul 31 12:15:28.160131 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:28.160090    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:28.160665 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.160261    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:28.160734 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:28.160707    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:28.160842 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.160815    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:28.631591 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:28.630860    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:28.631591 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:28.630945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:28.631591 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.631088    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:28.631591 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.631157    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:32.63113661 +0000 UTC m=+9.995118386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:28.631591 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.631370    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:28.631591 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.631447    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret podName:e84e8374-1010-4349-94f2-c25277188f41 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:32.631426036 +0000 UTC m=+9.995407799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret") pod "global-pull-secret-syncer-mbflb" (UID: "e84e8374-1010-4349-94f2-c25277188f41") : object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:28.731900 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:28.731854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:28.732085 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.732048    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 12:15:28.732085 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.732068    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 12:15:28.732085 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.732079    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mbxdr for pod openshift-network-diagnostics/network-check-target-cnhmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:28.732301 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:28.732131    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr podName:ae6ab437-1a4b-465b-95b8-c78ae61037ea nodeName:}" failed. No retries permitted until 2026-07-31 12:15:32.732116009 +0000 UTC m=+10.096097769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbxdr" (UniqueName: "kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr") pod "network-check-target-cnhmr" (UID: "ae6ab437-1a4b-465b-95b8-c78ae61037ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:29.162448 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:29.162408    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:29.162941 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:29.162599    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:30.160383 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:30.160338    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:30.160618 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:30.160485    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:30.160993 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:30.160966    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:30.161124 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:30.161072    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:31.161134 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:31.160314    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:31.161134 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:31.160670    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:32.160351 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:32.160117    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:32.160351 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.160282    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:32.160818 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:32.160117    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:32.160818 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.160753    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:32.668962 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:32.668343    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:32.668962 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:32.668425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:32.668962 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.668528    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:32.668962 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.668614    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret podName:e84e8374-1010-4349-94f2-c25277188f41 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:40.668589959 +0000 UTC m=+18.032571740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret") pod "global-pull-secret-syncer-mbflb" (UID: "e84e8374-1010-4349-94f2-c25277188f41") : object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:32.668962 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.668616    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:32.668962 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.668681    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:40.668660733 +0000 UTC m=+18.032642511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:32.769560 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:32.769514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:32.769770 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.769733    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 12:15:32.769770 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.769759    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 12:15:32.769878 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.769774    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mbxdr for pod openshift-network-diagnostics/network-check-target-cnhmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:32.769878 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:32.769838    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr podName:ae6ab437-1a4b-465b-95b8-c78ae61037ea nodeName:}" failed. No retries permitted until 2026-07-31 12:15:40.769818945 +0000 UTC m=+18.133800720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbxdr" (UniqueName: "kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr") pod "network-check-target-cnhmr" (UID: "ae6ab437-1a4b-465b-95b8-c78ae61037ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:33.162510 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:33.162475    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:33.162688 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:33.162607    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:34.160718 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:34.160680    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:34.161130 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:34.160821    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:34.161130 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:34.160888    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:34.161130 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:34.160961    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:35.163121 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:35.163036    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:35.163573 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:35.163223    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:35.247245 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:35.247200    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal" event={"ID":"54a85cf51d5501222ef690dfbb2ff6f9","Type":"ContainerStarted","Data":"ee187905f94572034f971fafdd8f9ce09492e8aac7c1b47605a2f10987b041a9"}
Jul 31 12:15:35.252985 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:35.252432    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qdp9r" event={"ID":"82ce66c0-6888-41e7-9b10-7cb2183022c1","Type":"ContainerStarted","Data":"cf7c8997d7d1eba0bbac61b883443adeaa4ba27107be673ed6613a6a3658af25"}
Jul 31 12:15:35.281386 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:35.280985    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-37.ec2.internal" podStartSLOduration=10.280961805 podStartE2EDuration="10.280961805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:35.261751607 +0000 UTC m=+12.625733389" watchObservedRunningTime="2026-07-31 12:15:35.280961805 +0000 UTC m=+12.644943587"
Jul 31 12:15:35.281386 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:35.281084    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qdp9r" podStartSLOduration=2.647850288 podStartE2EDuration="12.28107467s" totalImagesPullingTime="9.633224382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:35.2800646 +0000 UTC m=+12.644046379" watchObservedRunningTime="2026-07-31 12:15:35.28107467 +0000 UTC m=+12.645056452"
Jul 31 12:15:36.160303 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.159989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:36.160303 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.160245    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:36.160542 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:36.160372    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:36.160542 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:36.160471    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:36.260550 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.260506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerStarted","Data":"e89de952d3e7ff137456663086552f1940751f7884e0d80957f68e11844823f8"}
Jul 31 12:15:36.262719 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.262685    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf" event={"ID":"a332db7f-14ef-4ab3-8740-035dd40db79e","Type":"ContainerStarted","Data":"6383bba308f354a329d91cb0d4ca481193087f158d424b1515949a72002f05ed"}
Jul 31 12:15:36.264210 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.264179    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal" event={"ID":"5755871ed28212fcdc8815ae10f1f907","Type":"ContainerStarted","Data":"626c5074045d8516cec40cdc6aeefbdebcd93483787d6751e4f6ef3015e0ccc3"}
Jul 31 12:15:36.268580 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.266439    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9b8wp" event={"ID":"df889202-3bef-48b6-89d0-1efdda4100a1","Type":"ContainerStarted","Data":"a1e51011dcb9c4c687c11beeb0b9462a3bd7e6d0d889124f54c4bd9de970f9f0"}
Jul 31 12:15:36.269810 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.269257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nnkbg" event={"ID":"7e0270da-c956-4820-aa42-c274b29395e3","Type":"ContainerStarted","Data":"0d2e7822a515efe162324b55f81f67719146a65587833e1072bffdaeef94b5ad"}
Jul 31 12:15:36.270905 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.270871    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fmd8k" event={"ID":"065bcf50-4b01-4c1e-8250-057318bb5c65","Type":"ContainerStarted","Data":"8a04cafc02a92d22a321e1aa0a941c56ab4862e4b91de2a44b906ccf5a1c1cf1"}
Jul 31 12:15:36.311050 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.310929    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9b8wp" podStartSLOduration=3.753808701 podStartE2EDuration="13.310906989s" totalImagesPullingTime="9.557098288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:36.310828697 +0000 UTC m=+13.674810472" watchObservedRunningTime="2026-07-31 12:15:36.310906989 +0000 UTC m=+13.674888770"
Jul 31 12:15:36.326695 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.326632    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nnkbg" podStartSLOduration=3.739730284 podStartE2EDuration="13.326610777s" totalImagesPullingTime="9.586880493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:36.326108468 +0000 UTC m=+13.690090248" watchObservedRunningTime="2026-07-31 12:15:36.326610777 +0000 UTC m=+13.690592558"
Jul 31 12:15:36.343733 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:36.343659    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fmd8k" podStartSLOduration=4.617404167 podStartE2EDuration="13.343638994s" totalImagesPullingTime="8.726234827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:36.34324836 +0000 UTC m=+13.707230140" watchObservedRunningTime="2026-07-31 12:15:36.343638994 +0000 UTC m=+13.707620778"
Jul 31 12:15:37.161339 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:37.161293    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:37.161516 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:37.161432    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:37.275385 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:37.275353    2584 generic.go:356] "Generic (PLEG): container finished" podID="5755871ed28212fcdc8815ae10f1f907" containerID="626c5074045d8516cec40cdc6aeefbdebcd93483787d6751e4f6ef3015e0ccc3" exitCode=0
Jul 31 12:15:37.275858 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:37.275629    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal" event={"ID":"5755871ed28212fcdc8815ae10f1f907","Type":"ContainerDied","Data":"626c5074045d8516cec40cdc6aeefbdebcd93483787d6751e4f6ef3015e0ccc3"}
Jul 31 12:15:37.277566 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:37.277531    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnlq8" event={"ID":"ada61769-047f-4df3-9da9-4ea29b50364a","Type":"ContainerStarted","Data":"2aab43d40e4566cd26d6c5dca32076af83cd4c49754f774127654861280e91c9"}
Jul 31 12:15:37.279856 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:37.279829    2584 generic.go:356] "Generic (PLEG): container finished" podID="557922f6-6f9d-4a00-92ce-71d8452b6645" containerID="e89de952d3e7ff137456663086552f1940751f7884e0d80957f68e11844823f8" exitCode=0
Jul 31 12:15:37.279992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:37.279926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerDied","Data":"e89de952d3e7ff137456663086552f1940751f7884e0d80957f68e11844823f8"}
Jul 31 12:15:37.326696 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:37.326080    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hnlq8" podStartSLOduration=4.700022967 podStartE2EDuration="14.326052665s" totalImagesPullingTime="9.626029698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:37.30490459 +0000 UTC m=+14.668886371" watchObservedRunningTime="2026-07-31 12:15:37.326052665 +0000 UTC m=+14.690034446"
Jul 31 12:15:38.160134 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:38.160092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:38.160373 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:38.160092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:38.160373 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:38.160254    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:38.160373 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:38.160317    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:39.159995 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:39.159961    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:39.160441 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:39.160090    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:39.202413 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:39.202368    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:39.202942 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:39.202922    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:40.160178 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:40.160130    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:40.160178 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:40.160180    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:40.160858 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.160278    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:40.160858 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.160410    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:40.731927 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:40.731890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:40.732131 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:40.731945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:40.732131 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.732047    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:40.732131 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.732053    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:40.732131 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.732096    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:56.732080562 +0000 UTC m=+34.096062319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:40.732131 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.732117    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret podName:e84e8374-1010-4349-94f2-c25277188f41 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:56.732100719 +0000 UTC m=+34.096082490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret") pod "global-pull-secret-syncer-mbflb" (UID: "e84e8374-1010-4349-94f2-c25277188f41") : object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:40.833086 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:40.833031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:40.833273 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.833250    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 12:15:40.833273 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.833274    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 12:15:40.833385 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.833286    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mbxdr for pod openshift-network-diagnostics/network-check-target-cnhmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:40.833385 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:40.833346    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr podName:ae6ab437-1a4b-465b-95b8-c78ae61037ea nodeName:}" failed. No retries permitted until 2026-07-31 12:15:56.833326111 +0000 UTC m=+34.197307869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbxdr" (UniqueName: "kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr") pod "network-check-target-cnhmr" (UID: "ae6ab437-1a4b-465b-95b8-c78ae61037ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:41.160946 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:41.160385    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:41.160946 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:41.160531    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:42.161104 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:42.160439    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:42.161104 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:42.160502    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:42.161104 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:42.160793    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:42.161104 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:42.160914    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:43.161151 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:43.161109    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:43.161591 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:43.161249    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:44.160261 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:44.160221    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:44.160261 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:44.160241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:44.160497 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:44.160329    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:44.160497 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:44.160454    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:45.160445 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:45.160414    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:45.160984 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:45.160576    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:45.880795 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:45.880711    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:45.881000 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:45.880898    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 31 12:15:45.881777 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:45.881753    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fmd8k"
Jul 31 12:15:45.955999 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:45.955959    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:46.040921 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:46.040886    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:46.160298 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:46.160217    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:46.160298 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:46.160238    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:46.160511 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:46.160328    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:46.160511 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:46.160461    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:47.151105 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.151059    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 12:15:47.160912 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.159997    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:47.160912 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:47.160147    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:47.302527 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.302499    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"98a4688838b0263b137a605a8f6317db0b288468ec4aa3085439f6709fee3037"}
Jul 31 12:15:47.302653 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.302585    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"b6079d9229b4c6e7a0d4ce2c386f1edb0495f474a57dbfd340bc1a6ea624d62a"}
Jul 31 12:15:47.302653 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.302636    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"bdc6cfcc0731711089390d8ec25581a691e9566feceeec98953a6b03b3248717"}
Jul 31 12:15:47.304729 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.304699    2584 generic.go:356] "Generic (PLEG): container finished" podID="557922f6-6f9d-4a00-92ce-71d8452b6645" containerID="c042e86b7a5c6b8ae0f5c52b0280b59c293507575636a0a2fae054d35b53b69b" exitCode=0
Jul 31 12:15:47.304832 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.304782    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerDied","Data":"c042e86b7a5c6b8ae0f5c52b0280b59c293507575636a0a2fae054d35b53b69b"}
Jul 31 12:15:47.306739 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.306717    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf" event={"ID":"a332db7f-14ef-4ab3-8740-035dd40db79e","Type":"ContainerStarted","Data":"53752798a2165cef563e286b26f373a6a59c02850d0bd743f17c73de96f8a903"}
Jul 31 12:15:47.312500 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.312469    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal" event={"ID":"5755871ed28212fcdc8815ae10f1f907","Type":"ContainerStarted","Data":"01fdf513cf359172861bff3b8475585b146195e5266c3337ef99908dd00c5e46"}
Jul 31 12:15:47.314677 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.314647    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6w8bq" event={"ID":"2fe447c6-fb71-44fb-9791-d81c06899e5c","Type":"ContainerStarted","Data":"7290d1d6542a1e731070e01c8a67134c7a5d3081a202431f5299f6bdfe3d82e9"}
Jul 31 12:15:47.363256 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.363205    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-37.ec2.internal" podStartSLOduration=22.36318775 podStartE2EDuration="22.36318775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:47.343299828 +0000 UTC m=+24.707281608" watchObservedRunningTime="2026-07-31 12:15:47.36318775 +0000 UTC m=+24.727169530"
Jul 31 12:15:47.363358 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.363277    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6w8bq" podStartSLOduration=3.26793126 podStartE2EDuration="23.363273167s" totalImagesPullingTime="20.095341907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:47.362529653 +0000 UTC m=+24.726511433" watchObservedRunningTime="2026-07-31 12:15:47.363273167 +0000 UTC m=+24.727254947"
Jul 31 12:15:47.517764 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.517680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:47.581829 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:47.581793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:48.046110 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.045964    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T12:15:47.151082601Z","UUID":"6b74580d-6037-4d82-b302-56416d149dec","Handler":null,"Name":"","Endpoint":""}
Jul 31 12:15:48.047587 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.047559    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 12:15:48.047721 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.047602    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 12:15:48.160770 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.160734    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:48.160953 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.160746    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:48.160953 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:48.160841    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:48.160953 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:48.160921    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:48.319580 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.319495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"b6ad447c03569f3b34ad1c8592d678e80980fe4557f69dd6b4444392478c363d"}
Jul 31 12:15:48.319580 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.319566    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"292faea1a93f1de15ba1a2305df3ce7200d1ac3d552e4985309bf3952341d455"}
Jul 31 12:15:48.319759 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:48.319599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"ece5be6d0daafe16ec22ac3926b5ddaf8227ad31d2781b6c19f4cff5ff0f255c"}
Jul 31 12:15:49.160389 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:49.160303    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:49.160544 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:49.160433    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:49.323944 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:49.323911    2584 generic.go:356] "Generic (PLEG): container finished" podID="557922f6-6f9d-4a00-92ce-71d8452b6645" containerID="95ae90096416a941ddd42a7208048caddd35f2a5dd026ac1f69c5841edc29beb" exitCode=0
Jul 31 12:15:49.324409 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:49.323999    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerDied","Data":"95ae90096416a941ddd42a7208048caddd35f2a5dd026ac1f69c5841edc29beb"}
Jul 31 12:15:49.326232 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:49.326196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf" event={"ID":"a332db7f-14ef-4ab3-8740-035dd40db79e","Type":"ContainerStarted","Data":"a72c53e7c46ce3b2129533938bdb40f79b31c1fc734ffd18b7d3f83c919c3688"}
Jul 31 12:15:49.366008 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:49.365959    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqdf" podStartSLOduration=4.146835219 podStartE2EDuration="25.36594346s" totalImagesPullingTime="21.219108241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:49.365659827 +0000 UTC m=+26.729641608" watchObservedRunningTime="2026-07-31 12:15:49.36594346 +0000 UTC m=+26.729925234"
Jul 31 12:15:50.160314 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:50.160275    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:50.160314 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:50.160308    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:50.160528 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:50.160401    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:50.160569 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:50.160526    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:50.331947 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:50.331912    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"f954c8c608e30c73773e42f26553b96fa378f9c7ba30b77e0b37215c40997871"}
Jul 31 12:15:51.163794 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:51.163715    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:51.163935 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:51.163825    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:51.336913 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:51.336880    2584 generic.go:356] "Generic (PLEG): container finished" podID="557922f6-6f9d-4a00-92ce-71d8452b6645" containerID="381da0b2e98d0e34a6b69fbdbb29221c57ddd882904f0f5eaf0a06e8d71eecfb" exitCode=0
Jul 31 12:15:51.336913 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:51.336915    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerDied","Data":"381da0b2e98d0e34a6b69fbdbb29221c57ddd882904f0f5eaf0a06e8d71eecfb"}
Jul 31 12:15:51.522417 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:51.522313    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:51.584495 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:51.584466    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:51.834173 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:51.833671    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:51.934354 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:51.934316    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:52.160400 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.160301    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:52.160581 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:52.160443    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:52.160581 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.160493    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:52.160679 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:52.160643    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:52.191807 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.191767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:52.243417 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.243383    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:52.344530 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.344494    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" event={"ID":"647ff5d9-7c76-4167-89f5-72506f3c4b83","Type":"ContainerStarted","Data":"36420e53dda7dcfad5476c0d80cf64b026b11bdadadd66ae2bf96a2e97064271"}
Jul 31 12:15:52.344999 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.344793    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:52.344999 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.344880    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:52.364370 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.364331    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:52.372563 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.372521    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx" podStartSLOduration=8.276365598 podStartE2EDuration="28.372505387s" totalImagesPullingTime="20.096139789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:52.370610421 +0000 UTC m=+29.734592199" watchObservedRunningTime="2026-07-31 12:15:52.372505387 +0000 UTC m=+29.736487166"
Jul 31 12:15:52.705632 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.705583    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:52.757669 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:52.757627    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:53.165482 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:53.165417    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:53.165809 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:53.165601    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:53.348369 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:53.347732    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:53.364755 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:53.364727    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:15:54.108677 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:54.108642    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbflb"]
Jul 31 12:15:54.108847 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:54.108799    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:54.108910 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:54.108890    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:54.110455 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:54.110410    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cnhmr"]
Jul 31 12:15:54.110594 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:54.110537    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:54.110661 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:54.110636    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:54.112267 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:54.111234    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zz2qs"]
Jul 31 12:15:54.112267 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:54.111346    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:54.112267 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:54.111421    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:55.160072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:55.160028    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:55.160527 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:55.160249    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:55.750381 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:55.750198    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:55.803667 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:55.803631    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:56.160199 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:56.160152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:56.160727 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:56.160208    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:56.160727 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.160311    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:56.160727 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.160433    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:56.357692 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:56.357608    2584 generic.go:356] "Generic (PLEG): container finished" podID="557922f6-6f9d-4a00-92ce-71d8452b6645" containerID="5efe0acb52e389368ea0c3eb5951e6184e59aec177cd493617fb602f0b348ec2" exitCode=0
Jul 31 12:15:56.357692 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:56.357659    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerDied","Data":"5efe0acb52e389368ea0c3eb5951e6184e59aec177cd493617fb602f0b348ec2"}
Jul 31 12:15:56.755230 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:56.755195    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:56.755230 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:56.755241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:56.755586 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.755361    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:56.755586 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.755363    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:56.755586 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.755424    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:16:28.75540815 +0000 UTC m=+66.119389910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 12:15:56.755586 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.755438    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret podName:e84e8374-1010-4349-94f2-c25277188f41 nodeName:}" failed. No retries permitted until 2026-07-31 12:16:28.755432324 +0000 UTC m=+66.119414082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret") pod "global-pull-secret-syncer-mbflb" (UID: "e84e8374-1010-4349-94f2-c25277188f41") : object "kube-system"/"original-pull-secret" not registered
Jul 31 12:15:56.856129 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:56.856090    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:56.856395 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.856242    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 12:15:56.856395 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.856257    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 12:15:56.856395 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.856267    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mbxdr for pod openshift-network-diagnostics/network-check-target-cnhmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:56.856395 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:56.856316    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr podName:ae6ab437-1a4b-465b-95b8-c78ae61037ea nodeName:}" failed. No retries permitted until 2026-07-31 12:16:28.856305174 +0000 UTC m=+66.220286932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbxdr" (UniqueName: "kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr") pod "network-check-target-cnhmr" (UID: "ae6ab437-1a4b-465b-95b8-c78ae61037ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 12:15:57.160591 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:57.160558    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:57.161281 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:57.160708    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:15:57.363553 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:57.363517    2584 generic.go:356] "Generic (PLEG): container finished" podID="557922f6-6f9d-4a00-92ce-71d8452b6645" containerID="5abb600f1e91befeeff15e650250a861fe88576df1332eb30dc422151b8fee23" exitCode=0
Jul 31 12:15:57.363736 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:57.363562    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerDied","Data":"5abb600f1e91befeeff15e650250a861fe88576df1332eb30dc422151b8fee23"}
Jul 31 12:15:58.159951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.159908    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:15:58.159951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.159959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:15:58.160193 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:58.160051    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cnhmr" podUID="ae6ab437-1a4b-465b-95b8-c78ae61037ea"
Jul 31 12:15:58.160238 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:58.160200    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbflb" podUID="e84e8374-1010-4349-94f2-c25277188f41"
Jul 31 12:15:58.370409 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.370371    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcr66" event={"ID":"557922f6-6f9d-4a00-92ce-71d8452b6645","Type":"ContainerStarted","Data":"1e166687fa4e67bcb47adb2cc3e250685f9fd1587631b9a489f3b1f46ea11904"}
Jul 31 12:15:58.392948 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.392890    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hcr66" podStartSLOduration=9.526115343 podStartE2EDuration="34.392872425s" totalImagesPullingTime="24.866757082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:15:58.391635472 +0000 UTC m=+35.755617252" watchObservedRunningTime="2026-07-31 12:15:58.392872425 +0000 UTC m=+35.756854197"
Jul 31 12:15:58.512816 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.512784    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:58.566147 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.566114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:15:58.931878 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.931851    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-37.ec2.internal" event="NodeReady"
Jul 31 12:15:58.932036 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.931988    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 12:15:58.975863 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.975831    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p6kcl"]
Jul 31 12:15:58.999577 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:58.999549    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zp6fw"]
Jul 31 12:15:59.001355 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.000129    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.003426 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.003397    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 12:15:59.003426 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.003413    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 12:15:59.003598 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.003403    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ngjpv\""
Jul 31 12:15:59.015582 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.015559    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p6kcl"]
Jul 31 12:15:59.015692 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.015595    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zp6fw"]
Jul 31 12:15:59.015692 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.015672    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.019220 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.019198    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 12:15:59.019341 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.019295    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4h696\""
Jul 31 12:15:59.019407 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.019348    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 12:15:59.019407 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.019384    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 12:15:59.160462 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.160425    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:15:59.163217 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.163194    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qqfkp\""
Jul 31 12:15:59.163378 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.163222    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 12:15:59.174765 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.174735    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec511360-937c-4dd5-9a57-0f10382c2130-tmp-dir\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.174915 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.174772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6qzq\" (UniqueName: \"kubernetes.io/projected/ec511360-937c-4dd5-9a57-0f10382c2130-kube-api-access-b6qzq\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.174915 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.174803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec511360-937c-4dd5-9a57-0f10382c2130-config-volume\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.174915 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.174871    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrrkx\" (UniqueName: \"kubernetes.io/projected/f7d43255-0879-4cf5-8ac3-0cdaa84456a3-kube-api-access-mrrkx\") pod \"ingress-canary-zp6fw\" (UID: \"f7d43255-0879-4cf5-8ac3-0cdaa84456a3\") " pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.175025 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.174937    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.175025 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.174959    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7d43255-0879-4cf5-8ac3-0cdaa84456a3-cert\") pod \"ingress-canary-zp6fw\" (UID: \"f7d43255-0879-4cf5-8ac3-0cdaa84456a3\") " pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.275755 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.275671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec511360-937c-4dd5-9a57-0f10382c2130-config-volume\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.275755 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.275721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrrkx\" (UniqueName: \"kubernetes.io/projected/f7d43255-0879-4cf5-8ac3-0cdaa84456a3-kube-api-access-mrrkx\") pod \"ingress-canary-zp6fw\" (UID: \"f7d43255-0879-4cf5-8ac3-0cdaa84456a3\") " pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.275962 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.275841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.275962 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.275877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7d43255-0879-4cf5-8ac3-0cdaa84456a3-cert\") pod \"ingress-canary-zp6fw\" (UID: \"f7d43255-0879-4cf5-8ac3-0cdaa84456a3\") " pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.276064 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:59.275983    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:15:59.276064 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.276024    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec511360-937c-4dd5-9a57-0f10382c2130-tmp-dir\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.276064 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:59.276052    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:15:59.776030623 +0000 UTC m=+37.140012397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:15:59.276265 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.276085    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qzq\" (UniqueName: \"kubernetes.io/projected/ec511360-937c-4dd5-9a57-0f10382c2130-kube-api-access-b6qzq\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.276393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.276375    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec511360-937c-4dd5-9a57-0f10382c2130-tmp-dir\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.276473 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.276386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec511360-937c-4dd5-9a57-0f10382c2130-config-volume\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.280237 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.280220    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7d43255-0879-4cf5-8ac3-0cdaa84456a3-cert\") pod \"ingress-canary-zp6fw\" (UID: \"f7d43255-0879-4cf5-8ac3-0cdaa84456a3\") " pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.285208 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.285185    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrrkx\" (UniqueName: \"kubernetes.io/projected/f7d43255-0879-4cf5-8ac3-0cdaa84456a3-kube-api-access-mrrkx\") pod \"ingress-canary-zp6fw\" (UID: \"f7d43255-0879-4cf5-8ac3-0cdaa84456a3\") " pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.285356 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.285336    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6qzq\" (UniqueName: \"kubernetes.io/projected/ec511360-937c-4dd5-9a57-0f10382c2130-kube-api-access-b6qzq\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.324465 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.324426    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zp6fw"
Jul 31 12:15:59.534242 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.533897    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zp6fw"]
Jul 31 12:15:59.537484 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:15:59.537455    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d43255_0879_4cf5_8ac3_0cdaa84456a3.slice/crio-43a3a20391f05a35b202df29325d22c2a554e5119df7b850502cc2d5a5626fe7 WatchSource:0}: Error finding container 43a3a20391f05a35b202df29325d22c2a554e5119df7b850502cc2d5a5626fe7: Status 404 returned error can't find the container with id 43a3a20391f05a35b202df29325d22c2a554e5119df7b850502cc2d5a5626fe7
Jul 31 12:15:59.780025 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:15:59.779993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:15:59.780244 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:59.780122    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:15:59.780244 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:15:59.780209    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:16:00.780190999 +0000 UTC m=+38.144172776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:16:00.160284 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.160247    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:16:00.160497 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.160246    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:16:00.163477 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.163449    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 12:16:00.163622 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.163455    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 12:16:00.163622 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.163494    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dw9nv\""
Jul 31 12:16:00.164564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.164546    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 12:16:00.376036 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.376000    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zp6fw" event={"ID":"f7d43255-0879-4cf5-8ac3-0cdaa84456a3","Type":"ContainerStarted","Data":"43a3a20391f05a35b202df29325d22c2a554e5119df7b850502cc2d5a5626fe7"}
Jul 31 12:16:00.789190 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:00.789138    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:16:00.789686 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:00.789295    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:16:00.789686 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:00.789368    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:16:02.789344878 +0000 UTC m=+40.153326650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:16:02.385873 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:02.385838    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zp6fw" event={"ID":"f7d43255-0879-4cf5-8ac3-0cdaa84456a3","Type":"ContainerStarted","Data":"172ee50b00c0b09b9d89ccf847d215eb640d67f10372b3634f35bba5a5b9eaf1"}
Jul 31 12:16:02.401016 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:02.400959    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zp6fw" podStartSLOduration=2.154277647 podStartE2EDuration="4.400941894s" totalImagesPullingTime="2.246664247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:16:02.400632663 +0000 UTC m=+39.764614444" watchObservedRunningTime="2026-07-31 12:16:02.400941894 +0000 UTC m=+39.764923674"
Jul 31 12:16:02.806709 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:02.806657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:16:02.806895 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:02.806782    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:16:02.806895 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:02.806844    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:16:06.806831599 +0000 UTC m=+44.170813358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:16:06.835984 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:06.835925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:16:06.836604 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:06.836103    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:16:06.836604 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:06.836198    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:16:14.836181701 +0000 UTC m=+52.200163464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:16:07.904400 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:07.904367    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:13.692862 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:13.692821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:13.809052 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:13.809018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:13.860485 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:13.860455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:13.917384 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:13.917334    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:14.896266 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:14.896222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:16:14.896697 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:14.896398    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:16:14.896697 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:14.896465    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:16:30.896450494 +0000 UTC m=+68.260432252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:16:19.649797 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.649766    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"]
Jul 31 12:16:19.694407 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.694370    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"]
Jul 31 12:16:19.694592 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.694471    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.696586 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.696556    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 31 12:16:19.700210 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.700178    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 31 12:16:19.700365 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.700307    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 31 12:16:19.700365 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.700308    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 31 12:16:19.728245 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.728209    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-tmp\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.728414 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.728326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmflm\" (UniqueName: \"kubernetes.io/projected/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-kube-api-access-gmflm\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.728414 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.728360    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-klusterlet-config\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.829260 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.829214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmflm\" (UniqueName: \"kubernetes.io/projected/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-kube-api-access-gmflm\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.829420 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.829279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-klusterlet-config\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.829420 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.829320    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-tmp\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.829728 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.829696    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-tmp\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.833844 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.833815    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-klusterlet-config\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:19.837851 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:19.837824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmflm\" (UniqueName: \"kubernetes.io/projected/6d14f384-2ca6-47ca-8c9b-dd4c5d970130-kube-api-access-gmflm\") pod \"klusterlet-addon-workmgr-7975f9c54f-6bs22\" (UID: \"6d14f384-2ca6-47ca-8c9b-dd4c5d970130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:20.007614 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:20.007576    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:20.161278 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:20.161247    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"]
Jul 31 12:16:20.164607 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:16:20.164575    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d14f384_2ca6_47ca_8c9b_dd4c5d970130.slice/crio-a02b105b0bc80c68e0a54388706e395064f955e2506206c2a60d06d3947ca9d9 WatchSource:0}: Error finding container a02b105b0bc80c68e0a54388706e395064f955e2506206c2a60d06d3947ca9d9: Status 404 returned error can't find the container with id a02b105b0bc80c68e0a54388706e395064f955e2506206c2a60d06d3947ca9d9
Jul 31 12:16:20.430082 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:20.430050    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22" event={"ID":"6d14f384-2ca6-47ca-8c9b-dd4c5d970130","Type":"ContainerStarted","Data":"a02b105b0bc80c68e0a54388706e395064f955e2506206c2a60d06d3947ca9d9"}
Jul 31 12:16:24.445572 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:24.445534    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22" event={"ID":"6d14f384-2ca6-47ca-8c9b-dd4c5d970130","Type":"ContainerStarted","Data":"5a8659fdfd94e92b2ee69e3e84c6465f33a4fae3b14230d0cbb7ec57ec16bb22"}
Jul 31 12:16:24.446001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:24.445759    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:24.447281 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:24.447259    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:16:24.462968 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:24.462908    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22" podStartSLOduration=1.292606991 podStartE2EDuration="5.462891903s" totalImagesPullingTime="4.170284912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:16:24.46170764 +0000 UTC m=+61.825689419" watchObservedRunningTime="2026-07-31 12:16:24.462891903 +0000 UTC m=+61.826873661"
Jul 31 12:16:25.364304 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:25.364273    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6hwtx"
Jul 31 12:16:25.488173 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:25.488122    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:25.561513 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:25.561484    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:25.763929 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:25.763901    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:25.819613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:25.819586    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:28.799529 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.799466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:16:28.799529 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.799542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:16:28.802421 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.802401    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 12:16:28.802484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.802447    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 12:16:28.810578 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:28.810546    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 12:16:28.810680 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:28.810619    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:17:32.810602441 +0000 UTC m=+130.174584200 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : secret "metrics-daemon-secret" not found
Jul 31 12:16:28.812799 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.812776    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e84e8374-1010-4349-94f2-c25277188f41-original-pull-secret\") pod \"global-pull-secret-syncer-mbflb\" (UID: \"e84e8374-1010-4349-94f2-c25277188f41\") " pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:16:28.900358 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.900307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:16:28.903171 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.903132    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 12:16:28.913882 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.913858    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 12:16:28.924476 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.924452    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbxdr\" (UniqueName: \"kubernetes.io/projected/ae6ab437-1a4b-465b-95b8-c78ae61037ea-kube-api-access-mbxdr\") pod \"network-check-target-cnhmr\" (UID: \"ae6ab437-1a4b-465b-95b8-c78ae61037ea\") " pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:16:28.972725 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.972689    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbflb"
Jul 31 12:16:28.982498 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.982469    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dw9nv\""
Jul 31 12:16:28.990456 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:28.990423    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:16:29.108854 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:29.108811    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbflb"]
Jul 31 12:16:29.112953 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:16:29.112926    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84e8374_1010_4349_94f2_c25277188f41.slice/crio-13e44cbae87a0609c88a29c67dde1a986d4d07e901b189d5a6e7c02edbf884cf WatchSource:0}: Error finding container 13e44cbae87a0609c88a29c67dde1a986d4d07e901b189d5a6e7c02edbf884cf: Status 404 returned error can't find the container with id 13e44cbae87a0609c88a29c67dde1a986d4d07e901b189d5a6e7c02edbf884cf
Jul 31 12:16:29.128671 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:29.128641    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cnhmr"]
Jul 31 12:16:29.131926 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:16:29.131893    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6ab437_1a4b_465b_95b8_c78ae61037ea.slice/crio-a8d4122346ecd1dc4ba670cb8caa9306f64ca9952186e61e17f8f7fe8925dfc2 WatchSource:0}: Error finding container a8d4122346ecd1dc4ba670cb8caa9306f64ca9952186e61e17f8f7fe8925dfc2: Status 404 returned error can't find the container with id a8d4122346ecd1dc4ba670cb8caa9306f64ca9952186e61e17f8f7fe8925dfc2
Jul 31 12:16:29.459203 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:29.459145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cnhmr" event={"ID":"ae6ab437-1a4b-465b-95b8-c78ae61037ea","Type":"ContainerStarted","Data":"a8d4122346ecd1dc4ba670cb8caa9306f64ca9952186e61e17f8f7fe8925dfc2"}
Jul 31 12:16:29.460214 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:29.460189    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbflb" event={"ID":"e84e8374-1010-4349-94f2-c25277188f41","Type":"ContainerStarted","Data":"13e44cbae87a0609c88a29c67dde1a986d4d07e901b189d5a6e7c02edbf884cf"}
Jul 31 12:16:30.916711 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:30.916663    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:16:30.917227 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:30.916825    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:16:30.917227 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:16:30.916925    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:17:02.91690219 +0000 UTC m=+100.280883950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:16:34.475123 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:34.475077    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cnhmr" event={"ID":"ae6ab437-1a4b-465b-95b8-c78ae61037ea","Type":"ContainerStarted","Data":"ad4e59d3c3c765c9af8808e4fe64514d770fc7a4287ab8f32f90d3ddaf020b7f"}
Jul 31 12:16:34.475589 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:34.475189    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:16:34.476720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:34.476692    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbflb" event={"ID":"e84e8374-1010-4349-94f2-c25277188f41","Type":"ContainerStarted","Data":"208a7d7a89a486f23223f60d072d70ad5824e101fca4b16322d0fb8304646e6b"}
Jul 31 12:16:34.489783 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:34.489730    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cnhmr" podStartSLOduration=65.945333817 podStartE2EDuration="1m10.489712958s" totalImagesPullingTime="4.544379141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:16:34.489205021 +0000 UTC m=+71.853186802" watchObservedRunningTime="2026-07-31 12:16:34.489712958 +0000 UTC m=+71.853694736"
Jul 31 12:16:50.999819 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:50.999705    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:16:51.098085 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:16:51.098043    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:17:02.943398 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:17:02.943341    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:17:02.943908 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:17:02.943527    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:17:02.943908 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:17:02.943613    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:18:06.943592179 +0000 UTC m=+164.307573937 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:17:05.481658 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:17:05.481625    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cnhmr"
Jul 31 12:17:05.497036 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:17:05.496985    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mbflb" podStartSLOduration=96.929125067 podStartE2EDuration="1m41.496967881s" totalImagesPullingTime="4.567842814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:16:34.50237807 +0000 UTC m=+71.866359849" watchObservedRunningTime="2026-07-31 12:17:05.496967881 +0000 UTC m=+102.860949678"
Jul 31 12:17:32.859298 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:17:32.859243    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:17:32.859798 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:17:32.859409    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 12:17:32.859798 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:17:32.859475    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:34.859459919 +0000 UTC m=+252.223441677 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : secret "metrics-daemon-secret" not found
Jul 31 12:18:02.011436 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:18:02.011379    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p6kcl" podUID="ec511360-937c-4dd5-9a57-0f10382c2130"
Jul 31 12:18:02.168915 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:18:02.168855    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:18:02.692592 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:02.692549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:18:06.992752 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:06.992706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:18:06.993274 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:18:06.992872    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 12:18:06.993274 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:18:06.992952    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls podName:ec511360-937c-4dd5-9a57-0f10382c2130 nodeName:}" failed. No retries permitted until 2026-07-31 12:20:08.992934804 +0000 UTC m=+286.356916563 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls") pod "dns-default-p6kcl" (UID: "ec511360-937c-4dd5-9a57-0f10382c2130") : secret "dns-default-metrics-tls" not found
Jul 31 12:18:13.161687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:13.161601    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:18:16.032882 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:16.032844    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:18:24.446708 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:24.446660    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22" podUID="6d14f384-2ca6-47ca-8c9b-dd4c5d970130" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 31 12:18:24.750625 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:24.750542    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d14f384-2ca6-47ca-8c9b-dd4c5d970130" containerID="5a8659fdfd94e92b2ee69e3e84c6465f33a4fae3b14230d0cbb7ec57ec16bb22" exitCode=1
Jul 31 12:18:24.750625 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:24.750607    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22" event={"ID":"6d14f384-2ca6-47ca-8c9b-dd4c5d970130","Type":"ContainerDied","Data":"5a8659fdfd94e92b2ee69e3e84c6465f33a4fae3b14230d0cbb7ec57ec16bb22"}
Jul 31 12:18:24.750929 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:24.750916    2584 scope.go:117] "RemoveContainer" containerID="5a8659fdfd94e92b2ee69e3e84c6465f33a4fae3b14230d0cbb7ec57ec16bb22"
Jul 31 12:18:25.755358 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:25.755313    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22" event={"ID":"6d14f384-2ca6-47ca-8c9b-dd4c5d970130","Type":"ContainerStarted","Data":"76a54a72b48435532f7516336fbf721418bec09e8500ca2998517a305ebf4df3"}
Jul 31 12:18:25.755814 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:25.755610    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:18:25.756260 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:25.756242    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7975f9c54f-6bs22"
Jul 31 12:18:48.520631 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:18:48.520591    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:23.878778 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.878744    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"]
Jul 31 12:19:23.880988 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.880962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:23.881309 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.881286    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57687ffbc-jlxwr"]
Jul 31 12:19:23.882924 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.882905    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:23.884045 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.884020    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 31 12:19:23.884148 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.884085    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h2mvc\""
Jul 31 12:19:23.884350 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.884335    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 31 12:19:23.886457 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.886436    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 12:19:23.886650 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.886623    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 12:19:23.886650 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.886638    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 12:19:23.886981 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.886964    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tjczm\""
Jul 31 12:19:23.892426 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.892390    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"]
Jul 31 12:19:23.893064 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.893046    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 12:19:23.905872 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.905833    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57687ffbc-jlxwr"]
Jul 31 12:19:23.974302 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.974264    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-dt557"]
Jul 31 12:19:23.976079 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.976058    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-854b678d4d-k9nfk"]
Jul 31 12:19:23.976234 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.976217    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:23.977778 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.977755    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:23.980526 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980480    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 31 12:19:23.980768 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980719    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 31 12:19:23.980768 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980764    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-whxn7\""
Jul 31 12:19:23.980969 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980771    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 12:19:23.980969 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980784    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 31 12:19:23.980969 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980792    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 12:19:23.980969 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980899    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 31 12:19:23.980969 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.980952    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 31 12:19:23.981381 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.981007    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 31 12:19:23.981381 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.981057    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 31 12:19:23.981381 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.981075    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 31 12:19:23.981381 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.981276    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cddmt\""
Jul 31 12:19:23.991126 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.990580    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-dt557"]
Jul 31 12:19:23.991655 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.991634    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 31 12:19:23.996291 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:23.996260    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-854b678d4d-k9nfk"]
Jul 31 12:19:24.013432 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxd2n\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-kube-api-access-bxd2n\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.013432 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013436    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:24.013694 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.013694 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-installation-pull-secrets\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.013694 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013539    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eaf680b6-f8e4-4297-a644-7af5c12f844d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:24.013694 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013609    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-trusted-ca\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.013694 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-bound-sa-token\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.013918 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-image-registry-private-configuration\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.013918 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013765    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb5be62e-1cbc-402f-b16e-56478ae5113d-ca-trust-extracted\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.013918 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.013791    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-certificates\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114215 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114148    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-bound-sa-token\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114402 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-stats-auth\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.114402 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-image-registry-private-configuration\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114402 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb5be62e-1cbc-402f-b16e-56478ae5113d-ca-trust-extracted\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114527 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.114527 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114527 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114480    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-installation-pull-secrets\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114673 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd084b10-562f-4e45-a1a8-5ec09618414f-config\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.114673 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114584    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-default-certificate\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.114673 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-trusted-ca\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114673 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.114650    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 12:19:24.114673 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114657    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd084b10-562f-4e45-a1a8-5ec09618414f-serving-cert\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.114673 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.114668    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57687ffbc-jlxwr: secret "image-registry-tls" not found
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfdg5\" (UniqueName: \"kubernetes.io/projected/bd084b10-562f-4e45-a1a8-5ec09618414f-kube-api-access-lfdg5\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114727    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.114749    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls podName:bb5be62e-1cbc-402f-b16e-56478ae5113d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:24.614725242 +0000 UTC m=+241.978707017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls") pod "image-registry-57687ffbc-jlxwr" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d") : secret "image-registry-tls" not found
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6gx2\" (UniqueName: \"kubernetes.io/projected/2e80e9c1-e676-4614-96fb-fe892d44faff-kube-api-access-n6gx2\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-certificates\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114864    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxd2n\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-kube-api-access-bxd2n\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114869    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb5be62e-1cbc-402f-b16e-56478ae5113d-ca-trust-extracted\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:24.114978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.114933    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd084b10-562f-4e45-a1a8-5ec09618414f-trusted-ca\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.115477 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.115044    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 12:19:24.115477 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.115088    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert podName:eaf680b6-f8e4-4297-a644-7af5c12f844d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:24.615071988 +0000 UTC m=+241.979053761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8xz97" (UID: "eaf680b6-f8e4-4297-a644-7af5c12f844d") : secret "networking-console-plugin-cert" not found
Jul 31 12:19:24.115477 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.115203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eaf680b6-f8e4-4297-a644-7af5c12f844d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:24.115477 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.115381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-certificates\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.115790 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.115771    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-trusted-ca\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.115890 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.115875    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eaf680b6-f8e4-4297-a644-7af5c12f844d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:24.117606 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.117575    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-installation-pull-secrets\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.117746 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.117721    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-image-registry-private-configuration\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.123251 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.123225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxd2n\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-kube-api-access-bxd2n\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.123359 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.123253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-bound-sa-token\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.145911 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.145833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:24.215941 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.215902    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd084b10-562f-4e45-a1a8-5ec09618414f-serving-cert\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.215941 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.215941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfdg5\" (UniqueName: \"kubernetes.io/projected/bd084b10-562f-4e45-a1a8-5ec09618414f-kube-api-access-lfdg5\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.216124 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.215966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.216124 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.215981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6gx2\" (UniqueName: \"kubernetes.io/projected/2e80e9c1-e676-4614-96fb-fe892d44faff-kube-api-access-n6gx2\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.216124 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.216111    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd084b10-562f-4e45-a1a8-5ec09618414f-trusted-ca\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.216284 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.216194    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:24.716146229 +0000 UTC m=+242.080127987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : configmap references non-existent config key: service-ca.crt
Jul 31 12:19:24.216336 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.216294    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-stats-auth\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.216385 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.216340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.216385 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.216374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd084b10-562f-4e45-a1a8-5ec09618414f-config\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.216494 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.216455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-default-certificate\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.216494 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.216475    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 12:19:24.216596 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.216547    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:24.716528336 +0000 UTC m=+242.080510111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : secret "router-metrics-certs-default" not found
Jul 31 12:19:24.217021 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.216993    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd084b10-562f-4e45-a1a8-5ec09618414f-config\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.217407 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.217384    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd084b10-562f-4e45-a1a8-5ec09618414f-trusted-ca\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.218740 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.218705    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd084b10-562f-4e45-a1a8-5ec09618414f-serving-cert\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.218833 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.218720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-stats-auth\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.218833 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.218821    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-default-certificate\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.226724 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.226700    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6gx2\" (UniqueName: \"kubernetes.io/projected/2e80e9c1-e676-4614-96fb-fe892d44faff-kube-api-access-n6gx2\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.227039 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.227022    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfdg5\" (UniqueName: \"kubernetes.io/projected/bd084b10-562f-4e45-a1a8-5ec09618414f-kube-api-access-lfdg5\") pod \"console-operator-5ccd6b445f-dt557\" (UID: \"bd084b10-562f-4e45-a1a8-5ec09618414f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.245891 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.245852    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:24.287539 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.287498    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:24.421475 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.421442    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-dt557"]
Jul 31 12:19:24.424560 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:19:24.424527    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd084b10_562f_4e45_a1a8_5ec09618414f.slice/crio-305eee9ad627372c314bf4e9a69023afa2396e4e38834cb4757696bc7456189c WatchSource:0}: Error finding container 305eee9ad627372c314bf4e9a69023afa2396e4e38834cb4757696bc7456189c: Status 404 returned error can't find the container with id 305eee9ad627372c314bf4e9a69023afa2396e4e38834cb4757696bc7456189c
Jul 31 12:19:24.620123 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.620024    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:24.620123 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.620098    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:24.620372 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.620152    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 12:19:24.620372 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.620194    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57687ffbc-jlxwr: secret "image-registry-tls" not found
Jul 31 12:19:24.620372 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.620222    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 12:19:24.620372 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.620273    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert podName:eaf680b6-f8e4-4297-a644-7af5c12f844d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:25.620260142 +0000 UTC m=+242.984241900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8xz97" (UID: "eaf680b6-f8e4-4297-a644-7af5c12f844d") : secret "networking-console-plugin-cert" not found
Jul 31 12:19:24.620372 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.620286    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls podName:bb5be62e-1cbc-402f-b16e-56478ae5113d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:25.620279875 +0000 UTC m=+242.984261633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls") pod "image-registry-57687ffbc-jlxwr" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d") : secret "image-registry-tls" not found
Jul 31 12:19:24.721148 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.721071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.721272 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.721177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:24.721320 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.721273    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 12:19:24.721320 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.721290    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:25.721270737 +0000 UTC m=+243.085252522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : configmap references non-existent config key: service-ca.crt
Jul 31 12:19:24.721320 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:24.721318    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:25.721308026 +0000 UTC m=+243.085289783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : secret "router-metrics-certs-default" not found
Jul 31 12:19:24.905077 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:24.905041    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" event={"ID":"bd084b10-562f-4e45-a1a8-5ec09618414f","Type":"ContainerStarted","Data":"305eee9ad627372c314bf4e9a69023afa2396e4e38834cb4757696bc7456189c"}
Jul 31 12:19:25.628322 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:25.628278    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:25.628514 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:25.628382    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:25.628514 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.628444    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 12:19:25.628514 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.628514    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 12:19:25.628684 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.628531    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57687ffbc-jlxwr: secret "image-registry-tls" not found
Jul 31 12:19:25.628684 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.628537    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert podName:eaf680b6-f8e4-4297-a644-7af5c12f844d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:27.628511583 +0000 UTC m=+244.992493344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8xz97" (UID: "eaf680b6-f8e4-4297-a644-7af5c12f844d") : secret "networking-console-plugin-cert" not found
Jul 31 12:19:25.628684 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.628593    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls podName:bb5be62e-1cbc-402f-b16e-56478ae5113d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:27.62857604 +0000 UTC m=+244.992557804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls") pod "image-registry-57687ffbc-jlxwr" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d") : secret "image-registry-tls" not found
Jul 31 12:19:25.729153 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:25.729107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:25.729357 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:25.729204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:25.729357 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.729267    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 12:19:25.729357 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.729336    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:27.729318492 +0000 UTC m=+245.093300253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : secret "router-metrics-certs-default" not found
Jul 31 12:19:25.729357 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:25.729351    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:27.729344724 +0000 UTC m=+245.093326483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : configmap references non-existent config key: service-ca.crt
Jul 31 12:19:26.913264 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:26.913238    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/0.log"
Jul 31 12:19:26.913644 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:26.913283    2584 generic.go:356] "Generic (PLEG): container finished" podID="bd084b10-562f-4e45-a1a8-5ec09618414f" containerID="12bc73d33a4f9b02b3baab4a51dcee627eb3e7ec09eae8a8dd54ebbdb0be61e3" exitCode=255
Jul 31 12:19:26.913644 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:26.913353    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" event={"ID":"bd084b10-562f-4e45-a1a8-5ec09618414f","Type":"ContainerDied","Data":"12bc73d33a4f9b02b3baab4a51dcee627eb3e7ec09eae8a8dd54ebbdb0be61e3"}
Jul 31 12:19:26.913644 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:26.913601    2584 scope.go:117] "RemoveContainer" containerID="12bc73d33a4f9b02b3baab4a51dcee627eb3e7ec09eae8a8dd54ebbdb0be61e3"
Jul 31 12:19:27.648087 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.648047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:27.648276 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.648106    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:27.648276 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.648219    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 12:19:27.648276 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.648244    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57687ffbc-jlxwr: secret "image-registry-tls" not found
Jul 31 12:19:27.648276 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.648252    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 12:19:27.648408 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.648297    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls podName:bb5be62e-1cbc-402f-b16e-56478ae5113d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:31.648282233 +0000 UTC m=+249.012263990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls") pod "image-registry-57687ffbc-jlxwr" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d") : secret "image-registry-tls" not found
Jul 31 12:19:27.648408 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.648312    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert podName:eaf680b6-f8e4-4297-a644-7af5c12f844d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:31.648304199 +0000 UTC m=+249.012285956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8xz97" (UID: "eaf680b6-f8e4-4297-a644-7af5c12f844d") : secret "networking-console-plugin-cert" not found
Jul 31 12:19:27.749223 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.749151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:27.749335 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.749272    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 12:19:27.749335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.749280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:27.749418 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.749339    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:31.749317804 +0000 UTC m=+249.113299578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : secret "router-metrics-certs-default" not found
Jul 31 12:19:27.749418 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.749380    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:31.749369996 +0000 UTC m=+249.113351754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : configmap references non-existent config key: service-ca.crt
Jul 31 12:19:27.917518 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.917491    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:19:27.917954 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.917896    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/0.log"
Jul 31 12:19:27.917954 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.917931    2584 generic.go:356] "Generic (PLEG): container finished" podID="bd084b10-562f-4e45-a1a8-5ec09618414f" containerID="17c0e6579fc9d2570fe397692a8e0df497186b9325027e8ed010ad4d9a63a66e" exitCode=255
Jul 31 12:19:27.918040 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.917997    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" event={"ID":"bd084b10-562f-4e45-a1a8-5ec09618414f","Type":"ContainerDied","Data":"17c0e6579fc9d2570fe397692a8e0df497186b9325027e8ed010ad4d9a63a66e"}
Jul 31 12:19:27.918074 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.918048    2584 scope.go:117] "RemoveContainer" containerID="12bc73d33a4f9b02b3baab4a51dcee627eb3e7ec09eae8a8dd54ebbdb0be61e3"
Jul 31 12:19:27.918274 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:27.918254    2584 scope.go:117] "RemoveContainer" containerID="17c0e6579fc9d2570fe397692a8e0df497186b9325027e8ed010ad4d9a63a66e"
Jul 31 12:19:27.918905 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:27.918870    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-dt557_openshift-console-operator(bd084b10-562f-4e45-a1a8-5ec09618414f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" podUID="bd084b10-562f-4e45-a1a8-5ec09618414f"
Jul 31 12:19:28.197027 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.196944    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:28.248291 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.248267    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:28.495460 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.495379    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tj8pr"]
Jul 31 12:19:28.498115 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.498094    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.500393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.500370    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 12:19:28.500497 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.500430    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 12:19:28.500688 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.500674    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 12:19:28.501424 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.501410    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 12:19:28.502384 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.502368    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qpgl9\""
Jul 31 12:19:28.504649 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.504589    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:28.511657 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.511629    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tj8pr"]
Jul 31 12:19:28.557496 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.557450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9v9l\" (UniqueName: \"kubernetes.io/projected/c8a4b341-1866-4f10-be64-41a944dab346-kube-api-access-q9v9l\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.557680 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.557512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.557680 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.557541    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.557680 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.557566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8a4b341-1866-4f10-be64-41a944dab346-data-volume\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.557680 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.557590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8a4b341-1866-4f10-be64-41a944dab346-crio-socket\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.563308 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.563285    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:28.658644 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.658605    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9v9l\" (UniqueName: \"kubernetes.io/projected/c8a4b341-1866-4f10-be64-41a944dab346-kube-api-access-q9v9l\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.658754 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.658665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.658754 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.658695    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.658830 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:28.658772    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:28.658830 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:28.658797    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 12:19:28.658830 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:28.658820    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:29.158806634 +0000 UTC m=+246.522788392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:28.658957 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:28.658854    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:29.158838345 +0000 UTC m=+246.522820117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : configmap "kube-rbac-proxy" not found
Jul 31 12:19:28.658957 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.658889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8a4b341-1866-4f10-be64-41a944dab346-data-volume\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.658957 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.658942    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8a4b341-1866-4f10-be64-41a944dab346-crio-socket\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.659070 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.659056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8a4b341-1866-4f10-be64-41a944dab346-crio-socket\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.659147 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.659132    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8a4b341-1866-4f10-be64-41a944dab346-data-volume\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.667638 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.667611    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9v9l\" (UniqueName: \"kubernetes.io/projected/c8a4b341-1866-4f10-be64-41a944dab346-kube-api-access-q9v9l\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:28.922917 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.922882    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:19:28.923335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:28.923271    2584 scope.go:117] "RemoveContainer" containerID="17c0e6579fc9d2570fe397692a8e0df497186b9325027e8ed010ad4d9a63a66e"
Jul 31 12:19:28.923440 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:28.923421    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-dt557_openshift-console-operator(bd084b10-562f-4e45-a1a8-5ec09618414f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" podUID="bd084b10-562f-4e45-a1a8-5ec09618414f"
Jul 31 12:19:29.076388 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.076357    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:29.164323 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.164288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:29.164499 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.164335    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:29.164499 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:29.164352    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 12:19:29.164499 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:29.164424    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:30.164401505 +0000 UTC m=+247.528383263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : configmap "kube-rbac-proxy" not found
Jul 31 12:19:29.164499 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:29.164449    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:29.164499 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:29.164487    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:30.164475851 +0000 UTC m=+247.528457609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:29.177624 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.177545    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:29.277601 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.277574    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:29.549101 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.549020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:29.605456 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.605427    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:29.817776 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.817700    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:29.918489 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:29.918460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:30.173653 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:30.173618    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:30.174048 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:30.173668    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:30.174048 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:30.173731    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 12:19:30.174048 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:30.173800    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:32.173783757 +0000 UTC m=+249.537765515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : configmap "kube-rbac-proxy" not found
Jul 31 12:19:30.174048 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:30.173837    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:30.174048 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:30.173894    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:32.173880426 +0000 UTC m=+249.537862185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:30.449105 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:30.449033    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nnkbg_7e0270da-c956-4820-aa42-c274b29395e3/dns-node-resolver/0.log"
Jul 31 12:19:31.167659 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.167629    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:31.248708 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.248686    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9b8wp_df889202-3bef-48b6-89d0-1efdda4100a1/node-ca/0.log"
Jul 31 12:19:31.468253 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.468173    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:31.528775 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.528745    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:31.687552 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.687517    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:31.687659 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.687580    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:31.687697 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.687673    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 12:19:31.687697 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.687693    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57687ffbc-jlxwr: secret "image-registry-tls" not found
Jul 31 12:19:31.687761 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.687705    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 12:19:31.687761 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.687752    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls podName:bb5be62e-1cbc-402f-b16e-56478ae5113d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:39.687735037 +0000 UTC m=+257.051716796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls") pod "image-registry-57687ffbc-jlxwr" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d") : secret "image-registry-tls" not found
Jul 31 12:19:31.687828 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.687784    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert podName:eaf680b6-f8e4-4297-a644-7af5c12f844d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:39.687770651 +0000 UTC m=+257.051752409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8xz97" (UID: "eaf680b6-f8e4-4297-a644-7af5c12f844d") : secret "networking-console-plugin-cert" not found
Jul 31 12:19:31.788350 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.788269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:31.788350 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:31.788334    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:31.788509 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.788427    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 12:19:31.788509 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.788492    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:39.78847137 +0000 UTC m=+257.152453128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : secret "router-metrics-certs-default" not found
Jul 31 12:19:31.788509 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:31.788508    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:39.788502184 +0000 UTC m=+257.152483942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : configmap references non-existent config key: service-ca.crt
Jul 31 12:19:32.191683 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:32.191648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:32.191856 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:32.191698    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:32.191856 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:32.191770    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 12:19:32.191856 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:32.191789    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:32.191856 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:32.191843    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:36.191829008 +0000 UTC m=+253.555810767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:32.191982 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:32.191910    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:36.191893062 +0000 UTC m=+253.555874821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : configmap "kube-rbac-proxy" not found
Jul 31 12:19:32.345436 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:32.345408    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:32.449418 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:32.449345    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zp6fw_f7d43255-0879-4cf5-8ac3-0cdaa84456a3/serve-healthcheck-canary/0.log"
Jul 31 12:19:34.287753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:34.287707    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:34.288143 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:34.287778    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:34.288208 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:34.288140    2584 scope.go:117] "RemoveContainer" containerID="17c0e6579fc9d2570fe397692a8e0df497186b9325027e8ed010ad4d9a63a66e"
Jul 31 12:19:34.288367 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:34.288345    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-dt557_openshift-console-operator(bd084b10-562f-4e45-a1a8-5ec09618414f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" podUID="bd084b10-562f-4e45-a1a8-5ec09618414f"
Jul 31 12:19:34.472649 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:34.472601    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:34.905830 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:34.905792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:34.918013 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:34.917981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:19:34.918146 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:34.918131    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 12:19:34.918239 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:34.918227    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs podName:6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7 nodeName:}" failed. No retries permitted until 2026-07-31 12:21:36.918210223 +0000 UTC m=+374.282191981 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs") pod "network-metrics-daemon-zz2qs" (UID: "6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7") : secret "metrics-daemon-secret" not found
Jul 31 12:19:34.942072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:34.942043    2584 scope.go:117] "RemoveContainer" containerID="17c0e6579fc9d2570fe397692a8e0df497186b9325027e8ed010ad4d9a63a66e"
Jul 31 12:19:34.942239 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:34.942224    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-dt557_openshift-console-operator(bd084b10-562f-4e45-a1a8-5ec09618414f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" podUID="bd084b10-562f-4e45-a1a8-5ec09618414f"
Jul 31 12:19:35.007233 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:35.007200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:35.107820 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:35.107776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:35.207725 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:35.207640    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:35.409731 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:35.409693    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:35.619622 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:35.619532    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:36.230269 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:36.230226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:36.230461 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:36.230283    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:36.230461 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:36.230344    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 12:19:36.230461 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:36.230410    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:44.230391424 +0000 UTC m=+261.594373187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : configmap "kube-rbac-proxy" not found
Jul 31 12:19:36.230640 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:36.230494    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:36.230640 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:36.230567    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:19:44.230549486 +0000 UTC m=+261.594531245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:36.617053 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:36.616968    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:36.804775 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:36.804743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:37.006443 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:37.006407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:37.448498 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:37.448457    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:38.005619 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:38.005583    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:38.606951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:38.606920    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:38.707449 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:38.707413    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:38.807216 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:38.807179    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:38.863808 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:38.863742    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:39.209336 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.209297    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:39.407229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.407195    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:39.756419 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.756385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:39.756579 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.756495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:39.756617 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:39.756574    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 12:19:39.756685 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:39.756674    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert podName:eaf680b6-f8e4-4297-a644-7af5c12f844d nodeName:}" failed. No retries permitted until 2026-07-31 12:19:55.756654259 +0000 UTC m=+273.120636038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8xz97" (UID: "eaf680b6-f8e4-4297-a644-7af5c12f844d") : secret "networking-console-plugin-cert" not found
Jul 31 12:19:39.758995 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.758976    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"image-registry-57687ffbc-jlxwr\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") " pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:39.798276 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.798239    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:39.813351 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.813322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:39.857784 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.857735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:39.857960 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.857813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:39.857960 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:39.857945    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle podName:2e80e9c1-e676-4614-96fb-fe892d44faff nodeName:}" failed. No retries permitted until 2026-07-31 12:19:55.857931812 +0000 UTC m=+273.221913570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle") pod "router-default-854b678d4d-k9nfk" (UID: "2e80e9c1-e676-4614-96fb-fe892d44faff") : configmap references non-existent config key: service-ca.crt
Jul 31 12:19:39.861373 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.861301    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e80e9c1-e676-4614-96fb-fe892d44faff-metrics-certs\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:39.935722 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.935692    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57687ffbc-jlxwr"]
Jul 31 12:19:39.938803 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:19:39.938770    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5be62e_1cbc_402f_b16e_56478ae5113d.slice/crio-7635cbd308715ea896e429dbb64dfd1e6920017293821149b979174b59d1c9d1 WatchSource:0}: Error finding container 7635cbd308715ea896e429dbb64dfd1e6920017293821149b979174b59d1c9d1: Status 404 returned error can't find the container with id 7635cbd308715ea896e429dbb64dfd1e6920017293821149b979174b59d1c9d1
Jul 31 12:19:39.957640 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:39.957607    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" event={"ID":"bb5be62e-1cbc-402f-b16e-56478ae5113d","Type":"ContainerStarted","Data":"7635cbd308715ea896e429dbb64dfd1e6920017293821149b979174b59d1c9d1"}
Jul 31 12:19:40.605859 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:40.605822    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:40.816277 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:40.816242    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:40.962251 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:40.962213    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" event={"ID":"bb5be62e-1cbc-402f-b16e-56478ae5113d","Type":"ContainerStarted","Data":"179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a"}
Jul 31 12:19:40.962427 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:40.962300    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:19:40.983871 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:40.983816    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" podStartSLOduration=17.983801139 podStartE2EDuration="17.983801139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:19:40.982791253 +0000 UTC m=+258.346773043" watchObservedRunningTime="2026-07-31 12:19:40.983801139 +0000 UTC m=+258.347782955"
Jul 31 12:19:41.211002 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:41.210970    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:41.406908 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:41.406879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:41.507900 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:41.507867    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:41.693746 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:41.693654    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:42.082024 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:42.081938    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:42.410294 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:42.410261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:42.614926 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:42.614894    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:43.006495 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:43.006457    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:43.825421 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:43.825387    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:44.158237 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.158204    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:44.259179 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.259127    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:44.294635 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.294590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:44.294754 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.294655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:44.294830 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:44.294767    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:44.294830 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:19:44.294828    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls podName:c8a4b341-1866-4f10-be64-41a944dab346 nodeName:}" failed. No retries permitted until 2026-07-31 12:20:00.294810673 +0000 UTC m=+277.658792451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj8pr" (UID: "c8a4b341-1866-4f10-be64-41a944dab346") : secret "insights-runtime-extractor-tls" not found
Jul 31 12:19:44.295266 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.295243    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8a4b341-1866-4f10-be64-41a944dab346-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:19:44.411443 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.411359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:44.612465 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.612416    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:44.802815 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:44.802733    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:45.407728 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:45.407692    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:45.606451 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:45.606423    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:49.161119 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.161088    2584 scope.go:117] "RemoveContainer" containerID="17c0e6579fc9d2570fe397692a8e0df497186b9325027e8ed010ad4d9a63a66e"
Jul 31 12:19:49.463364 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.463280    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57687ffbc-jlxwr"]
Jul 31 12:19:49.622922 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.622879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:49.723494 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.723417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:49.992567 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.992487    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:19:49.992567 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.992536    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" event={"ID":"bd084b10-562f-4e45-a1a8-5ec09618414f","Type":"ContainerStarted","Data":"e88acf62fe8183ddbe2ba6ddff8eb719c9c302085d6e8df21de8bc26864b1761"}
Jul 31 12:19:49.992879 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.992850    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:49.998647 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:49.998613    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557"
Jul 31 12:19:50.010573 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:50.010524    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-dt557" podStartSLOduration=24.966541348 podStartE2EDuration="27.010506028s" totalImagesPullingTime="2.04396468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:19:50.009453923 +0000 UTC m=+267.373435703" watchObservedRunningTime="2026-07-31 12:19:50.010506028 +0000 UTC m=+267.374487808"
Jul 31 12:19:50.143256 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:50.143224    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:50.215289 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:50.215256    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:50.265741 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:50.265669    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:50.429310 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:50.429273    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:50.811807 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:50.811772    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:50.912281 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:50.912246    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:51.822969 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:51.822933    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:52.032345 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:52.032314    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:52.132978 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:52.132893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:52.232964 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:52.232926    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:52.284558 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:52.284529    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:55.749395 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:55.749349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:55.790523 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:55.790477    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:55.793087 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:55.793066    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaf680b6-f8e4-4297-a644-7af5c12f844d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8xz97\" (UID: \"eaf680b6-f8e4-4297-a644-7af5c12f844d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:55.804051 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:55.804021    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:55.891561 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:55.891517    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:55.892115 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:55.892096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e80e9c1-e676-4614-96fb-fe892d44faff-service-ca-bundle\") pod \"router-default-854b678d4d-k9nfk\" (UID: \"2e80e9c1-e676-4614-96fb-fe892d44faff\") " pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:55.991830 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:55.991789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"
Jul 31 12:19:56.094693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:56.094655    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:56.124121 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:56.124085    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8xz97"]
Jul 31 12:19:56.127560 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:19:56.127524    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf680b6_f8e4_4297_a644_7af5c12f844d.slice/crio-b0ebb171fad73866210c19041169da66aafcb9cdae7c957a0f31c71a9cdd5d2d WatchSource:0}: Error finding container b0ebb171fad73866210c19041169da66aafcb9cdae7c957a0f31c71a9cdd5d2d: Status 404 returned error can't find the container with id b0ebb171fad73866210c19041169da66aafcb9cdae7c957a0f31c71a9cdd5d2d
Jul 31 12:19:56.230335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:56.230249    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-854b678d4d-k9nfk"]
Jul 31 12:19:56.232841 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:19:56.232810    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e80e9c1_e676_4614_96fb_fe892d44faff.slice/crio-26687119a71f857f7ec6b7e7947087ed108e9769252ceafac7c5f75024107e94 WatchSource:0}: Error finding container 26687119a71f857f7ec6b7e7947087ed108e9769252ceafac7c5f75024107e94: Status 404 returned error can't find the container with id 26687119a71f857f7ec6b7e7947087ed108e9769252ceafac7c5f75024107e94
Jul 31 12:19:57.016619 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:57.016581    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97" event={"ID":"eaf680b6-f8e4-4297-a644-7af5c12f844d","Type":"ContainerStarted","Data":"b0ebb171fad73866210c19041169da66aafcb9cdae7c957a0f31c71a9cdd5d2d"}
Jul 31 12:19:57.018297 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:57.018263    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-854b678d4d-k9nfk" event={"ID":"2e80e9c1-e676-4614-96fb-fe892d44faff","Type":"ContainerStarted","Data":"3e512ee00853a1c4464249b65e7b7e896044b1d05d67af4a48e181f35d8b63fd"}
Jul 31 12:19:57.018448 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:57.018327    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-854b678d4d-k9nfk" event={"ID":"2e80e9c1-e676-4614-96fb-fe892d44faff","Type":"ContainerStarted","Data":"26687119a71f857f7ec6b7e7947087ed108e9769252ceafac7c5f75024107e94"}
Jul 31 12:19:57.037283 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:57.037225    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-854b678d4d-k9nfk" podStartSLOduration=34.037202273 podStartE2EDuration="34.037202273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:19:57.035740996 +0000 UTC m=+274.399722775" watchObservedRunningTime="2026-07-31 12:19:57.037202273 +0000 UTC m=+274.401184053"
Jul 31 12:19:57.095139 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:57.095104    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:57.098598 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:57.098559    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:58.023619 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.023569    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97" event={"ID":"eaf680b6-f8e4-4297-a644-7af5c12f844d","Type":"ContainerStarted","Data":"13539712a4b42815f6705ce91066b2b64b9340f15854801a4f7edb55814ca0a0"}
Jul 31 12:19:58.024085 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.023863    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:58.025175 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.025135    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-854b678d4d-k9nfk"
Jul 31 12:19:58.041895 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.041839    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8xz97" podStartSLOduration=33.857014774 podStartE2EDuration="35.041823101s" totalImagesPullingTime="1.184808327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:19:58.041013373 +0000 UTC m=+275.404995147" watchObservedRunningTime="2026-07-31 12:19:58.041823101 +0000 UTC m=+275.405804881"
Jul 31 12:19:58.148647 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.148617    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:58.250459 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.250426    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:58.696136 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.696105    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:58.842491 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.842436    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:58.848772 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.848744    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"]
Jul 31 12:19:58.850782 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.850766    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"
Jul 31 12:19:58.853260 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.853238    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 31 12:19:58.853427 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.853364    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hhz6t\""
Jul 31 12:19:58.859195 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:58.859145    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"]
Jul 31 12:19:59.017778 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.017673    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a8e863c1-3556-4d92-9be8-147315f3fc08-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-z88s9\" (UID: \"a8e863c1-3556-4d92-9be8-147315f3fc08\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"
Jul 31 12:19:59.020030 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.020005    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:19:59.118992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.118955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a8e863c1-3556-4d92-9be8-147315f3fc08-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-z88s9\" (UID: \"a8e863c1-3556-4d92-9be8-147315f3fc08\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"
Jul 31 12:19:59.121916 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.121878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a8e863c1-3556-4d92-9be8-147315f3fc08-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-z88s9\" (UID: \"a8e863c1-3556-4d92-9be8-147315f3fc08\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"
Jul 31 12:19:59.161415 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.161370    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"
Jul 31 12:19:59.299593 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.299505    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"]
Jul 31 12:19:59.302996 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:19:59.302963    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e863c1_3556_4d92_9be8_147315f3fc08.slice/crio-87edc9da70eebad5eca936977d8abb313c34ddbee4749e1d10ea0a08d537eb98 WatchSource:0}: Error finding container 87edc9da70eebad5eca936977d8abb313c34ddbee4749e1d10ea0a08d537eb98: Status 404 returned error can't find the container with id 87edc9da70eebad5eca936977d8abb313c34ddbee4749e1d10ea0a08d537eb98
Jul 31 12:19:59.469565 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.469531    2584 patch_prober.go:28] interesting pod/image-registry-57687ffbc-jlxwr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 12:19:59.469744 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:19:59.469587    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" podUID="bb5be62e-1cbc-402f-b16e-56478ae5113d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 12:20:00.030591 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:00.030553    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9" event={"ID":"a8e863c1-3556-4d92-9be8-147315f3fc08","Type":"ContainerStarted","Data":"87edc9da70eebad5eca936977d8abb313c34ddbee4749e1d10ea0a08d537eb98"}
Jul 31 12:20:00.329937 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:00.329852    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:20:00.333198 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:00.333152    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8a4b341-1866-4f10-be64-41a944dab346-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj8pr\" (UID: \"c8a4b341-1866-4f10-be64-41a944dab346\") " pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:20:00.607710 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:00.607612    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tj8pr"
Jul 31 12:20:00.647111 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:00.647072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:00.704223 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:00.704188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:00.742865 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:00.742830    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tj8pr"]
Jul 31 12:20:00.746506 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:20:00.746478    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a4b341_1866_4f10_be64_41a944dab346.slice/crio-32fe0cbf04870a95f59d2091d5224a24cc48aa3ca69ec1d5fcb2e02da284d8c2 WatchSource:0}: Error finding container 32fe0cbf04870a95f59d2091d5224a24cc48aa3ca69ec1d5fcb2e02da284d8c2: Status 404 returned error can't find the container with id 32fe0cbf04870a95f59d2091d5224a24cc48aa3ca69ec1d5fcb2e02da284d8c2
Jul 31 12:20:01.035652 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.035614    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9" event={"ID":"a8e863c1-3556-4d92-9be8-147315f3fc08","Type":"ContainerStarted","Data":"c069d6ee1bd62ccecdc50253b28353e641971433f7d7ad04a41111bf17f01ae3"}
Jul 31 12:20:01.035890 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.035861    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"
Jul 31 12:20:01.037246 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.037220    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj8pr" event={"ID":"c8a4b341-1866-4f10-be64-41a944dab346","Type":"ContainerStarted","Data":"1e39050dc9ba957549fde3c738e75438f1bd045d5cbb8106694bee9753655481"}
Jul 31 12:20:01.037358 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.037279    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj8pr" event={"ID":"c8a4b341-1866-4f10-be64-41a944dab346","Type":"ContainerStarted","Data":"32fe0cbf04870a95f59d2091d5224a24cc48aa3ca69ec1d5fcb2e02da284d8c2"}
Jul 31 12:20:01.041195 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.041147    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9"
Jul 31 12:20:01.052671 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.052618    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-z88s9" podStartSLOduration=1.927121605 podStartE2EDuration="3.052596526s" totalImagesPullingTime="1.125474921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:01.052055777 +0000 UTC m=+278.416037570" watchObservedRunningTime="2026-07-31 12:20:01.052596526 +0000 UTC m=+278.416578305"
Jul 31 12:20:01.866505 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.866416    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:01.904426 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.904396    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-frtlx"]
Jul 31 12:20:01.907335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.907318    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:01.909880 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.909858    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 31 12:20:01.910016 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.909858    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 12:20:01.911043 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.911022    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 31 12:20:01.911139 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.911067    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pcx24\""
Jul 31 12:20:01.911139 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.911089    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 12:20:01.911270 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.911067    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 12:20:01.914932 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.914906    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-frtlx"]
Jul 31 12:20:01.928673 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:01.928626    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:02.044818 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.044775    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8j88\" (UniqueName: \"kubernetes.io/projected/743926bd-f184-444d-b830-ece8b840e27b-kube-api-access-x8j88\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.045018 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.044827    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/743926bd-f184-444d-b830-ece8b840e27b-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.045018 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.044909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/743926bd-f184-444d-b830-ece8b840e27b-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.045018 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.044983    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/743926bd-f184-444d-b830-ece8b840e27b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.046415 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.046384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj8pr" event={"ID":"c8a4b341-1866-4f10-be64-41a944dab346","Type":"ContainerStarted","Data":"8ed6d231f64a94d6b0425e278adf9d2cfca70f66480f07d6e65ed89dd77ac063"}
Jul 31 12:20:02.128844 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.128722    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:02.145799 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.145767    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/743926bd-f184-444d-b830-ece8b840e27b-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.145941 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.145823    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/743926bd-f184-444d-b830-ece8b840e27b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.145941 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.145882    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8j88\" (UniqueName: \"kubernetes.io/projected/743926bd-f184-444d-b830-ece8b840e27b-kube-api-access-x8j88\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.145941 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.145906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/743926bd-f184-444d-b830-ece8b840e27b-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.146665 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.146579    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/743926bd-f184-444d-b830-ece8b840e27b-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.148431 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.148404    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/743926bd-f184-444d-b830-ece8b840e27b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.148628 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.148609    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/743926bd-f184-444d-b830-ece8b840e27b-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.153800 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.153775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8j88\" (UniqueName: \"kubernetes.io/projected/743926bd-f184-444d-b830-ece8b840e27b-kube-api-access-x8j88\") pod \"prometheus-operator-758d7cb874-frtlx\" (UID: \"743926bd-f184-444d-b830-ece8b840e27b\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.217020 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.216977    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx"
Jul 31 12:20:02.346946 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:02.346911    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-frtlx"]
Jul 31 12:20:02.350199 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:20:02.350140    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743926bd_f184_444d_b830_ece8b840e27b.slice/crio-bf9f4bfb9dfffaa6f2d0bad8f3629fb983256f7ea40ee1632c06568dc4d7ed8f WatchSource:0}: Error finding container bf9f4bfb9dfffaa6f2d0bad8f3629fb983256f7ea40ee1632c06568dc4d7ed8f: Status 404 returned error can't find the container with id bf9f4bfb9dfffaa6f2d0bad8f3629fb983256f7ea40ee1632c06568dc4d7ed8f
Jul 31 12:20:03.052204 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:03.052150    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx" event={"ID":"743926bd-f184-444d-b830-ece8b840e27b","Type":"ContainerStarted","Data":"bf9f4bfb9dfffaa6f2d0bad8f3629fb983256f7ea40ee1632c06568dc4d7ed8f"}
Jul 31 12:20:04.058547 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:04.058509    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj8pr" event={"ID":"c8a4b341-1866-4f10-be64-41a944dab346","Type":"ContainerStarted","Data":"1fd608710465aa2e9f4f67f2b5c79946e08030b4eace316c5e53ad3f2e7ac886"}
Jul 31 12:20:04.077910 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:04.077841    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tj8pr" podStartSLOduration=33.619461766 podStartE2EDuration="36.077820738s" totalImagesPullingTime="2.458358972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 12:19:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:04.076244538 +0000 UTC m=+281.440226322" watchObservedRunningTime="2026-07-31 12:20:04.077820738 +0000 UTC m=+281.441802517"
Jul 31 12:20:04.488545 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:04.488509    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:05.063301 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:05.063264    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx" event={"ID":"743926bd-f184-444d-b830-ece8b840e27b","Type":"ContainerStarted","Data":"699a015a422fa41432da4215eec1e53bb86fd52e8c7a1419e65ed2d23721ef20"}
Jul 31 12:20:05.063702 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:05.063331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx" event={"ID":"743926bd-f184-444d-b830-ece8b840e27b","Type":"ContainerStarted","Data":"b3871e154b1efbacf4ceb57718408a103a331b647068dc45da7ecc44a4b40b59"}
Jul 31 12:20:05.082099 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:05.082041    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-frtlx" podStartSLOduration=2.262684375 podStartE2EDuration="4.082023677s" totalImagesPullingTime="1.819339302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:05.0810557 +0000 UTC m=+282.445037480" watchObservedRunningTime="2026-07-31 12:20:05.082023677 +0000 UTC m=+282.446005456"
Jul 31 12:20:05.693402 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:20:05.693353    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p6kcl" podUID="ec511360-937c-4dd5-9a57-0f10382c2130"
Jul 31 12:20:06.067443 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:06.067344    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:20:06.986811 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:06.986782    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.215718 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.215685    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.221445 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.221414    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"]
Jul 31 12:20:07.224755 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.224736    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.227221 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.227199    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 31 12:20:07.227357 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.227339    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 31 12:20:07.227418 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.227396    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cggl5\""
Jul 31 12:20:07.234935 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.234908    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"]
Jul 31 12:20:07.243971 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.243905    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"]
Jul 31 12:20:07.247051 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.247031    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.250257 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.250228    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hp57v\""
Jul 31 12:20:07.250382 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.250331    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 31 12:20:07.251048 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.251028    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 31 12:20:07.251138 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.251086    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 31 12:20:07.257373 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.257352    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gthjr"]
Jul 31 12:20:07.260518 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.260496    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.260659 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.260640    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"]
Jul 31 12:20:07.263169 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.263140    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5xjv\""
Jul 31 12:20:07.263319 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.263213    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 12:20:07.263409 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.263337    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 12:20:07.263409 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.263363    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 12:20:07.303701 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.303669    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.391384 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391352    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/851ba084-882c-43b2-9ff6-82d6b11bf96b-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.391578 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391389    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/851ba084-882c-43b2-9ff6-82d6b11bf96b-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.391578 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391412    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391578 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xqbn\" (UniqueName: \"kubernetes.io/projected/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-api-access-7xqbn\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.391578 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391499    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/361a2d3c-4b17-4382-af91-9b05471b89a0-metrics-client-ca\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391747 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391576    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgr8b\" (UniqueName: \"kubernetes.io/projected/62d46553-1704-4482-8656-c8f799b0f8ba-kube-api-access-vgr8b\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.391747 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391618    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-root\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391747 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62d46553-1704-4482-8656-c8f799b0f8ba-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.391747 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391699    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hqhr\" (UniqueName: \"kubernetes.io/projected/361a2d3c-4b17-4382-af91-9b05471b89a0-kube-api-access-7hqhr\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391747 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391721    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391750    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391783    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-wtmp\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391800    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391820    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-sys\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-tls\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391860    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d46553-1704-4482-8656-c8f799b0f8ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-textfile\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.391979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.391958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62d46553-1704-4482-8656-c8f799b0f8ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.492549 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-sys\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.492722 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492558    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-tls\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.492722 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d46553-1704-4482-8656-c8f799b0f8ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.492722 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492628    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-sys\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.492722 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492628    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.492897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-textfile\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.492897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62d46553-1704-4482-8656-c8f799b0f8ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.492897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/851ba084-882c-43b2-9ff6-82d6b11bf96b-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.492897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492830    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/851ba084-882c-43b2-9ff6-82d6b11bf96b-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.493091 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.492997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493091 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493040    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xqbn\" (UniqueName: \"kubernetes.io/projected/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-api-access-7xqbn\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.493091 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493070    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/361a2d3c-4b17-4382-af91-9b05471b89a0-metrics-client-ca\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493091 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-textfile\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/851ba084-882c-43b2-9ff6-82d6b11bf96b-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.493600 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgr8b\" (UniqueName: \"kubernetes.io/projected/62d46553-1704-4482-8656-c8f799b0f8ba-kube-api-access-vgr8b\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.493720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493630    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-root\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/851ba084-882c-43b2-9ff6-82d6b11bf96b-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.493720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493668    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62d46553-1704-4482-8656-c8f799b0f8ba-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.493720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493697    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-root\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/361a2d3c-4b17-4382-af91-9b05471b89a0-metrics-client-ca\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493438    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.493997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hqhr\" (UniqueName: \"kubernetes.io/projected/361a2d3c-4b17-4382-af91-9b05471b89a0-kube-api-access-7hqhr\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493807    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.493997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493879    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-wtmp\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.493997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.493908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.493997 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:20:07.493992    2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 31 12:20:07.494336 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:20:07.494083    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-tls podName:851ba084-882c-43b2-9ff6-82d6b11bf96b nodeName:}" failed. No retries permitted until 2026-07-31 12:20:07.994063413 +0000 UTC m=+285.358045196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-cglfm" (UID: "851ba084-882c-43b2-9ff6-82d6b11bf96b") : secret "kube-state-metrics-tls" not found
Jul 31 12:20:07.494410 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.494340    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62d46553-1704-4482-8656-c8f799b0f8ba-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.494512 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.494488    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-wtmp\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.494898 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.494876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.495964 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.495938    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-tls\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.496072 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.496003    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62d46553-1704-4482-8656-c8f799b0f8ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.496409 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.496386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/361a2d3c-4b17-4382-af91-9b05471b89a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.496500 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.496484    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.496804 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.496781    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62d46553-1704-4482-8656-c8f799b0f8ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.500651 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.500622    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.502687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.502660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xqbn\" (UniqueName: \"kubernetes.io/projected/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-api-access-7xqbn\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:07.502827 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.502810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgr8b\" (UniqueName: \"kubernetes.io/projected/62d46553-1704-4482-8656-c8f799b0f8ba-kube-api-access-vgr8b\") pod \"openshift-state-metrics-6bb4d7b4dd-m8xkm\" (UID: \"62d46553-1704-4482-8656-c8f799b0f8ba\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.502906 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.502891    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hqhr\" (UniqueName: \"kubernetes.io/projected/361a2d3c-4b17-4382-af91-9b05471b89a0-kube-api-access-7hqhr\") pod \"node-exporter-gthjr\" (UID: \"361a2d3c-4b17-4382-af91-9b05471b89a0\") " pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.534180 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.534122    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"
Jul 31 12:20:07.569412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.569380    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gthjr"
Jul 31 12:20:07.581582 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:20:07.581553    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361a2d3c_4b17_4382_af91_9b05471b89a0.slice/crio-d55e965ba870b710116d6787e1b87aa41bd0d5c129dafebec9876d5ea721d8cc WatchSource:0}: Error finding container d55e965ba870b710116d6787e1b87aa41bd0d5c129dafebec9876d5ea721d8cc: Status 404 returned error can't find the container with id d55e965ba870b710116d6787e1b87aa41bd0d5c129dafebec9876d5ea721d8cc
Jul 31 12:20:07.601895 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.601825    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.674315 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.674290    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm"]
Jul 31 12:20:07.676805 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:20:07.676776    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d46553_1704_4482_8656_c8f799b0f8ba.slice/crio-f538e192cf2b3e8346ea114bdacc7d41ada620daece572fa3fac098f2a9631fa WatchSource:0}: Error finding container f538e192cf2b3e8346ea114bdacc7d41ada620daece572fa3fac098f2a9631fa: Status 404 returned error can't find the container with id f538e192cf2b3e8346ea114bdacc7d41ada620daece572fa3fac098f2a9631fa
Jul 31 12:20:07.676949 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.676898    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.840909 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.840873    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.941332 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.941293    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:07.998735 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:07.998632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:08.001381 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.001358    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/851ba084-882c-43b2-9ff6-82d6b11bf96b-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-cglfm\" (UID: \"851ba084-882c-43b2-9ff6-82d6b11bf96b\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:08.074754 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.074713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gthjr" event={"ID":"361a2d3c-4b17-4382-af91-9b05471b89a0","Type":"ContainerStarted","Data":"d55e965ba870b710116d6787e1b87aa41bd0d5c129dafebec9876d5ea721d8cc"}
Jul 31 12:20:08.076396 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.076367    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm" event={"ID":"62d46553-1704-4482-8656-c8f799b0f8ba","Type":"ContainerStarted","Data":"771e8199fb6c77ad0c1b4eed3870dc8d018a9cfd588c73a2c26d69709071f65c"}
Jul 31 12:20:08.076534 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.076433    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm" event={"ID":"62d46553-1704-4482-8656-c8f799b0f8ba","Type":"ContainerStarted","Data":"1817ef50ad69dda6409538439a79e226ff240e34023a0a348ed3c21f1801faaa"}
Jul 31 12:20:08.076534 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.076462    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm" event={"ID":"62d46553-1704-4482-8656-c8f799b0f8ba","Type":"ContainerStarted","Data":"f538e192cf2b3e8346ea114bdacc7d41ada620daece572fa3fac098f2a9631fa"}
Jul 31 12:20:08.158005 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.157962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"
Jul 31 12:20:08.220414 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.220376    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:08.292855 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.292821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:08.324514 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.324488    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm"]
Jul 31 12:20:08.327221 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:20:08.327187    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851ba084_882c_43b2_9ff6_82d6b11bf96b.slice/crio-31c8d66254a7af7fce0a2fdefc34a323f8b29dc79919cbcbe6130ff79c7ce1d7 WatchSource:0}: Error finding container 31c8d66254a7af7fce0a2fdefc34a323f8b29dc79919cbcbe6130ff79c7ce1d7: Status 404 returned error can't find the container with id 31c8d66254a7af7fce0a2fdefc34a323f8b29dc79919cbcbe6130ff79c7ce1d7
Jul 31 12:20:08.702080 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:08.702035    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:09.008782 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.008687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:20:09.011776 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.011741    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec511360-937c-4dd5-9a57-0f10382c2130-metrics-tls\") pod \"dns-default-p6kcl\" (UID: \"ec511360-937c-4dd5-9a57-0f10382c2130\") " pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:20:09.071048 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.071008    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ngjpv\""
Jul 31 12:20:09.079560 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.079530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:20:09.082116 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.082075    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm" event={"ID":"851ba084-882c-43b2-9ff6-82d6b11bf96b","Type":"ContainerStarted","Data":"31c8d66254a7af7fce0a2fdefc34a323f8b29dc79919cbcbe6130ff79c7ce1d7"}
Jul 31 12:20:09.083983 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.083954    2584 generic.go:356] "Generic (PLEG): container finished" podID="361a2d3c-4b17-4382-af91-9b05471b89a0" containerID="eda6d31d2c19fdf2789d3669698b24b5f2c39130575f633e6444e0b9cbd58944" exitCode=0
Jul 31 12:20:09.084108 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.084007    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gthjr" event={"ID":"361a2d3c-4b17-4382-af91-9b05471b89a0","Type":"ContainerDied","Data":"eda6d31d2c19fdf2789d3669698b24b5f2c39130575f633e6444e0b9cbd58944"}
Jul 31 12:20:09.266777 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.266748    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p6kcl"]
Jul 31 12:20:09.269424 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:20:09.269396    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec511360_937c_4dd5_9a57_0f10382c2130.slice/crio-f576a74a48ce2feeff01b8f5056ed06e35e83bdc131344cbfaadf44e7d7cd972 WatchSource:0}: Error finding container f576a74a48ce2feeff01b8f5056ed06e35e83bdc131344cbfaadf44e7d7cd972: Status 404 returned error can't find the container with id f576a74a48ce2feeff01b8f5056ed06e35e83bdc131344cbfaadf44e7d7cd972
Jul 31 12:20:09.470748 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.470674    2584 patch_prober.go:28] interesting pod/image-registry-57687ffbc-jlxwr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 12:20:09.470956 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:09.470749    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" podUID="bb5be62e-1cbc-402f-b16e-56478ae5113d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 12:20:10.089826 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.089720    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6kcl" event={"ID":"ec511360-937c-4dd5-9a57-0f10382c2130","Type":"ContainerStarted","Data":"f576a74a48ce2feeff01b8f5056ed06e35e83bdc131344cbfaadf44e7d7cd972"}
Jul 31 12:20:10.092708 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.092672    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm" event={"ID":"851ba084-882c-43b2-9ff6-82d6b11bf96b","Type":"ContainerStarted","Data":"bc3cc0079064ad4240cc38e7a9d95876cf1089c11b4988b9bcc1026d0c031467"}
Jul 31 12:20:10.092864 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.092743    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm" event={"ID":"851ba084-882c-43b2-9ff6-82d6b11bf96b","Type":"ContainerStarted","Data":"dc25c455d256851ecdcf297a4bcfe388c765e250ecec6d247ee3f95396e9b032"}
Jul 31 12:20:10.092864 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.092774    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm" event={"ID":"851ba084-882c-43b2-9ff6-82d6b11bf96b","Type":"ContainerStarted","Data":"6505e1a88e46c6aad6e6142223c735e27b46558fad6f5681698d541fe381ca2b"}
Jul 31 12:20:10.095571 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.095533    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gthjr" event={"ID":"361a2d3c-4b17-4382-af91-9b05471b89a0","Type":"ContainerStarted","Data":"94eda864a5c4d7cd7bd5db87260ea8d93103dedb055acb891c30cfe4a8dd85ef"}
Jul 31 12:20:10.095718 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.095589    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gthjr" event={"ID":"361a2d3c-4b17-4382-af91-9b05471b89a0","Type":"ContainerStarted","Data":"52fc4bc1998b92ab3c338f192a65b31110c6411fcda3ef17b9889fce29c2ccc8"}
Jul 31 12:20:10.099409 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.099196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm" event={"ID":"62d46553-1704-4482-8656-c8f799b0f8ba","Type":"ContainerStarted","Data":"850887c8aab6d362ea27ac2dadf918b4f17f2d94ae309fb81ec6ae5d68a14f6e"}
Jul 31 12:20:10.112633 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.112459    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-cglfm" podStartSLOduration=1.750694427 podStartE2EDuration="3.112442525s" totalImagesPullingTime="1.361748098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:10.112267657 +0000 UTC m=+287.476249439" watchObservedRunningTime="2026-07-31 12:20:10.112442525 +0000 UTC m=+287.476424307"
Jul 31 12:20:10.130439 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.130374    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m8xkm" podStartSLOduration=1.826905899 podStartE2EDuration="3.130350278s" totalImagesPullingTime="1.303444379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:10.129522953 +0000 UTC m=+287.493504761" watchObservedRunningTime="2026-07-31 12:20:10.130350278 +0000 UTC m=+287.494332059"
Jul 31 12:20:10.153101 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.153045    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gthjr" podStartSLOduration=1.920504266 podStartE2EDuration="3.153027282s" totalImagesPullingTime="1.153431632s" totalInitContainerRuntime="79.091384ms" isStatefulPod=true podCreationTimestamp="2026-07-31 12:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:10.151958271 +0000 UTC m=+287.515940053" watchObservedRunningTime="2026-07-31 12:20:10.153027282 +0000 UTC m=+287.517009453"
Jul 31 12:20:10.184438 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.184398    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:10.247970 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.247928    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:10.372370 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.372263    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:10.465463 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:10.465431    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:11.017430 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:11.017399    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:11.116063 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:11.116028    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:11.216425 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:11.216389    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:11.509444 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:11.509407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:11.577515 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:11.577426    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:11.631897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:11.631863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:11.732973 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:11.732927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:12.013852 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:12.013823    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:12.108707 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:12.108670    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6kcl" event={"ID":"ec511360-937c-4dd5-9a57-0f10382c2130","Type":"ContainerStarted","Data":"4d552c7f87bd09e3174fd8316d2ed31dc6669966cd5524ce12c7d0ab87b5b8a3"}
Jul 31 12:20:12.108918 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:12.108729    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6kcl" event={"ID":"ec511360-937c-4dd5-9a57-0f10382c2130","Type":"ContainerStarted","Data":"719a84cd6f5ebbea0695af966070e8eb2a4bdb91213173d85e36f365a26ef2b9"}
Jul 31 12:20:12.108918 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:12.108772    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:20:12.109148 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:12.109131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:12.126064 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:12.126003    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p6kcl" podStartSLOduration=252.26493848 podStartE2EDuration="4m14.125986131s" totalImagesPullingTime="1.861047651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:12.124215001 +0000 UTC m=+289.488196777" watchObservedRunningTime="2026-07-31 12:20:12.125986131 +0000 UTC m=+289.489967910"
Jul 31 12:20:12.209774 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:12.209746    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:13.444438 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.444407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:13.451945 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.451896    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 12:20:13.456410 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.456384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.459417 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.459382    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 31 12:20:13.459668 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.459648    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 31 12:20:13.459881 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.459860    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 31 12:20:13.460616 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.460591    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 31 12:20:13.460736 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.460617    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8vf6bc7rg7ev8\""
Jul 31 12:20:13.460736 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.460695    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jt8dt\""
Jul 31 12:20:13.460874 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.460735    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 31 12:20:13.460930 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.460875    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 31 12:20:13.460930 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.460898    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 31 12:20:13.461030 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.460997    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 31 12:20:13.461030 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.461006    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 31 12:20:13.461129 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.461075    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 31 12:20:13.461129 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.461121    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 31 12:20:13.461263 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.461222    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 31 12:20:13.461263 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.461249    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 31 12:20:13.461727 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.461606    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 31 12:20:13.462927 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.462905    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 31 12:20:13.476076 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.476031    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 12:20:13.548093 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548052    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-config\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548093 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bqdf\" (UniqueName: \"kubernetes.io/projected/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-kube-api-access-8bqdf\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548453 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548142    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548453 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548186    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548453 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548237    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548453 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548453 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548370    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548453 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548480    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548515    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548545    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548569    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548623    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-web-config\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548702    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.548745 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548747    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-config-out\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.549175 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.548902    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649305 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649274    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649305 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649327    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649540    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.649575 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-web-config\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649618    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649670    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649692    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-config-out\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649775    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-config\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bqdf\" (UniqueName: \"kubernetes.io/projected/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-kube-api-access-8bqdf\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.650067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.649982    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.651151 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.650818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.651350 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.651321    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.651763 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.651731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.652543 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.652518    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.655300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.652787    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.655300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.653222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.655300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.653417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.655709 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.655679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.656175 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.656134    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.656345 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.656323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.656608 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.656585    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.656785 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.656765    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-config-out\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.656856 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.656826    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.657741 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.657716    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-web-config\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.657818 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.657768    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.657935 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.657911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.660484 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.660450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.660584 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.660456    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-config\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.662719 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.662696    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bqdf\" (UniqueName: \"kubernetes.io/projected/e961eef5-c3d2-4548-aa41-7d8ab8a43f25-kube-api-access-8bqdf\") pod \"prometheus-k8s-0\" (UID: \"e961eef5-c3d2-4548-aa41-7d8ab8a43f25\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.768744 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.768649    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:13.944814 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:13.944703    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 12:20:13.948399 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:20:13.948364    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode961eef5_c3d2_4548_aa41_7d8ab8a43f25.slice/crio-7688fd3364fe9695b31409d69f87d768f3a83d7c4826b905031ec435e5e110be WatchSource:0}: Error finding container 7688fd3364fe9695b31409d69f87d768f3a83d7c4826b905031ec435e5e110be: Status 404 returned error can't find the container with id 7688fd3364fe9695b31409d69f87d768f3a83d7c4826b905031ec435e5e110be
Jul 31 12:20:14.120882 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.120786    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerStarted","Data":"7688fd3364fe9695b31409d69f87d768f3a83d7c4826b905031ec435e5e110be"}
Jul 31 12:20:14.483502 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.483433    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" podUID="bb5be62e-1cbc-402f-b16e-56478ae5113d" containerName="registry" containerID="cri-o://179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a" gracePeriod=30
Jul 31 12:20:14.923040 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.923012    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:20:14.961579 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961551    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.961705 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961603    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxd2n\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-kube-api-access-bxd2n\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.961705 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961630    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-image-registry-private-configuration\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.961845 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961769    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-bound-sa-token\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.961845 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961814    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-installation-pull-secrets\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.961951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961846    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-certificates\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.961951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961883    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-trusted-ca\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.961951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.961942    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb5be62e-1cbc-402f-b16e-56478ae5113d-ca-trust-extracted\") pod \"bb5be62e-1cbc-402f-b16e-56478ae5113d\" (UID: \"bb5be62e-1cbc-402f-b16e-56478ae5113d\") "
Jul 31 12:20:14.962618 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.962590    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 12:20:14.963060 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.963034    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 12:20:14.964461 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.964419    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 12:20:14.964988 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.964954    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 12:20:14.965188 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.965133    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 12:20:14.965434 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.965408    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-kube-api-access-bxd2n" (OuterVolumeSpecName: "kube-api-access-bxd2n") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "kube-api-access-bxd2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 12:20:14.966944 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.966921    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 12:20:14.974926 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:14.974888    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb5be62e-1cbc-402f-b16e-56478ae5113d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bb5be62e-1cbc-402f-b16e-56478ae5113d" (UID: "bb5be62e-1cbc-402f-b16e-56478ae5113d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:20:15.049615 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.049585    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:15.063002 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.062966    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb5be62e-1cbc-402f-b16e-56478ae5113d-ca-trust-extracted\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.063002 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.062998    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-tls\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.063002 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.063009    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxd2n\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-kube-api-access-bxd2n\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.063255 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.063018    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-image-registry-private-configuration\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.063255 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.063029    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5be62e-1cbc-402f-b16e-56478ae5113d-bound-sa-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.063255 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.063037    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb5be62e-1cbc-402f-b16e-56478ae5113d-installation-pull-secrets\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.063255 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.063044    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-registry-certificates\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.063255 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.063052    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb5be62e-1cbc-402f-b16e-56478ae5113d-trusted-ca\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:20:15.098293 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.098256    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:15.126345 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.126312    2584 generic.go:356] "Generic (PLEG): container finished" podID="e961eef5-c3d2-4548-aa41-7d8ab8a43f25" containerID="177839d3558026574bf70ae4f1a5b7fc8b66046829159b561d09baa2ac6d5fe7" exitCode=0
Jul 31 12:20:15.126534 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.126392    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerDied","Data":"177839d3558026574bf70ae4f1a5b7fc8b66046829159b561d09baa2ac6d5fe7"}
Jul 31 12:20:15.127787 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.127765    2584 generic.go:356] "Generic (PLEG): container finished" podID="bb5be62e-1cbc-402f-b16e-56478ae5113d" containerID="179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a" exitCode=0
Jul 31 12:20:15.127895 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.127800    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" event={"ID":"bb5be62e-1cbc-402f-b16e-56478ae5113d","Type":"ContainerDied","Data":"179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a"}
Jul 31 12:20:15.127895 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.127827    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr"
Jul 31 12:20:15.127895 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.127843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57687ffbc-jlxwr" event={"ID":"bb5be62e-1cbc-402f-b16e-56478ae5113d","Type":"ContainerDied","Data":"7635cbd308715ea896e429dbb64dfd1e6920017293821149b979174b59d1c9d1"}
Jul 31 12:20:15.127895 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.127866    2584 scope.go:117] "RemoveContainer" containerID="179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a"
Jul 31 12:20:15.136801 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.136784    2584 scope.go:117] "RemoveContainer" containerID="179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a"
Jul 31 12:20:15.137105 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:20:15.137087    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a\": container with ID starting with 179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a not found: ID does not exist" containerID="179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a"
Jul 31 12:20:15.137149 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.137116    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a"} err="failed to get container status \"179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a\": rpc error: code = NotFound desc = could not find container \"179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a\": container with ID starting with 179ed6da9dedf9b36fc011da2dd5ea30a825137d75a9acbfa49c069d27791a2a not found: ID does not exist"
Jul 31 12:20:15.168848 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.168779    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57687ffbc-jlxwr"]
Jul 31 12:20:15.171075 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:15.171049    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57687ffbc-jlxwr"]
Jul 31 12:20:16.163134 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:20:16.163091    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zz2qs" podUID="6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7"
Jul 31 12:20:17.167096 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:17.167059    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb5be62e-1cbc-402f-b16e-56478ae5113d" path="/var/lib/kubelet/pods/bb5be62e-1cbc-402f-b16e-56478ae5113d/volumes"
Jul 31 12:20:18.324952 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:18.324882    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:18.397666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:18.397606    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:18.462902 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:18.462386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:18.561850 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:18.561741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:18.615328 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:18.615293    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:19.148926 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:19.148892    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerStarted","Data":"774de156c9b1b5de803d0dc5abb5b6dc7f4a63971e9faea9099caa5b6f66b228"}
Jul 31 12:20:19.149115 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:19.148995    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerStarted","Data":"879d77bb8301f31c8dda9208ea1a40efe230ce424fe9ea3727381eaf97ace74c"}
Jul 31 12:20:19.549412 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:19.549373    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:19.650633 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:19.650587    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:21.159521 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:21.159484    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerStarted","Data":"30035850f9d9124ec0679d3ffea7f6462e2df7630a46c8ea295d9ea28c02ca57"}
Jul 31 12:20:21.159884 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:21.159568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerStarted","Data":"68d3e523871706e3f30b9a46b82ec865c2490bfbe3cbc8e92d18c75a265e2586"}
Jul 31 12:20:21.159884 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:21.159611    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerStarted","Data":"560a7847f551f6cbe5d6a4bfa1e9f1a525f4a0f21583cb703e0a62701cc142ea"}
Jul 31 12:20:21.159884 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:21.159648    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e961eef5-c3d2-4548-aa41-7d8ab8a43f25","Type":"ContainerStarted","Data":"8b47fed3cd67faa60b5dfc0e62a39bee4d24056654a50f6b2a3f5a6584675a43"}
Jul 31 12:20:21.188431 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:21.188373    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.263029857 podStartE2EDuration="8.188353387s" totalImagesPullingTime="5.903522272s" totalInitContainerRuntime="21.801258ms" isStatefulPod=false podCreationTimestamp="2026-07-31 12:20:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:20:21.18662029 +0000 UTC m=+298.550602083" watchObservedRunningTime="2026-07-31 12:20:21.188353387 +0000 UTC m=+298.552335167"
Jul 31 12:20:22.114962 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:22.114927    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p6kcl"
Jul 31 12:20:22.992066 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:22.992035    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:20:22.992469 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:22.992115    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:20:23.003328 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:23.003294    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 12:20:23.769527 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:23.769487    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:20:24.549997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:24.549952    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:24.607361 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:24.607325    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:24.661497 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:24.661460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:25.092533 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:25.092504    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:25.146408 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:25.146376    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:27.160822 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:27.160788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:20:28.120642 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:28.120607    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:28.221840 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:28.221797    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:31.239462 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:31.239424    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:31.337829 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:31.337796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:34.170761 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:34.170723    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:34.269451 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:34.269414    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:40.747882 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:40.747848    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:40.850586 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:40.850554    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:55.753090 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:55.753044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:20:55.818425 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:20:55.818388    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:13.769134 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:13.769032    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:21:13.785813 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:13.785783    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:21:14.380045 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:14.380018    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 12:21:26.451269 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:26.451229    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:26.614312 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:26.614275    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:28.791012 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:28.790957    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:28.894010 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:28.893975    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:34.888232 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:34.888188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:34.942349 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:34.942313    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:37.005381 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:37.005339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:21:37.007901 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:37.007881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7-metrics-certs\") pod \"network-metrics-daemon-zz2qs\" (UID: \"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7\") " pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:21:37.064374 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:37.064343    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qqfkp\""
Jul 31 12:21:37.072256 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:37.072232    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zz2qs"
Jul 31 12:21:37.209601 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:37.209571    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zz2qs"]
Jul 31 12:21:37.212711 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:21:37.212686    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6590a2f9_f9c3_4f5d_ba30_3fbbeb32f2c7.slice/crio-c7bae05328dbf9d10e28c8790d336178cf31191d3b78f9ef35394641ec4c59ae WatchSource:0}: Error finding container c7bae05328dbf9d10e28c8790d336178cf31191d3b78f9ef35394641ec4c59ae: Status 404 returned error can't find the container with id c7bae05328dbf9d10e28c8790d336178cf31191d3b78f9ef35394641ec4c59ae
Jul 31 12:21:37.215191 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:37.215171    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 12:21:37.451141 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:37.451090    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zz2qs" event={"ID":"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7","Type":"ContainerStarted","Data":"c7bae05328dbf9d10e28c8790d336178cf31191d3b78f9ef35394641ec4c59ae"}
Jul 31 12:21:38.457141 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:38.457097    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zz2qs" event={"ID":"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7","Type":"ContainerStarted","Data":"9619e7f1641918c9f2059a0c41e44ba8d6626c31667c3b63035efe4a30e65da2"}
Jul 31 12:21:38.457570 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:38.457182    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zz2qs" event={"ID":"6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7","Type":"ContainerStarted","Data":"6abff048b52988475a699b2dae8497cd855a80b443a0737c34d5255b48120163"}
Jul 31 12:21:38.475565 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:38.475516    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zz2qs" podStartSLOduration=374.651972889 podStartE2EDuration="6m15.475493645s" totalImagesPullingTime="823.520756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:21:38.473616811 +0000 UTC m=+375.837598594" watchObservedRunningTime="2026-07-31 12:21:38.475493645 +0000 UTC m=+375.839475425"
Jul 31 12:21:38.556874 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:38.556838    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:38.611891 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:38.611866    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:41.658953 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:41.658883    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:41.759944 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:41.759908    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:46.258502 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:46.258459    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:46.309607 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:46.309570    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:46.862742 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:46.862706    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:46.963335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:46.963299    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:53.612105 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:53.612071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:53.662847 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:53.662806    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:56.971929 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:56.971896    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:57.036142 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:57.036104    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:21:57.092355 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:21:57.092318    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:22:10.766326 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:22:10.766288    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:22:10.868583 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:22:10.868548    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:22:14.591939 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:22:14.591898    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:22:14.645782 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:22:14.645748    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:01.231668 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:01.231626    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:01.330137 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:01.330106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:27.920449 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:27.920407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:28.747052 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:28.747012    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:31.095869 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:31.095836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:32.326795 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:32.326756    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:32.427146 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:32.427113    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:33.604714 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:33.604676    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:33.712654 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:33.712618    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:34.228034 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:34.228002    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:34.330580 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:34.330544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:36.240483 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:36.240441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:36.631817 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:36.631717    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:39.121770 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:39.121738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:39.174471 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:39.174441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:40.682437 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:40.682393    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:40.791281 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:40.791239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:44.564372 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:44.564335    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:44.659740 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:44.659699    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:44.868568 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:44.868452    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:51.078625 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:51.078582    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:51.179451 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:51.179412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:23:53.124810 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:23:53.124773    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:08.739681 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:08.739641    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:08.840847 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:08.840795    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:09.357066 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.357024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:09.595736 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.595706    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:09.698541 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.698505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:09.741720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.741682    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"]
Jul 31 12:24:09.742096 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.741989    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb5be62e-1cbc-402f-b16e-56478ae5113d" containerName="registry"
Jul 31 12:24:09.742096 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.742001    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb5be62e-1cbc-402f-b16e-56478ae5113d" containerName="registry"
Jul 31 12:24:09.742096 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.742061    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb5be62e-1cbc-402f-b16e-56478ae5113d" containerName="registry"
Jul 31 12:24:09.745297 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.745277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.748022 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.747990    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 12:24:09.748223 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.748108    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 12:24:09.748223 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.748119    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4n6bj\""
Jul 31 12:24:09.748439 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.748425    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 12:24:09.748494 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.748460    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 12:24:09.763772 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.763730    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"]
Jul 31 12:24:09.848983 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.848945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca49fdd-bed4-47fe-8020-a56f714d53d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.849223 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.849003    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ca49fdd-bed4-47fe-8020-a56f714d53d7-manifests\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.849223 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.849126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ca49fdd-bed4-47fe-8020-a56f714d53d7-tmp\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.849223 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.849191    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjcx\" (UniqueName: \"kubernetes.io/projected/3ca49fdd-bed4-47fe-8020-a56f714d53d7-kube-api-access-5kjcx\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.849394 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.849267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ca49fdd-bed4-47fe-8020-a56f714d53d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.894114 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.894083    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:09.950060 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.949965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ca49fdd-bed4-47fe-8020-a56f714d53d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.950060 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.950019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca49fdd-bed4-47fe-8020-a56f714d53d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.950060 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.950042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ca49fdd-bed4-47fe-8020-a56f714d53d7-manifests\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.950330 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.950075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ca49fdd-bed4-47fe-8020-a56f714d53d7-tmp\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.950330 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.950103    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjcx\" (UniqueName: \"kubernetes.io/projected/3ca49fdd-bed4-47fe-8020-a56f714d53d7-kube-api-access-5kjcx\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.950541 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.950516    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ca49fdd-bed4-47fe-8020-a56f714d53d7-manifests\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.952647 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.952621    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ca49fdd-bed4-47fe-8020-a56f714d53d7-tmp\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.952765 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.952720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ca49fdd-bed4-47fe-8020-a56f714d53d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.952837 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.952820    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca49fdd-bed4-47fe-8020-a56f714d53d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.958486 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.958461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjcx\" (UniqueName: \"kubernetes.io/projected/3ca49fdd-bed4-47fe-8020-a56f714d53d7-kube-api-access-5kjcx\") pod \"opendatahub-operator-controller-manager-5996b4548f-jfns6\" (UID: \"3ca49fdd-bed4-47fe-8020-a56f714d53d7\") " pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:09.994380 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:09.994346    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:10.056090 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:10.056051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:10.094746 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:10.094711    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:10.188639 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:10.188602    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:10.204216 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:10.204110    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"]
Jul 31 12:24:10.209040 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:24:10.209014    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca49fdd_bed4_47fe_8020_a56f714d53d7.slice/crio-06e3e271a5c9c9622871921b3855d584d4bc4aa9bbcc7ed43d04264425abcd25 WatchSource:0}: Error finding container 06e3e271a5c9c9622871921b3855d584d4bc4aa9bbcc7ed43d04264425abcd25: Status 404 returned error can't find the container with id 06e3e271a5c9c9622871921b3855d584d4bc4aa9bbcc7ed43d04264425abcd25
Jul 31 12:24:10.270704 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:10.270670    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:10.370400 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:10.370367    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:11.041715 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:11.041673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6" event={"ID":"3ca49fdd-bed4-47fe-8020-a56f714d53d7","Type":"ContainerStarted","Data":"06e3e271a5c9c9622871921b3855d584d4bc4aa9bbcc7ed43d04264425abcd25"}
Jul 31 12:24:11.343445 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:11.343321    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:14.057320 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:14.057281    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6" event={"ID":"3ca49fdd-bed4-47fe-8020-a56f714d53d7","Type":"ContainerStarted","Data":"9d9e8a09332af63c09e0dc44f3b5e0fd38c10fe40bcb048b65b295d248f4cf40"}
Jul 31 12:24:15.062876 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:15.062841    2584 generic.go:356] "Generic (PLEG): container finished" podID="3ca49fdd-bed4-47fe-8020-a56f714d53d7" containerID="9d9e8a09332af63c09e0dc44f3b5e0fd38c10fe40bcb048b65b295d248f4cf40" exitCode=0
Jul 31 12:24:15.063268 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:15.062929    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6" event={"ID":"3ca49fdd-bed4-47fe-8020-a56f714d53d7","Type":"ContainerDied","Data":"9d9e8a09332af63c09e0dc44f3b5e0fd38c10fe40bcb048b65b295d248f4cf40"}
Jul 31 12:24:16.069688 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:16.069634    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6" event={"ID":"3ca49fdd-bed4-47fe-8020-a56f714d53d7","Type":"ContainerStarted","Data":"76170e9d45baa792fc0f0ae88536077a2bb301db8cb3441bbefe69262f6f32fa"}
Jul 31 12:24:16.070083 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:16.069727    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:16.092623 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:16.092566    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6" podStartSLOduration=2.787203715 podStartE2EDuration="7.092529885s" totalImagesPullingTime="3.276784254s" totalInitContainerRuntime="1.028541916s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:24:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:24:16.090468739 +0000 UTC m=+533.454450530" watchObservedRunningTime="2026-07-31 12:24:16.092529885 +0000 UTC m=+533.456511661"
Jul 31 12:24:19.311308 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:19.311269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:19.418642 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:19.418603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:27.076933 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:27.076898    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5996b4548f-jfns6"
Jul 31 12:24:28.659504 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:28.659468    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:28.768244 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:28.768192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:29.087595 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.087503    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:29.372070 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.371990    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84cd848656-799gr"]
Jul 31 12:24:29.387271 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.387240    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.390092 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.390066    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 31 12:24:29.390354 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.390329    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 31 12:24:29.390433 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.390127    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pcrdc\""
Jul 31 12:24:29.393522 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.393494    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84cd848656-799gr"]
Jul 31 12:24:29.421990 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.421936    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:29.424076 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.424053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47x9\" (UniqueName: \"kubernetes.io/projected/02a65523-f000-43b8-969c-e38ca24683ac-kube-api-access-m47x9\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.424211 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.424090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a65523-f000-43b8-969c-e38ca24683ac-tmp\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.424211 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.424117    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02a65523-f000-43b8-969c-e38ca24683ac-tls-certs\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.495918 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.495867    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:29.525102 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.525047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47x9\" (UniqueName: \"kubernetes.io/projected/02a65523-f000-43b8-969c-e38ca24683ac-kube-api-access-m47x9\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.525297 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.525129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a65523-f000-43b8-969c-e38ca24683ac-tmp\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.525297 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.525190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02a65523-f000-43b8-969c-e38ca24683ac-tls-certs\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.527620 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.527596    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a65523-f000-43b8-969c-e38ca24683ac-tmp\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.527766 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.527730    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02a65523-f000-43b8-969c-e38ca24683ac-tls-certs\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.533818 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.533790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47x9\" (UniqueName: \"kubernetes.io/projected/02a65523-f000-43b8-969c-e38ca24683ac-kube-api-access-m47x9\") pod \"kube-auth-proxy-84cd848656-799gr\" (UID: \"02a65523-f000-43b8-969c-e38ca24683ac\") " pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.596793 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.596761    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:29.699300 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.699261    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr"
Jul 31 12:24:29.871005 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.870974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84cd848656-799gr"]
Jul 31 12:24:29.873637 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:24:29.873607    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a65523_f000_43b8_969c_e38ca24683ac.slice/crio-01b74d0969de023950d2c8b9ba7f6f8d64ad94c3f457650dd93034e9d6421278 WatchSource:0}: Error finding container 01b74d0969de023950d2c8b9ba7f6f8d64ad94c3f457650dd93034e9d6421278: Status 404 returned error can't find the container with id 01b74d0969de023950d2c8b9ba7f6f8d64ad94c3f457650dd93034e9d6421278
Jul 31 12:24:29.916780 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:29.916747    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:30.053514 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:30.053422    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:30.131059 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:30.131017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr" event={"ID":"02a65523-f000-43b8-969c-e38ca24683ac","Type":"ContainerStarted","Data":"01b74d0969de023950d2c8b9ba7f6f8d64ad94c3f457650dd93034e9d6421278"}
Jul 31 12:24:30.343456 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:30.343337    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:30.475311 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:30.475271    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:30.572951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:30.572913    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:31.415750 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:31.415707    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:33.148038 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:33.147986    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr" event={"ID":"02a65523-f000-43b8-969c-e38ca24683ac","Type":"ContainerStarted","Data":"2a07ab09f612428cfbf615e65980aa20f3651863e794372a19d9a13a4da57b71"}
Jul 31 12:24:33.165342 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:33.165289    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84cd848656-799gr" podStartSLOduration=1.4032693680000001 podStartE2EDuration="4.165272137s" totalImagesPullingTime="2.762002769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:24:33.163232046 +0000 UTC m=+550.527213827" watchObservedRunningTime="2026-07-31 12:24:33.165272137 +0000 UTC m=+550.529253943"
Jul 31 12:24:36.241966 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:36.241933    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:36.339033 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:36.339000    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:36.601623 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:36.601513    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:36.693330 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:36.693294    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:36.790049 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:36.790016    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:38.266866 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.266836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:38.647574 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.647493    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"]
Jul 31 12:24:38.650840 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.650819    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.654621 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.654594    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m8htf\""
Jul 31 12:24:38.654775 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.654757    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 12:24:38.667071 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.667034    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"]
Jul 31 12:24:38.695422 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695391    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695431    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj2fm\" (UniqueName: \"kubernetes.io/projected/67a5f21c-0ef2-44ab-970a-2b0fd992b449-kube-api-access-hj2fm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695457    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695479    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695503    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695570    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695613 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695585    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.695865 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.695621    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.705478 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.705451    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"]
Jul 31 12:24:38.708664 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.708643    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.711815 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.711787    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 31 12:24:38.712067 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.712051    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 31 12:24:38.712343 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.712322    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 31 12:24:38.712413 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.712370    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rj97x\""
Jul 31 12:24:38.724642 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.724611    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"]
Jul 31 12:24:38.796829 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.796785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.796829 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.796821    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797219 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.796860    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797219 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.796902    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.797219 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.796944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797219 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.796969    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.797219 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.797219 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcvk8\" (UniqueName: \"kubernetes.io/projected/c6724ba8-6404-41e2-bac4-6fd046eeba54-kube-api-access-qcvk8\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.797219 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797186    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj2fm\" (UniqueName: \"kubernetes.io/projected/67a5f21c-0ef2-44ab-970a-2b0fd992b449-kube-api-access-hj2fm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797236    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797281    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797318    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797353    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797355    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797477    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.797693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797501    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6724ba8-6404-41e2-bac4-6fd046eeba54-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.798123 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797836    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.798123 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.797883    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.798235 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.798140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.800118 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.800089    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.800286 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.800267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.810056 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.810025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67a5f21c-0ef2-44ab-970a-2b0fd992b449-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.810151 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.810110    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj2fm\" (UniqueName: \"kubernetes.io/projected/67a5f21c-0ef2-44ab-970a-2b0fd992b449-kube-api-access-hj2fm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9\" (UID: \"67a5f21c-0ef2-44ab-970a-2b0fd992b449\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:38.898705 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.898597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.898705 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.898643    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.898705 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.898680    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6724ba8-6404-41e2-bac4-6fd046eeba54-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.898992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.898732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.898992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.898766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.898992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.898789    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.898992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.898846    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvk8\" (UniqueName: \"kubernetes.io/projected/c6724ba8-6404-41e2-bac4-6fd046eeba54-kube-api-access-qcvk8\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.899546 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.899414    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.901510 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.901474    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6724ba8-6404-41e2-bac4-6fd046eeba54-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.901649 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.901574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.901990 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.901967    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.902053 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.901974    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.915334 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.915302    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcvk8\" (UniqueName: \"kubernetes.io/projected/c6724ba8-6404-41e2-bac4-6fd046eeba54-kube-api-access-qcvk8\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.915477 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.915301    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6724ba8-6404-41e2-bac4-6fd046eeba54-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tvstf\" (UID: \"c6724ba8-6404-41e2-bac4-6fd046eeba54\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:38.961302 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:38.961262    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:39.018456 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.018422    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:39.098382 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.098314    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:39.127620 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.127592    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"]
Jul 31 12:24:39.130269 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:24:39.130240    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a5f21c_0ef2_44ab_970a_2b0fd992b449.slice/crio-28f4e015286dede0b32eba257ba51b145a2239df3e76add880b01bd4d227bd1b WatchSource:0}: Error finding container 28f4e015286dede0b32eba257ba51b145a2239df3e76add880b01bd4d227bd1b: Status 404 returned error can't find the container with id 28f4e015286dede0b32eba257ba51b145a2239df3e76add880b01bd4d227bd1b
Jul 31 12:24:39.174999 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.174961    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9" event={"ID":"67a5f21c-0ef2-44ab-970a-2b0fd992b449","Type":"ContainerStarted","Data":"28f4e015286dede0b32eba257ba51b145a2239df3e76add880b01bd4d227bd1b"}
Jul 31 12:24:39.180712 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.180676    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"]
Jul 31 12:24:39.184601 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:24:39.184575    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6724ba8_6404_41e2_bac4_6fd046eeba54.slice/crio-9a1b11db1ef0954a90e0f2a1f4cb9b88e72892595a03c510b321b57787e47bf4 WatchSource:0}: Error finding container 9a1b11db1ef0954a90e0f2a1f4cb9b88e72892595a03c510b321b57787e47bf4: Status 404 returned error can't find the container with id 9a1b11db1ef0954a90e0f2a1f4cb9b88e72892595a03c510b321b57787e47bf4
Jul 31 12:24:39.716657 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.716622    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"]
Jul 31 12:24:39.720084 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.720055    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.725770 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.725607    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 12:24:39.726669 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.726641    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 12:24:39.726850 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.726641    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w8xbd\""
Jul 31 12:24:39.727172 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.727133    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 12:24:39.727283 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.727134    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 12:24:39.727401 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.727387    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 12:24:39.743097 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.743055    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"]
Jul 31 12:24:39.807982 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.807938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gqkf\" (UniqueName: \"kubernetes.io/projected/ecdcda26-b97a-4889-9d0b-17af7e658e8a-kube-api-access-4gqkf\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.808226 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.808006    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ecdcda26-b97a-4889-9d0b-17af7e658e8a-manager-config\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.808226 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.808085    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecdcda26-b97a-4889-9d0b-17af7e658e8a-cert\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.808226 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.808119    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecdcda26-b97a-4889-9d0b-17af7e658e8a-metrics-cert\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.910342 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.910302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gqkf\" (UniqueName: \"kubernetes.io/projected/ecdcda26-b97a-4889-9d0b-17af7e658e8a-kube-api-access-4gqkf\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.910535 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.910390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ecdcda26-b97a-4889-9d0b-17af7e658e8a-manager-config\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.910535 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.910474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecdcda26-b97a-4889-9d0b-17af7e658e8a-cert\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.910535 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.910514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecdcda26-b97a-4889-9d0b-17af7e658e8a-metrics-cert\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.911335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.911278    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ecdcda26-b97a-4889-9d0b-17af7e658e8a-manager-config\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.914201 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.914140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecdcda26-b97a-4889-9d0b-17af7e658e8a-cert\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.914625 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.914603    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecdcda26-b97a-4889-9d0b-17af7e658e8a-metrics-cert\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:39.922677 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:39.922622    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gqkf\" (UniqueName: \"kubernetes.io/projected/ecdcda26-b97a-4889-9d0b-17af7e658e8a-kube-api-access-4gqkf\") pod \"lws-controller-manager-7f679cb99-8cr57\" (UID: \"ecdcda26-b97a-4889-9d0b-17af7e658e8a\") " pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:40.035551 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:40.035150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:40.185819 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:40.185782    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf" event={"ID":"c6724ba8-6404-41e2-bac4-6fd046eeba54","Type":"ContainerStarted","Data":"9a1b11db1ef0954a90e0f2a1f4cb9b88e72892595a03c510b321b57787e47bf4"}
Jul 31 12:24:40.251114 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:40.251077    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"]
Jul 31 12:24:40.252800 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:24:40.252768    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdcda26_b97a_4889_9d0b_17af7e658e8a.slice/crio-1cb81be88106d9faa317b0fe116d2b28aeea10474dde729b8348d28c35238c27 WatchSource:0}: Error finding container 1cb81be88106d9faa317b0fe116d2b28aeea10474dde729b8348d28c35238c27: Status 404 returned error can't find the container with id 1cb81be88106d9faa317b0fe116d2b28aeea10474dde729b8348d28c35238c27
Jul 31 12:24:40.645919 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:40.645875    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:40.752563 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:40.752428    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:40.861990 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:40.861954    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:41.168620 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:41.168581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:41.192777 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:41.192731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57" event={"ID":"ecdcda26-b97a-4889-9d0b-17af7e658e8a","Type":"ContainerStarted","Data":"1cb81be88106d9faa317b0fe116d2b28aeea10474dde729b8348d28c35238c27"}
Jul 31 12:24:41.952788 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:41.952750    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:42.068746 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:42.068712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:42.168859 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:42.168796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:42.684653 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:42.684616    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:24:42.684738 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:42.684683    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:24:42.688168 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:42.688123    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:24:42.688250 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:42.688220    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:24:42.688285 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:42.688260    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:24:43.206231 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.205832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9" event={"ID":"67a5f21c-0ef2-44ab-970a-2b0fd992b449","Type":"ContainerStarted","Data":"4e2a790a0364a2e07704c59bf876288c38171ca3edf1703f358779663464aa96"}
Jul 31 12:24:43.208239 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.208208    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf" event={"ID":"c6724ba8-6404-41e2-bac4-6fd046eeba54","Type":"ContainerStarted","Data":"f806c1cdc85bdc11b8a26faeb5f0b40c76476ffe466e56d2de990837bcd5286d"}
Jul 31 12:24:43.208906 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.208886    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:43.212983 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.210652    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-tvstf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 12:24:43.212983 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.210708    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf" podUID="c6724ba8-6404-41e2-bac4-6fd046eeba54" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 12:24:43.228788 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.228727    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9" podStartSLOduration=1.673818731 podStartE2EDuration="5.22870353s" totalImagesPullingTime="3.554884799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:24:43.226414731 +0000 UTC m=+560.590396511" watchObservedRunningTime="2026-07-31 12:24:43.22870353 +0000 UTC m=+560.592685311"
Jul 31 12:24:43.246451 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.245887    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf" podStartSLOduration=1.748177791 podStartE2EDuration="5.245864313s" totalImagesPullingTime="3.497686522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:24:43.244972355 +0000 UTC m=+560.608954162" watchObservedRunningTime="2026-07-31 12:24:43.245864313 +0000 UTC m=+560.609846092"
Jul 31 12:24:43.962417 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.962377    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:43.967833 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:43.967802    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:44.213555 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:44.213438    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:44.214191 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:44.214145    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tvstf"
Jul 31 12:24:44.214709 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:44.214693    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9"
Jul 31 12:24:45.218628 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:45.218580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57" event={"ID":"ecdcda26-b97a-4889-9d0b-17af7e658e8a","Type":"ContainerStarted","Data":"cb705c4bef1c748803c536e5541ec1dbc19d6125fd44c130a537d5d9d1336f33"}
Jul 31 12:24:45.219025 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:45.218978    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:24:45.241079 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:45.241023    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57" podStartSLOduration=1.948884059 podStartE2EDuration="6.241009365s" totalImagesPullingTime="4.292125306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:24:45.238899987 +0000 UTC m=+562.602881766" watchObservedRunningTime="2026-07-31 12:24:45.241009365 +0000 UTC m=+562.604991144"
Jul 31 12:24:52.267857 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:52.267818    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:52.368316 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:52.368280    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:24:56.226578 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:24:56.226545    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f679cb99-8cr57"
Jul 31 12:25:10.855707 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:10.855668    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:14.980523 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:14.980483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:16.357878 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:16.357834    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:23.019150 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:23.019115    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:25:23.025053 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:23.021601    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:25:26.001284 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:26.001248    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:26.106971 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:26.106937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:26.208193 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:26.208133    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:29.645179 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:29.645123    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:29.746196 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:29.746140    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:30.455020 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:30.454976    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:30.556986 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:30.556950    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:41.622568 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:41.622514    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:42.472493 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:42.472456    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:45.636269 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:45.636180    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:45.895501 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:45.895405    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:47.296192 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:47.296128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:47.940833 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:47.940793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:48.247045 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:48.246955    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:48.639632 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:48.639538    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:48.912910 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:48.912872    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:49.005615 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:49.005581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:52.087931 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:52.087891    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:53.482531 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:53.482485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:55.038414 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:55.038379    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:55.135713 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:55.135678    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:55.426749 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:55.426715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:55.541997 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:55.541962    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:58.582375 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:58.582340    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:58.882589 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:58.882505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:59.029494 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:59.029455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:25:59.079298 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:25:59.079268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:04.582680 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:04.582639    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:04.682427 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:04.682376    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:04.782451 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:04.782413    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:11.691598 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:11.691563    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:11.792451 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:11.792416    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:15.658541 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:15.658505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:15.759263 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:15.759235    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:16.261498 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:16.261451    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:16.362554 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:16.362522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:19.266182 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:19.266117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:19.365682 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:19.365637    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:24.622687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:24.622644    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:24.722538 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:24.722501    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:24.794826 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:24.794791    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:31.663443 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:31.663404    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:31.764361 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:31.764319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:41.636345 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:41.636309    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:41.735989 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:41.735951    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:50.136022 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:50.135969    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:53.177609 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:53.177573    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:53.239596 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:53.239567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:53.924146 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:53.924105    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:26:54.023108 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:26:54.023076    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:12.269753 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:12.269720    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:12.370364 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:12.370320    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:12.726105 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:12.726071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:25.383765 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:25.383724    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:25.780528 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:25.780485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:31.781001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:31.780960    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:31.885548 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:31.885512    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:31.962631 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:31.962596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:32.202353 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:32.202313    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:33.323970 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:33.323934    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:33.382003 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:33.381973    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:35.005034 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:35.004997    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:27:35.105597 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:27:35.105559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:05.920571 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:05.920534    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:05.984139 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:05.984104    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:07.598812 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:07.598770    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:07.798468 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:07.798429    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:08.055451 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:08.055409    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:08.145564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:08.145519    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:18.320720 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:18.320680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:18.419417 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:18.419382    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:34.374646 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:34.374609    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:41.374520 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:41.374480    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:50.900497 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:50.900403    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:28:58.411593 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:28:58.411554    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:29:02.988443 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:29:02.988412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:29:10.888415 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:29:10.888378    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:29:34.714285 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:29:34.714248    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:29:34.779933 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:29:34.779899    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:29:57.955930 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:29:57.955894    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:30:05.760517 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:05.760485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:30:05.839419 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:05.839390    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:30:23.049850 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:23.049817    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:30:23.052676 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:23.052645    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:30:26.552367 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:26.552328    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:30:27.646380 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:27.646347    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:30:27.853184 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:27.853128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:30:27.959345 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:30:27.959308    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:32:09.186370 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:32:09.186331    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:32:15.696081 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:32:15.696044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:32:15.747238 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:32:15.747200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:32:33.020002 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:32:33.019966    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:32:34.267081 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:32:34.267046    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:37.552014 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:37.551927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:37.652900 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:37.652870    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:37.786514 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:37.786480    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:43.590231 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:43.590189    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:43.655419 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:43.655388    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:43.748560 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:43.748524    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:43.874393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:43.874309    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:44.005366 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:44.005334    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:49.670802 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:49.670768    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:33:49.768493 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:33:49.768435    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:34:18.923335 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:34:18.923282    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:34:18.976986 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:34:18.976949    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:34:36.548102 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:34:36.548066    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:34:44.537612 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:34:44.537533    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:34:44.640414 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:34:44.640381    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:35:23.080199 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:35:23.080142    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:35:23.083327 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:35:23.083302    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:35:44.658532 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:35:44.658477    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:37:11.393913 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:37:11.393877    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:40:23.106439 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:40:23.106347    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:40:23.110929 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:40:23.110904    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:40:55.585633 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:40:55.585600    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:40:57.024144 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:40:57.024069    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:42:57.233197 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:42:57.233148    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:43:01.305502 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:43:01.305450    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:43:29.105833 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:43:29.105799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:43:30.048566 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:43:30.048520    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:45:05.580206 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:45:05.580147    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:45:23.137493 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:45:23.137461    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:45:23.143288 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:45:23.143256    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:45:49.528646 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:45:49.528606    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:45:49.585351 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:45:49.585312    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:46:48.224686 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:46:48.224609    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:14.186033 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:14.185995    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:17.476402 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:17.476369    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:17.569313 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:17.569284    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:17.970243 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:17.970216    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:23.767262 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:23.767228    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:23.867228 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:23.867200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:24.013949 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:24.013919    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:24.363178 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:24.363139    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:24.887251 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:24.887215    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:27.102469 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:27.102429    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:27.197629 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:27.197603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:28.194260 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:28.194229    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:28.476122 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:28.476043    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:28.830413 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:28.830338    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:47:28.937559 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:47:28.937522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:09.151344 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:09.151296    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:09.216584 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:09.216553    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:09.445427 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:09.445360    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:09.716580 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:09.716506    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:09.814888 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:09.814860    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:09.928819 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:09.928794    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:10.327942 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.327914    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"]
Jul 31 12:48:10.331358 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.331338    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.333939 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.333913    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-643d0a88-gw-openshift-default-dockercfg-dq89w\""
Jul 31 12:48:10.343135 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.343115    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"]
Jul 31 12:48:10.353052 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.353010    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:10.406502 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406475    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw4wr\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-kube-api-access-gw4wr\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406624 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-token\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406624 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-podinfo\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406741 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406638    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-certs\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406741 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406664    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-data\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406741 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db7ff0c-84b1-4c4c-84ec-06849e860659-istiod-ca-cert\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406741 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-envoy\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406953 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-socket\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.406953 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.406797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-credential-socket\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.444113 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.444094    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:10.508257 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-token\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508386 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-podinfo\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508386 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-certs\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508386 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508370    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-data\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db7ff0c-84b1-4c4c-84ec-06849e860659-istiod-ca-cert\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508416    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-envoy\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508443    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-socket\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-credential-socket\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.508564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.508539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw4wr\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-kube-api-access-gw4wr\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.509234 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.509210    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-credential-socket\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.509449 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.509428    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-certs\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.509696 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.509674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-data\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.509847 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.509827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-socket\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.509957 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.509939    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db7ff0c-84b1-4c4c-84ec-06849e860659-istiod-ca-cert\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.511609 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.511586    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-envoy\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.512043 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.512023    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-podinfo\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.516934 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.516911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-token\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.517216 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.517176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw4wr\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-kube-api-access-gw4wr\") pod \"e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") " pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.641738 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.641671    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:10.769640 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.769617    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"]
Jul 31 12:48:10.772340 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:48:10.772308    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db7ff0c_84b1_4c4c_84ec_06849e860659.slice/crio-2ad3a5f51486fe56e043c4a5ea21019282fe8b004c5efd6d3da40506f2aeb447 WatchSource:0}: Error finding container 2ad3a5f51486fe56e043c4a5ea21019282fe8b004c5efd6d3da40506f2aeb447: Status 404 returned error can't find the container with id 2ad3a5f51486fe56e043c4a5ea21019282fe8b004c5efd6d3da40506f2aeb447
Jul 31 12:48:10.774768 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.774736    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:48:10.774828 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.774806    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:48:10.774860 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:10.774837    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:48:11.415963 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:11.415928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" event={"ID":"3db7ff0c-84b1-4c4c-84ec-06849e860659","Type":"ContainerStarted","Data":"96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc"}
Jul 31 12:48:11.416310 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:11.415980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" event={"ID":"3db7ff0c-84b1-4c4c-84ec-06849e860659","Type":"ContainerStarted","Data":"2ad3a5f51486fe56e043c4a5ea21019282fe8b004c5efd6d3da40506f2aeb447"}
Jul 31 12:48:11.437065 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:11.437022    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podStartSLOduration=1.437009353 podStartE2EDuration="1.437009353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:48:11.43578569 +0000 UTC m=+1968.799767470" watchObservedRunningTime="2026-07-31 12:48:11.437009353 +0000 UTC m=+1968.800991132"
Jul 31 12:48:11.641866 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:11.641834    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:11.646880 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:11.646859    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:12.419724 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:12.419695    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:12.420552 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:12.420534    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:12.986773 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:12.986747    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:13.087194 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:13.087100    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:13.557755 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:13.557721    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:13.727546 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:13.727516    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:13.800941 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:13.800915    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:25.472956 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:25.472922    2584 generic.go:356] "Generic (PLEG): container finished" podID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerID="96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc" exitCode=0
Jul 31 12:48:25.473349 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:25.473006    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" event={"ID":"3db7ff0c-84b1-4c4c-84ec-06849e860659","Type":"ContainerDied","Data":"96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc"}
Jul 31 12:48:25.473409 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:25.473395    2584 scope.go:117] "RemoveContainer" containerID="96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc"
Jul 31 12:48:25.474351 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:25.474324    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:48:25.474427 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:25.474391    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:48:25.474466 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:25.474424    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:48:26.481345 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:26.481300    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" event={"ID":"3db7ff0c-84b1-4c4c-84ec-06849e860659","Type":"ContainerStarted","Data":"4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7"}
Jul 31 12:48:26.641951 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:26.641914    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:26.642897 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:26.642874    2584 patch_prober.go:28] interesting pod/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 31 12:48:26.642948 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:26.642924    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 31 12:48:27.420549 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:27.420513    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:27.642954 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:27.642917    2584 patch_prober.go:28] interesting pod/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 31 12:48:27.643404 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:27.642976    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 31 12:48:28.642536 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:28.642501    2584 patch_prober.go:28] interesting pod/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 31 12:48:28.642702 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:28.642550    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 31 12:48:29.642794 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:29.642760    2584 patch_prober.go:28] interesting pod/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 31 12:48:29.643270 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:29.642820    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 31 12:48:30.642313 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:30.642285    2584 patch_prober.go:28] interesting pod/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 31 12:48:30.642469 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:30.642349    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 31 12:48:31.646291 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:31.646262    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:31.647313 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:31.647292    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:44.277057 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.277020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:44.356843 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.356807    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:44.420707 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.420679    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:44.521144 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.521106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:44.616226 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.616133    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"]
Jul 31 12:48:44.616393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.616363    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy" containerID="cri-o://4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7" gracePeriod=30
Jul 31 12:48:44.651659 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.651626    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:44.913275 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:44.913239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:45.168570 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:45.168510    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:45.513115 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:45.513051    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:45.636354 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:45.636323    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:46.649079 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:46.649051    2584 patch_prober.go:28] interesting pod/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 12:48:46.649494 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:46.649110    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 12:48:47.554736 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:47.554701    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:47.649298 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:47.649266    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:48.744128 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:48.744099    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:48.892791 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:48.892759    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:49.225979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.225937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:49.319366 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.319340    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:48:49.855548 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.855522    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:49.930860 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.930837    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-token\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.930981 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.930868    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db7ff0c-84b1-4c4c-84ec-06849e860659-istiod-ca-cert\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.930981 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.930892    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw4wr\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-kube-api-access-gw4wr\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.930981 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.930910    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-socket\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.931146 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.930985    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-podinfo\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.931146 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931026    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-envoy\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.931146 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931093    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-data\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.931146 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931118    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-credential-socket\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.931363 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931202    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-certs\") pod \"3db7ff0c-84b1-4c4c-84ec-06849e860659\" (UID: \"3db7ff0c-84b1-4c4c-84ec-06849e860659\") "
Jul 31 12:48:49.931363 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931201    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:48:49.931363 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931311    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db7ff0c-84b1-4c4c-84ec-06849e860659-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 12:48:49.931508 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931429    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:48:49.931564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931523    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:48:49.931798 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931770    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-data" (OuterVolumeSpecName: "istio-data") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:48:49.931798 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931791    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db7ff0c-84b1-4c4c-84ec-06849e860659-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:49.931878 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931811    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:49.931878 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931823    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:49.931878 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.931836    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:49.933263 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.933241    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-kube-api-access-gw4wr" (OuterVolumeSpecName: "kube-api-access-gw4wr") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "kube-api-access-gw4wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 12:48:49.933346 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.933269    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-token" (OuterVolumeSpecName: "istio-token") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 12:48:49.933585 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.933558    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:48:49.933649 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:49.933558    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3db7ff0c-84b1-4c4c-84ec-06849e860659" (UID: "3db7ff0c-84b1-4c4c-84ec-06849e860659"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 12:48:50.032647 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.032626    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:50.032647 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.032648    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw4wr\" (UniqueName: \"kubernetes.io/projected/3db7ff0c-84b1-4c4c-84ec-06849e860659-kube-api-access-gw4wr\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:50.032766 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.032658    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:50.032766 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.032666    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:50.032766 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.032673    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db7ff0c-84b1-4c4c-84ec-06849e860659-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:48:50.594511 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.594470    2584 generic.go:356] "Generic (PLEG): container finished" podID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerID="4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7" exitCode=0
Jul 31 12:48:50.594696 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.594523    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" event={"ID":"3db7ff0c-84b1-4c4c-84ec-06849e860659","Type":"ContainerDied","Data":"4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7"}
Jul 31 12:48:50.594696 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.594539    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"
Jul 31 12:48:50.594696 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.594598    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc" event={"ID":"3db7ff0c-84b1-4c4c-84ec-06849e860659","Type":"ContainerDied","Data":"2ad3a5f51486fe56e043c4a5ea21019282fe8b004c5efd6d3da40506f2aeb447"}
Jul 31 12:48:50.594696 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.594621    2584 scope.go:117] "RemoveContainer" containerID="4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7"
Jul 31 12:48:50.603293 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.603279    2584 scope.go:117] "RemoveContainer" containerID="96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc"
Jul 31 12:48:50.611169 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.611138    2584 scope.go:117] "RemoveContainer" containerID="4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7"
Jul 31 12:48:50.611526 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:48:50.611508    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7\": container with ID starting with 4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7 not found: ID does not exist" containerID="4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7"
Jul 31 12:48:50.611584 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.611534    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7"} err="failed to get container status \"4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7\": rpc error: code = NotFound desc = could not find container \"4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7\": container with ID starting with 4ecb731f24d7572efc30d591c3e3e6de678a1c17e1d0ada826a088dbcfd068e7 not found: ID does not exist"
Jul 31 12:48:50.611584 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.611549    2584 scope.go:117] "RemoveContainer" containerID="96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc"
Jul 31 12:48:50.611806 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:48:50.611791    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc\": container with ID starting with 96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc not found: ID does not exist" containerID="96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc"
Jul 31 12:48:50.611848 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.611812    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc"} err="failed to get container status \"96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc\": rpc error: code = NotFound desc = could not find container \"96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc\": container with ID starting with 96e1423c9660f901c8f45fd03e09b1a504f2b965ed94e35183dd4baf0bbed2cc not found: ID does not exist"
Jul 31 12:48:50.617905 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.617881    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"]
Jul 31 12:48:50.622948 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:50.622928    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-643d0a88-gw-openshift-default-759fbc6fc6-9qrtc"]
Jul 31 12:48:51.165977 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:48:51.165950    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" path="/var/lib/kubelet/pods/3db7ff0c-84b1-4c4c-84ec-06849e860659/volumes"
Jul 31 12:49:19.123610 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:19.123576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:19.223713 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:19.223666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:19.297423 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:19.297397    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:19.355446 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:19.355412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:20.529461 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:20.529421    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:20.781521 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:20.781441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:21.010863 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.010798    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:21.353626 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.353592    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"]
Jul 31 12:49:21.353932 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.353920    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy"
Jul 31 12:49:21.353979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.353934    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy"
Jul 31 12:49:21.353979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.353943    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy"
Jul 31 12:49:21.353979 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.353950    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy"
Jul 31 12:49:21.354068 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.354005    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy"
Jul 31 12:49:21.357061 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.357037    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.360033 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.360013    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-46d34f7d-openshift-default-dockercfg-m8875\""
Jul 31 12:49:21.369648 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.369628    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"]
Jul 31 12:49:21.384140 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.384089    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:21.448908 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.448870    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-credential-socket\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449056 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.448915    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-certs\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449056 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.448963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cs7j\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-kube-api-access-4cs7j\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449056 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.449024    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istiod-ca-cert\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449056 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.449055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-envoy\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449314 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.449083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-data\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449314 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.449112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-socket\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449314 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.449195    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-token\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.449314 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.449223    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-podinfo\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.549853 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.549828    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istiod-ca-cert\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.549864    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-envoy\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.549893    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-data\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.549929    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-socket\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.549959    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-token\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-podinfo\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550229 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550178    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-credential-socket\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550525 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-data\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550525 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-certs\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550525 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cs7j\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-kube-api-access-4cs7j\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550667 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550551    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-socket\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550767 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550745    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-credential-socket\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550814 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550754    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-certs\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.550872 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.550849    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istiod-ca-cert\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.552225 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.552207    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-envoy\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.552793 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.552775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-podinfo\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.562659 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.562633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-token\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.563107 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.563086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cs7j\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-kube-api-access-4cs7j\") pod \"e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") " pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.602228 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.602202    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:21.666656 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.666631    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:21.802344 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.802316    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"]
Jul 31 12:49:21.804235 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:49:21.804206    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d667ad_1f47_46bc_9dbf_2cd499cf4199.slice/crio-d1517aa666e4211e0bf73ee45627446fd934831f79ecd1372ea7f42a90c9a64c WatchSource:0}: Error finding container d1517aa666e4211e0bf73ee45627446fd934831f79ecd1372ea7f42a90c9a64c: Status 404 returned error can't find the container with id d1517aa666e4211e0bf73ee45627446fd934831f79ecd1372ea7f42a90c9a64c
Jul 31 12:49:21.806290 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.806258    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:49:21.806356 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.806321    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:49:21.806356 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:21.806350    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:49:22.616290 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:22.616259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:22.732482 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:22.732444    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" event={"ID":"84d667ad-1f47-46bc-9dbf-2cd499cf4199","Type":"ContainerStarted","Data":"33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91"}
Jul 31 12:49:22.732635 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:22.732514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" event={"ID":"84d667ad-1f47-46bc-9dbf-2cd499cf4199","Type":"ContainerStarted","Data":"d1517aa666e4211e0bf73ee45627446fd934831f79ecd1372ea7f42a90c9a64c"}
Jul 31 12:49:22.752996 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:22.752957    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" podStartSLOduration=1.752943044 podStartE2EDuration="1.752943044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:49:22.751914857 +0000 UTC m=+2040.115896636" watchObservedRunningTime="2026-07-31 12:49:22.752943044 +0000 UTC m=+2040.116924823"
Jul 31 12:49:23.667603 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:23.667573    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:23.672289 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:23.672269    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:23.737134 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:23.737110    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:23.737880 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:23.737863    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:24.112039 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:24.111973    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:24.212181 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:24.208833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:25.343865 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:25.343809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:25.477985 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:25.477958    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:25.803301 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:25.803263    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:25.864559 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:25.864516    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:36.799668 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:36.799637    2584 generic.go:356] "Generic (PLEG): container finished" podID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerID="33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91" exitCode=0
Jul 31 12:49:36.800075 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:36.799719    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" event={"ID":"84d667ad-1f47-46bc-9dbf-2cd499cf4199","Type":"ContainerDied","Data":"33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91"}
Jul 31 12:49:36.800197 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:36.800181    2584 scope.go:117] "RemoveContainer" containerID="33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91"
Jul 31 12:49:36.801189 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:36.801137    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:49:36.801288 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:36.801223    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:49:36.801288 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:36.801264    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:49:37.805528 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:37.805490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" event={"ID":"84d667ad-1f47-46bc-9dbf-2cd499cf4199","Type":"ContainerStarted","Data":"a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486"}
Jul 31 12:49:38.667065 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:38.667029    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:38.668102 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:38.668068    2584 patch_prober.go:28] interesting pod/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 31 12:49:38.668262 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:38.668127    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 31 12:49:38.737761 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:38.737725    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:39.667342 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:39.667309    2584 patch_prober.go:28] interesting pod/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 31 12:49:39.667700 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:39.667359    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 31 12:49:40.667942 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:40.667907    2584 patch_prober.go:28] interesting pod/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 31 12:49:40.668342 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:40.667975    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 31 12:49:41.667417 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:41.667381    2584 patch_prober.go:28] interesting pod/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 31 12:49:41.667580 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:41.667464    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 31 12:49:42.670495 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:42.670464    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:42.671354 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:42.671334    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:49:55.796285 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:55.796254    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:55.896651 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:55.896619    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:55.951846 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:55.951817    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:56.073171 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:56.073074    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"]
Jul 31 12:49:56.073339 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:56.073314    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy" containerID="cri-o://a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486" gracePeriod=30
Jul 31 12:49:56.089008 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:56.088956    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:56.318476 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:56.318440    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:56.776556 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:56.776521    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:56.874040 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:56.874011    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:56.974668 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:56.974642    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:49:57.672874 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:57.672839    2584 patch_prober.go:28] interesting pod/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 31 12:49:57.673011 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:49:57.672896    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 12:50:01.318898 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.318869    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:50:01.476355 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476329    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-data\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476505 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476380    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-token\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476505 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476407    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istiod-ca-cert\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476505 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476484    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-socket\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476510    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-podinfo\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476535    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-envoy\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476545    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-data" (OuterVolumeSpecName: "istio-data") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:50:01.476666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476566    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-credential-socket\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476597    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-certs\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.476666 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476642    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cs7j\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-kube-api-access-4cs7j\") pod \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\" (UID: \"84d667ad-1f47-46bc-9dbf-2cd499cf4199\") "
Jul 31 12:50:01.477026 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476817    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:50:01.477026 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476878    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 12:50:01.477026 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476933    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.477026 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.476948    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.477026 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.477015    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:50:01.477283 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.477026    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:50:01.479123 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.479100    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 12:50:01.479265 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.479136    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-token" (OuterVolumeSpecName: "istio-token") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 12:50:01.479372 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.479356    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 12:50:01.479424 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.479394    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-kube-api-access-4cs7j" (OuterVolumeSpecName: "kube-api-access-4cs7j") pod "84d667ad-1f47-46bc-9dbf-2cd499cf4199" (UID: "84d667ad-1f47-46bc-9dbf-2cd499cf4199"). InnerVolumeSpecName "kube-api-access-4cs7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 12:50:01.577564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.577539    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.577564 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.577559    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.577687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.577568    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.577687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.577577    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84d667ad-1f47-46bc-9dbf-2cd499cf4199-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.577687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.577585    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cs7j\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-kube-api-access-4cs7j\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.577687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.577593    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.577687 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.577601    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84d667ad-1f47-46bc-9dbf-2cd499cf4199-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:50:01.908508 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.908481    2584 generic.go:356] "Generic (PLEG): container finished" podID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerID="a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486" exitCode=0
Jul 31 12:50:01.908651 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.908533    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"
Jul 31 12:50:01.908651 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.908547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" event={"ID":"84d667ad-1f47-46bc-9dbf-2cd499cf4199","Type":"ContainerDied","Data":"a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486"}
Jul 31 12:50:01.908651 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.908614    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg" event={"ID":"84d667ad-1f47-46bc-9dbf-2cd499cf4199","Type":"ContainerDied","Data":"d1517aa666e4211e0bf73ee45627446fd934831f79ecd1372ea7f42a90c9a64c"}
Jul 31 12:50:01.908651 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.908635    2584 scope.go:117] "RemoveContainer" containerID="a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486"
Jul 31 12:50:01.917320 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.917306    2584 scope.go:117] "RemoveContainer" containerID="33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91"
Jul 31 12:50:01.924723 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.924710    2584 scope.go:117] "RemoveContainer" containerID="a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486"
Jul 31 12:50:01.924959 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:50:01.924942    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486\": container with ID starting with a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486 not found: ID does not exist" containerID="a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486"
Jul 31 12:50:01.925005 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.924970    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486"} err="failed to get container status \"a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486\": rpc error: code = NotFound desc = could not find container \"a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486\": container with ID starting with a1822f9ad8984267c56c5a6b2b5ef070486f35014c28a6c4a066790bcfdb8486 not found: ID does not exist"
Jul 31 12:50:01.925005 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.924987    2584 scope.go:117] "RemoveContainer" containerID="33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91"
Jul 31 12:50:01.925271 ip-10-0-138-37 kubenswrapper[2584]: E0731 12:50:01.925252    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91\": container with ID starting with 33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91 not found: ID does not exist" containerID="33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91"
Jul 31 12:50:01.925336 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.925280    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91"} err="failed to get container status \"33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91\": rpc error: code = NotFound desc = could not find container \"33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91\": container with ID starting with 33baa6c33a52d78a67ac3a0c28006bf796265e75b248f0a979798e2e6953bf91 not found: ID does not exist"
Jul 31 12:50:01.930537 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.930514    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"]
Jul 31 12:50:01.934019 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:01.933998    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-46d34f7d-openshift-default-5f9644d79b-j55hg"]
Jul 31 12:50:03.165699 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:03.165666    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" path="/var/lib/kubelet/pods/84d667ad-1f47-46bc-9dbf-2cd499cf4199/volumes"
Jul 31 12:50:08.577175 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:08.577122    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:14.635899 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:14.635865    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:14.738015 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:14.737985    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:14.842916 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:14.842892    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:14.943045 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:14.943020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:15.339923 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:15.339854    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:23.163563 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:23.163538    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:50:23.170569 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:23.170543    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:50:41.291705 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:41.291668    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:47.485912 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:47.485876    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:47.588790 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:47.588759    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:50:47.686471 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:50:47.686439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:03.558693 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:03.558647    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:08.943857 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:08.943826    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:09.130663 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:09.130629    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:09.235845 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:09.235785    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:09.331478 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:09.331452    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:19.853356 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:19.853274    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:30.845173 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:30.845129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:36.642395 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:36.642361    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:36.700682 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:36.700657    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:36.779191 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:36.779131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:36.871645 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:36.871613    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:36.971879 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:36.971853    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:37.583010 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:37.582976    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:37.711220 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:37.711188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:37.799581 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:37.799559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:39.238752 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:39.238717    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:45.336301 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:45.336273    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:45.437085 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:45.437058    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:46.022630 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:46.022606    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:51.753784 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:51.753757    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:53.389663 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:53.389633    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:55.035439 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:55.035404    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:55.136049 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:55.136014    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:56.160964 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:56.160929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:56.304879 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:56.304846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:56.655836 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:56.655799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:51:56.750709 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:51:56.750685    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:19.980135 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:19.980105    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:20.636143 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:20.636101    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:20.734590 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:20.734562    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:21.056631 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:21.056610    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:26.754444 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:26.754414    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:26.812446 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:26.812416    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:37.492305 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:37.492273    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:37.597192 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:37.597141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:37.663749 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:37.663709    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:38.020506 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:38.020461    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:43.605394 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:43.605326    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:43.707336 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:43.707305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:43.866652 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:43.866580    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:44.087471 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:44.087432    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:44.210551 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:44.210524    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:44.309234 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:44.309206    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:44.423820 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:44.423797    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:50.393706 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:50.393668    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:50.504987 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:50.504958    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:50.598510 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:50.598482    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:50.737822 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:50.737793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:56.528795 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:56.528765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:52:56.629043 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:52:56.629003    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:54:02.608516 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:54:02.608419    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:54:59.242523 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:54:59.242474    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:54:59.549910 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:54:59.549833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:54:59.731095 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:54:59.731048    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:03.112710 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:03.112633    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:03.211883 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:03.211851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:04.092243 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:04.092208    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:04.300390 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:04.300352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:04.712485 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:04.712452    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:04.809808 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:04.809776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:23.188669 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:23.188641    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:55:23.195760 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:23.195739    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 12:55:27.902358 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:27.902319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:29.983001 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:29.982960    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:54.945908 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:54.945873    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:55:56.997864 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:56.997825    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"]
Jul 31 12:55:56.998342 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:56.998321    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy"
Jul 31 12:55:56.998393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:56.998346    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy"
Jul 31 12:55:56.998393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:56.998377    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy"
Jul 31 12:55:56.998393 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:56.998386    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy"
Jul 31 12:55:56.998488 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:56.998466    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy"
Jul 31 12:55:56.998488 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:56.998480    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db7ff0c-84b1-4c4c-84ec-06849e860659" containerName="istio-proxy"
Jul 31 12:55:57.001398 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.001381    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"
Jul 31 12:55:57.003867 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.003846    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 12:55:57.004081 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.004068    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 12:55:57.007377 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.007354    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"]
Jul 31 12:55:57.178939 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.178914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5f57f8-a11a-4d05-aca7-2a5d41ac3085-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp\" (UID: \"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"
Jul 31 12:55:57.279345 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.279275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5f57f8-a11a-4d05-aca7-2a5d41ac3085-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp\" (UID: \"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"
Jul 31 12:55:57.279886 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.279865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5f57f8-a11a-4d05-aca7-2a5d41ac3085-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp\" (UID: \"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"
Jul 31 12:55:57.313379 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.313357    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"
Jul 31 12:55:57.446561 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.446536    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"]
Jul 31 12:55:57.448952 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:55:57.448923    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5f57f8_a11a_4d05_aca7_2a5d41ac3085.slice/crio-e96114479ccaf3164063fca2b1fc6c9b3fdbde1d3b8ec7c8add078341928ecff WatchSource:0}: Error finding container e96114479ccaf3164063fca2b1fc6c9b3fdbde1d3b8ec7c8add078341928ecff: Status 404 returned error can't find the container with id e96114479ccaf3164063fca2b1fc6c9b3fdbde1d3b8ec7c8add078341928ecff
Jul 31 12:55:57.450719 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:57.450699    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 12:55:58.375520 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:55:58.375484    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp" event={"ID":"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085","Type":"ContainerStarted","Data":"e96114479ccaf3164063fca2b1fc6c9b3fdbde1d3b8ec7c8add078341928ecff"}
Jul 31 12:56:00.386825 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:00.386744    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp" event={"ID":"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085","Type":"ContainerStarted","Data":"8dfb41941b418bd65fc269400c34a26fbd68e4c8d7a3eee755bffa5bba26a632"}
Jul 31 12:56:00.402818 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:00.402764    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp" podStartSLOduration=1.913366177 podStartE2EDuration="4.402747717s" totalImagesPullingTime="2.48938154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:56:00.400635382 +0000 UTC m=+2437.764617162" watchObservedRunningTime="2026-07-31 12:56:00.402747717 +0000 UTC m=+2437.766729536"
Jul 31 12:56:01.392764 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:01.392730    2584 generic.go:356] "Generic (PLEG): container finished" podID="8b5f57f8-a11a-4d05-aca7-2a5d41ac3085" containerID="8dfb41941b418bd65fc269400c34a26fbd68e4c8d7a3eee755bffa5bba26a632" exitCode=0
Jul 31 12:56:01.393189 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:01.392784    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp" event={"ID":"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085","Type":"ContainerDied","Data":"8dfb41941b418bd65fc269400c34a26fbd68e4c8d7a3eee755bffa5bba26a632"}
Jul 31 12:56:02.513242 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:02.513220    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"
Jul 31 12:56:02.623368 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:02.623337    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5f57f8-a11a-4d05-aca7-2a5d41ac3085-maas-api-service-ca\") pod \"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085\" (UID: \"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085\") "
Jul 31 12:56:02.623717 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:02.623696    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5f57f8-a11a-4d05-aca7-2a5d41ac3085-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b5f57f8-a11a-4d05-aca7-2a5d41ac3085" (UID: "8b5f57f8-a11a-4d05-aca7-2a5d41ac3085"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 12:56:02.724130 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:02.724104    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b5f57f8-a11a-4d05-aca7-2a5d41ac3085-maas-api-service-ca\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 12:56:03.402518 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:03.402492    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"
Jul 31 12:56:03.402518 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:03.402504    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp" event={"ID":"8b5f57f8-a11a-4d05-aca7-2a5d41ac3085","Type":"ContainerDied","Data":"e96114479ccaf3164063fca2b1fc6c9b3fdbde1d3b8ec7c8add078341928ecff"}
Jul 31 12:56:03.402683 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:03.402550    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e96114479ccaf3164063fca2b1fc6c9b3fdbde1d3b8ec7c8add078341928ecff"
Jul 31 12:56:12.549337 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:12.549304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:12.615259 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:12.615225    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:12.686924 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:12.686893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:12.702709 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:12.702676    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"]
Jul 31 12:56:12.705098 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:12.705071    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bcf3ab8b-kj8kp"]
Jul 31 12:56:12.787845 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:12.787815    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:13.164954 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:13.164923    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5f57f8-a11a-4d05-aca7-2a5d41ac3085" path="/var/lib/kubelet/pods/8b5f57f8-a11a-4d05-aca7-2a5d41ac3085/volumes"
Jul 31 12:56:15.772665 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:15.772636    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:20.802642 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:20.802604    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:55.711468 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:55.711432    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:56.984068 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:56.984036    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:56:57.916366 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:56:57.916329    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:03.372378 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:03.372348    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:03.441873 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:03.441839    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:03.655076 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:03.655045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:03.865964 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:03.865927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:15.164476 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:15.164386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:15.265228 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:15.265188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:15.364501 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:15.364473    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:15.960736 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:15.960702    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:16.095059 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:16.095024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:16.186920 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:16.186887    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:17.398682 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:17.398645    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:23.822594 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:23.822562    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:23.879448 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:23.879417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:24.495751 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:24.495714    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:30.407385 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:30.407347    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:30.565102 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:30.565070    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:30.705128 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:30.705040    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:41.189953 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:41.189914    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:41.401092 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:41.401057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:54.464113 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:54.464083    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:57:54.564697 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:57:54.564658    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:02.357471 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:02.357438    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:08.369835 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:08.369791    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:08.428729 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:08.428698    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:08.730112 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:08.730080    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:09.032749 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:09.032668    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:09.469733 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:09.469706    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:11.927639 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:11.927597    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:12.016529 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:12.016496    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:13.029992 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:13.029961    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:13.394637 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:13.394561    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:13.601555 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:13.601528    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:13.696582 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:13.696550    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:23.690017 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:23.689982    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:36.901800 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:36.901764    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:37.251066 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.250988    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:37.535981 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.535893    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"]
Jul 31 12:58:37.536422 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.536391    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5f57f8-a11a-4d05-aca7-2a5d41ac3085" containerName="revoke-keys"
Jul 31 12:58:37.536422 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.536414    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5f57f8-a11a-4d05-aca7-2a5d41ac3085" containerName="revoke-keys"
Jul 31 12:58:37.536618 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.536497    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d667ad-1f47-46bc-9dbf-2cd499cf4199" containerName="istio-proxy"
Jul 31 12:58:37.536618 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.536513    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5f57f8-a11a-4d05-aca7-2a5d41ac3085" containerName="revoke-keys"
Jul 31 12:58:37.539706 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.539683    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.542318 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.542300    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e614c6-openshift-default-dockercfg-m86j7\""
Jul 31 12:58:37.551265 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.551245    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"]
Jul 31 12:58:37.567721 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.567689    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:37.666559 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clckq\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-kube-api-access-clckq\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.666559 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666561    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5af696-df19-4527-a5ee-e555f71e0b6d-istiod-ca-cert\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.666802 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-socket\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.666802 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-token\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.666802 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666621    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-envoy\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.666802 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666720    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-credential-socket\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.666802 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-certs\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.667027 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666864    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-data\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.667027 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.666901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-podinfo\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.748320 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.748290    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:37.767436 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-data\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767569 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-podinfo\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767569 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767465    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clckq\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-kube-api-access-clckq\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767569 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767488    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5af696-df19-4527-a5ee-e555f71e0b6d-istiod-ca-cert\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767569 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-socket\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767569 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-token\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767849 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767653    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-envoy\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767849 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767713    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-credential-socket\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767849 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767737    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-certs\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767991 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-data\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.767991 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.767928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-socket\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.768070 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.768056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-credential-socket\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.768115 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.768099    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-certs\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.768346 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.768327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5af696-df19-4527-a5ee-e555f71e0b6d-istiod-ca-cert\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.770009 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.769984    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-envoy\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.770276 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.770261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-podinfo\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.775478 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.775452    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clckq\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-kube-api-access-clckq\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.775708 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.775690    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-token\") pod \"e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") " pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.850355 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.850296    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:37.986277 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.986253    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"]
Jul 31 12:58:37.988395 ip-10-0-138-37 kubenswrapper[2584]: W0731 12:58:37.988365    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5af696_df19_4527_a5ee_e555f71e0b6d.slice/crio-e5dda22db8bd2a517de365419bdfa50b283710310fe84ebf34458010fc2416a5 WatchSource:0}: Error finding container e5dda22db8bd2a517de365419bdfa50b283710310fe84ebf34458010fc2416a5: Status 404 returned error can't find the container with id e5dda22db8bd2a517de365419bdfa50b283710310fe84ebf34458010fc2416a5
Jul 31 12:58:37.990599 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.990563    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:58:37.990701 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.990635    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:58:37.990701 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:37.990666    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:58:38.057066 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:38.057038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" event={"ID":"2f5af696-df19-4527-a5ee-e555f71e0b6d","Type":"ContainerStarted","Data":"a9c5635b3683b6dd5e9983b300dcb0439d66f7d341aa9795ca6ebf914a8a8ccc"}
Jul 31 12:58:38.057204 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:38.057093    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" event={"ID":"2f5af696-df19-4527-a5ee-e555f71e0b6d","Type":"ContainerStarted","Data":"e5dda22db8bd2a517de365419bdfa50b283710310fe84ebf34458010fc2416a5"}
Jul 31 12:58:38.080199 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:38.080124    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" podStartSLOduration=1.0801026870000001 podStartE2EDuration="1.080102687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 12:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 12:58:38.079682324 +0000 UTC m=+2595.443664105" watchObservedRunningTime="2026-07-31 12:58:38.080102687 +0000 UTC m=+2595.444084468"
Jul 31 12:58:38.850699 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:38.850664    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:39.856333 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:39.856303    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:40.058797 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:40.058762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:40.066117 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:40.066093    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:40.066823 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:40.066806    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:40.157604 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:40.157575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:41.141210 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:41.141175    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:41.314470 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:41.314436    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:41.675922 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:41.675888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:41.766786 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:41.766752    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:58:53.138525 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:53.138448    2584 generic.go:356] "Generic (PLEG): container finished" podID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerID="a9c5635b3683b6dd5e9983b300dcb0439d66f7d341aa9795ca6ebf914a8a8ccc" exitCode=0
Jul 31 12:58:53.138525 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:53.138488    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" event={"ID":"2f5af696-df19-4527-a5ee-e555f71e0b6d","Type":"ContainerDied","Data":"a9c5635b3683b6dd5e9983b300dcb0439d66f7d341aa9795ca6ebf914a8a8ccc"}
Jul 31 12:58:53.138935 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:53.138819    2584 scope.go:117] "RemoveContainer" containerID="a9c5635b3683b6dd5e9983b300dcb0439d66f7d341aa9795ca6ebf914a8a8ccc"
Jul 31 12:58:53.139767 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:53.139738    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:58:53.139818 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:53.139807    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:58:53.139852 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:53.139838    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 12:58:54.144568 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:54.144536    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" event={"ID":"2f5af696-df19-4527-a5ee-e555f71e0b6d","Type":"ContainerStarted","Data":"1de916382fe16c055c6fd48f6e45a5cddc207df05d49e4f8dce47a4a04357832"}
Jul 31 12:58:54.850742 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:54.850706    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:54.851879 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:54.851857    2584 patch_prober.go:28] interesting pod/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 31 12:58:54.851939 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:54.851904    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 31 12:58:55.066865 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:55.066830    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:55.850844 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:55.850807    2584 patch_prober.go:28] interesting pod/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 31 12:58:55.851236 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:55.850871    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 31 12:58:56.851000 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:56.850965    2584 patch_prober.go:28] interesting pod/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 31 12:58:56.851410 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:56.851022    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 31 12:58:57.851420 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:57.851379    2584 patch_prober.go:28] interesting pod/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 31 12:58:57.851808 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:57.851459    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 31 12:58:58.851435 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:58.851400    2584 patch_prober.go:28] interesting pod/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 31 12:58:58.851817 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:58.851452    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 31 12:58:59.855289 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:59.855254    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:58:59.856193 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:58:59.856176    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 12:59:05.052069 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:59:05.052032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:59:06.992320 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:59:06.992273    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:59:08.770696 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:59:08.770667    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 12:59:27.582747 ip-10-0-138-37 kubenswrapper[2584]: I0731 12:59:27.582704    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:00.135693 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.135650    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"]
Jul 31 13:00:00.139573 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.139546    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282"]
Jul 31 13:00:00.139705 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.139644    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"
Jul 31 13:00:00.142234 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.142201    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 13:00:00.142770 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.142752    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282"
Jul 31 13:00:00.148345 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.148319    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"]
Jul 31 13:00:00.151670 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.151643    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282"]
Jul 31 13:00:00.152669 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.152647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"
Jul 31 13:00:00.161016 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.160993    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282"
Jul 31 13:00:00.299573 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.299472    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"]
Jul 31 13:00:00.303989 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:00:00.303956    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda114fc06_9bbd_4863_a4a8_f49340deedb7.slice/crio-cc71a17cf71c762360c171e081f8165ce903a509becf5a125e17afddc301af05 WatchSource:0}: Error finding container cc71a17cf71c762360c171e081f8165ce903a509becf5a125e17afddc301af05: Status 404 returned error can't find the container with id cc71a17cf71c762360c171e081f8165ce903a509becf5a125e17afddc301af05
Jul 31 13:00:00.329145 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.329077    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282"]
Jul 31 13:00:00.338276 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:00:00.338250    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf278ca43_1c2f_4c28_9f6c_082243e70979.slice/crio-bebe5f4a125fc8cd131bd15fc24dfed89865f590cd0b43fa5189c0c26f79c1bf WatchSource:0}: Error finding container bebe5f4a125fc8cd131bd15fc24dfed89865f590cd0b43fa5189c0c26f79c1bf: Status 404 returned error can't find the container with id bebe5f4a125fc8cd131bd15fc24dfed89865f590cd0b43fa5189c0c26f79c1bf
Jul 31 13:00:00.436386 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.436357    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr" event={"ID":"a114fc06-9bbd-4863-a4a8-f49340deedb7","Type":"ContainerStarted","Data":"cc71a17cf71c762360c171e081f8165ce903a509becf5a125e17afddc301af05"}
Jul 31 13:00:00.437582 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:00.437558    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282" event={"ID":"f278ca43-1c2f-4c28-9f6c-082243e70979","Type":"ContainerStarted","Data":"bebe5f4a125fc8cd131bd15fc24dfed89865f590cd0b43fa5189c0c26f79c1bf"}
Jul 31 13:00:01.444307 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:01.444271    2584 generic.go:356] "Generic (PLEG): container finished" podID="a114fc06-9bbd-4863-a4a8-f49340deedb7" containerID="5fbb0b42eda5d9b46d3bb1c68257dc6b25478f076ce31bba6975033d2ad9ac3c" exitCode=0
Jul 31 13:00:01.444763 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:01.444352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr" event={"ID":"a114fc06-9bbd-4863-a4a8-f49340deedb7","Type":"ContainerDied","Data":"5fbb0b42eda5d9b46d3bb1c68257dc6b25478f076ce31bba6975033d2ad9ac3c"}
Jul 31 13:00:01.445928 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:01.445908    2584 generic.go:356] "Generic (PLEG): container finished" podID="f278ca43-1c2f-4c28-9f6c-082243e70979" containerID="64be2a8579d56e39eecc073e303bc87693347e897273b5ee679663c1d3283472" exitCode=0
Jul 31 13:00:01.446047 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:01.445968    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282" event={"ID":"f278ca43-1c2f-4c28-9f6c-082243e70979","Type":"ContainerDied","Data":"64be2a8579d56e39eecc073e303bc87693347e897273b5ee679663c1d3283472"}
Jul 31 13:00:02.579459 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:02.579433    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282"
Jul 31 13:00:02.609374 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:02.609349    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"
Jul 31 13:00:03.457028 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:03.456957    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"
Jul 31 13:00:03.457028 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:03.456973    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr" event={"ID":"a114fc06-9bbd-4863-a4a8-f49340deedb7","Type":"ContainerDied","Data":"cc71a17cf71c762360c171e081f8165ce903a509becf5a125e17afddc301af05"}
Jul 31 13:00:03.457028 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:03.457025    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc71a17cf71c762360c171e081f8165ce903a509becf5a125e17afddc301af05"
Jul 31 13:00:03.458468 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:03.458451    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282"
Jul 31 13:00:03.458600 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:03.458466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758380-r9282" event={"ID":"f278ca43-1c2f-4c28-9f6c-082243e70979","Type":"ContainerDied","Data":"bebe5f4a125fc8cd131bd15fc24dfed89865f590cd0b43fa5189c0c26f79c1bf"}
Jul 31 13:00:03.458600 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:03.458511    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bebe5f4a125fc8cd131bd15fc24dfed89865f590cd0b43fa5189c0c26f79c1bf"
Jul 31 13:00:09.236102 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:09.236072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:10.142895 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.142860    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:10.243653 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.243621    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"]
Jul 31 13:00:10.244021 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.243928    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f278ca43-1c2f-4c28-9f6c-082243e70979" containerName="cleanup"
Jul 31 13:00:10.244021 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.243939    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f278ca43-1c2f-4c28-9f6c-082243e70979" containerName="cleanup"
Jul 31 13:00:10.244021 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.243958    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a114fc06-9bbd-4863-a4a8-f49340deedb7" containerName="cleanup"
Jul 31 13:00:10.244021 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.243963    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a114fc06-9bbd-4863-a4a8-f49340deedb7" containerName="cleanup"
Jul 31 13:00:10.244021 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.244021    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a114fc06-9bbd-4863-a4a8-f49340deedb7" containerName="cleanup"
Jul 31 13:00:10.244247 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.244028    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f278ca43-1c2f-4c28-9f6c-082243e70979" containerName="cleanup"
Jul 31 13:00:10.247040 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.247022    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"
Jul 31 13:00:10.249858 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.249833    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 13:00:10.250253 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.250239    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 13:00:10.254563 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.254538    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"]
Jul 31 13:00:10.404735 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.404712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/613d7ae4-c76a-4bb0-bdd9-215e19b85677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9\" (UID: \"613d7ae4-c76a-4bb0-bdd9-215e19b85677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"
Jul 31 13:00:10.505818 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.505791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/613d7ae4-c76a-4bb0-bdd9-215e19b85677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9\" (UID: \"613d7ae4-c76a-4bb0-bdd9-215e19b85677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"
Jul 31 13:00:10.506428 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.506407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/613d7ae4-c76a-4bb0-bdd9-215e19b85677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9\" (UID: \"613d7ae4-c76a-4bb0-bdd9-215e19b85677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"
Jul 31 13:00:10.558051 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.558010    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"
Jul 31 13:00:10.697073 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:10.697056    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"]
Jul 31 13:00:10.699312 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:00:10.699278    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613d7ae4_c76a_4bb0_bdd9_215e19b85677.slice/crio-05078c251daefed1c8cf6efcbd0b8daf23faf06e86602334e7cf2720a8a043a3 WatchSource:0}: Error finding container 05078c251daefed1c8cf6efcbd0b8daf23faf06e86602334e7cf2720a8a043a3: Status 404 returned error can't find the container with id 05078c251daefed1c8cf6efcbd0b8daf23faf06e86602334e7cf2720a8a043a3
Jul 31 13:00:11.495268 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:11.495237    2584 generic.go:356] "Generic (PLEG): container finished" podID="613d7ae4-c76a-4bb0-bdd9-215e19b85677" containerID="f5d20373d6bcd4672eb161fb7914089507d6c2b002787ce3c51b3e2323697d28" exitCode=0
Jul 31 13:00:11.495548 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:11.495315    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9" event={"ID":"613d7ae4-c76a-4bb0-bdd9-215e19b85677","Type":"ContainerDied","Data":"f5d20373d6bcd4672eb161fb7914089507d6c2b002787ce3c51b3e2323697d28"}
Jul 31 13:00:11.495548 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:11.495350    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9" event={"ID":"613d7ae4-c76a-4bb0-bdd9-215e19b85677","Type":"ContainerStarted","Data":"05078c251daefed1c8cf6efcbd0b8daf23faf06e86602334e7cf2720a8a043a3"}
Jul 31 13:00:12.633270 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:12.633245    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"
Jul 31 13:00:12.825854 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:12.825773    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/613d7ae4-c76a-4bb0-bdd9-215e19b85677-maas-api-service-ca\") pod \"613d7ae4-c76a-4bb0-bdd9-215e19b85677\" (UID: \"613d7ae4-c76a-4bb0-bdd9-215e19b85677\") "
Jul 31 13:00:12.826203 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:12.826182    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613d7ae4-c76a-4bb0-bdd9-215e19b85677-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "613d7ae4-c76a-4bb0-bdd9-215e19b85677" (UID: "613d7ae4-c76a-4bb0-bdd9-215e19b85677"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:00:12.926976 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:12.926949    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/613d7ae4-c76a-4bb0-bdd9-215e19b85677-maas-api-service-ca\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:13.506006 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:13.505926    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"
Jul 31 13:00:13.506006 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:13.505941    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9" event={"ID":"613d7ae4-c76a-4bb0-bdd9-215e19b85677","Type":"ContainerDied","Data":"05078c251daefed1c8cf6efcbd0b8daf23faf06e86602334e7cf2720a8a043a3"}
Jul 31 13:00:13.506209 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:13.506019    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05078c251daefed1c8cf6efcbd0b8daf23faf06e86602334e7cf2720a8a043a3"
Jul 31 13:00:20.703956 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.703913    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"]
Jul 31 13:00:20.706727 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.706689    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:20.708836 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.708812    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-20ab27-29758380-swbhr"]
Jul 31 13:00:20.777955 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.777928    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:20.870061 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.870026    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:20.936541 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.936508    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"]
Jul 31 13:00:20.938406 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.938380    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-20ab27-m88c9"]
Jul 31 13:00:20.959827 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:20.959761    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:21.165636 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:21.165608    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="613d7ae4-c76a-4bb0-bdd9-215e19b85677" path="/var/lib/kubelet/pods/613d7ae4-c76a-4bb0-bdd9-215e19b85677/volumes"
Jul 31 13:00:21.165903 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:21.165889    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a114fc06-9bbd-4863-a4a8-f49340deedb7" path="/var/lib/kubelet/pods/a114fc06-9bbd-4863-a4a8-f49340deedb7/volumes"
Jul 31 13:00:21.325342 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:21.325278    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:23.214230 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:23.214197    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:00:23.227529 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:23.227509    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:00:27.374188 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.374139    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:27.504146 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.504113    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:27.673777 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.673746    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:27.884986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.884958    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:27.985216 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.985126    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"]
Jul 31 13:00:27.985521 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.985504    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613d7ae4-c76a-4bb0-bdd9-215e19b85677" containerName="revoke-keys"
Jul 31 13:00:27.985604 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.985523    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="613d7ae4-c76a-4bb0-bdd9-215e19b85677" containerName="revoke-keys"
Jul 31 13:00:27.985662 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.985634    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="613d7ae4-c76a-4bb0-bdd9-215e19b85677" containerName="revoke-keys"
Jul 31 13:00:27.990051 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.990031    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"
Jul 31 13:00:27.992523 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.992502    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 13:00:27.992594 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.992572    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 13:00:27.995968 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:27.995945    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"]
Jul 31 13:00:28.044112 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:28.044083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e39770-23a3-46e2-bf9c-80b5a35fabbe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm\" (UID: \"e7e39770-23a3-46e2-bf9c-80b5a35fabbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"
Jul 31 13:00:28.145308 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:28.145282    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e39770-23a3-46e2-bf9c-80b5a35fabbe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm\" (UID: \"e7e39770-23a3-46e2-bf9c-80b5a35fabbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"
Jul 31 13:00:28.145847 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:28.145825    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e39770-23a3-46e2-bf9c-80b5a35fabbe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm\" (UID: \"e7e39770-23a3-46e2-bf9c-80b5a35fabbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"
Jul 31 13:00:28.301569 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:28.301508    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"
Jul 31 13:00:28.428197 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:28.428142    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"]
Jul 31 13:00:28.430393 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:00:28.430365    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e39770_23a3_46e2_bf9c_80b5a35fabbe.slice/crio-d44ac68b1d37564aa4ec6a6f15f7d520c7752f642c0321441332696fc1da76a9 WatchSource:0}: Error finding container d44ac68b1d37564aa4ec6a6f15f7d520c7752f642c0321441332696fc1da76a9: Status 404 returned error can't find the container with id d44ac68b1d37564aa4ec6a6f15f7d520c7752f642c0321441332696fc1da76a9
Jul 31 13:00:28.572760 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:28.572706    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm" event={"ID":"e7e39770-23a3-46e2-bf9c-80b5a35fabbe","Type":"ContainerStarted","Data":"d44ac68b1d37564aa4ec6a6f15f7d520c7752f642c0321441332696fc1da76a9"}
Jul 31 13:00:29.578568 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:29.578542    2584 generic.go:356] "Generic (PLEG): container finished" podID="e7e39770-23a3-46e2-bf9c-80b5a35fabbe" containerID="8a3efb3f770aadc457e8972c85e3c3b4a269b37df4ca5ae112adf3bba95806cc" exitCode=0
Jul 31 13:00:29.578907 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:29.578617    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm" event={"ID":"e7e39770-23a3-46e2-bf9c-80b5a35fabbe","Type":"ContainerDied","Data":"8a3efb3f770aadc457e8972c85e3c3b4a269b37df4ca5ae112adf3bba95806cc"}
Jul 31 13:00:30.710687 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:30.710664    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"
Jul 31 13:00:30.764467 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:30.764445    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e39770-23a3-46e2-bf9c-80b5a35fabbe-maas-api-service-ca\") pod \"e7e39770-23a3-46e2-bf9c-80b5a35fabbe\" (UID: \"e7e39770-23a3-46e2-bf9c-80b5a35fabbe\") "
Jul 31 13:00:30.764795 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:30.764776    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e39770-23a3-46e2-bf9c-80b5a35fabbe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e7e39770-23a3-46e2-bf9c-80b5a35fabbe" (UID: "e7e39770-23a3-46e2-bf9c-80b5a35fabbe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:00:30.865193 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:30.865122    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e39770-23a3-46e2-bf9c-80b5a35fabbe-maas-api-service-ca\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:31.588191 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:31.588123    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"
Jul 31 13:00:31.588191 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:31.588126    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm" event={"ID":"e7e39770-23a3-46e2-bf9c-80b5a35fabbe","Type":"ContainerDied","Data":"d44ac68b1d37564aa4ec6a6f15f7d520c7752f642c0321441332696fc1da76a9"}
Jul 31 13:00:31.588330 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:31.588196    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d44ac68b1d37564aa4ec6a6f15f7d520c7752f642c0321441332696fc1da76a9"
Jul 31 13:00:38.634318 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:38.634289    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:38.722019 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:38.721989    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:38.823847 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:38.823806    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:38.825047 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:38.825019    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"]
Jul 31 13:00:38.826477 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:38.826458    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e614c6-psqcm"]
Jul 31 13:00:38.923780 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:38.923751    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:39.167445 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:39.167418    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e39770-23a3-46e2-bf9c-80b5a35fabbe" path="/var/lib/kubelet/pods/e7e39770-23a3-46e2-bf9c-80b5a35fabbe/volumes"
Jul 31 13:00:39.211267 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:39.211205    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:45.242652 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:45.242617    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:45.343706 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:45.343680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:45.497399 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:45.497325    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"]
Jul 31 13:00:45.497597 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:45.497570    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy" containerID="cri-o://1de916382fe16c055c6fd48f6e45a5cddc207df05d49e4f8dce47a4a04357832" gracePeriod=30
Jul 31 13:00:45.525824 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:45.525792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:45.747590 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:45.747487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:46.097249 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:46.097148    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:46.469751 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:46.469708    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:46.564817 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:46.564781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:49.736255 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:49.736214    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:49.834347 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:49.834315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:50.675955 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.675930    2584 generic.go:356] "Generic (PLEG): container finished" podID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerID="1de916382fe16c055c6fd48f6e45a5cddc207df05d49e4f8dce47a4a04357832" exitCode=0
Jul 31 13:00:50.676094 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.675997    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" event={"ID":"2f5af696-df19-4527-a5ee-e555f71e0b6d","Type":"ContainerDied","Data":"1de916382fe16c055c6fd48f6e45a5cddc207df05d49e4f8dce47a4a04357832"}
Jul 31 13:00:50.676094 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.676083    2584 scope.go:117] "RemoveContainer" containerID="a9c5635b3683b6dd5e9983b300dcb0439d66f7d341aa9795ca6ebf914a8a8ccc"
Jul 31 13:00:50.762984 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.762932    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 13:00:50.821690 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.821659    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5af696-df19-4527-a5ee-e555f71e0b6d-istiod-ca-cert\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.821834 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.821716    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clckq\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-kube-api-access-clckq\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.821922 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.821902    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-credential-socket\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.821978 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.821935    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-certs\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.821978 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.821970    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-podinfo\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.822055 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822020    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-data\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.822055 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822042    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-envoy\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.822186 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822078    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-socket\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.822186 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822103    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-token\") pod \"2f5af696-df19-4527-a5ee-e555f71e0b6d\" (UID: \"2f5af696-df19-4527-a5ee-e555f71e0b6d\") "
Jul 31 13:00:50.822302 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822215    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:00:50.822302 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822230    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:00:50.822407 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822335    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:00:50.822467 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822445    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:00:50.822467 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822458    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.822538 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822477    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.822538 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822488    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.822653 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.822627    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5af696-df19-4527-a5ee-e555f71e0b6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:00:50.824180 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.824124    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-kube-api-access-clckq" (OuterVolumeSpecName: "kube-api-access-clckq") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "kube-api-access-clckq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:00:50.824294 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.824232    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 13:00:50.824294 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.824255    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:00:50.824528 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.824506    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f5af696-df19-4527-a5ee-e555f71e0b6d" (UID: "2f5af696-df19-4527-a5ee-e555f71e0b6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:00:50.923193 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.923150    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.923193 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.923192    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5af696-df19-4527-a5ee-e555f71e0b6d-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.923341 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.923204    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.923341 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.923216    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5af696-df19-4527-a5ee-e555f71e0b6d-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.923341 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.923229    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clckq\" (UniqueName: \"kubernetes.io/projected/2f5af696-df19-4527-a5ee-e555f71e0b6d-kube-api-access-clckq\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:50.923341 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:50.923242    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5af696-df19-4527-a5ee-e555f71e0b6d-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:00:51.022751 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.022673    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:51.491018 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.490983    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:51.558343 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.558311    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:51.648505 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.648472    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:00:51.683871 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.683834    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv" event={"ID":"2f5af696-df19-4527-a5ee-e555f71e0b6d","Type":"ContainerDied","Data":"e5dda22db8bd2a517de365419bdfa50b283710310fe84ebf34458010fc2416a5"}
Jul 31 13:00:51.683871 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.683865    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"
Jul 31 13:00:51.684099 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.683922    2584 scope.go:117] "RemoveContainer" containerID="1de916382fe16c055c6fd48f6e45a5cddc207df05d49e4f8dce47a4a04357832"
Jul 31 13:00:51.702653 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.702625    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"]
Jul 31 13:00:51.707929 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:51.707904    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e614c6-openshift-default-74968cd758-hv7nv"]
Jul 31 13:00:53.165383 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:00:53.165351    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" path="/var/lib/kubelet/pods/2f5af696-df19-4527-a5ee-e555f71e0b6d/volumes"
Jul 31 13:01:14.732150 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:14.732114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:15.217298 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.217250    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:15.525731 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.525647    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"]
Jul 31 13:01:15.526034 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.526017    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e39770-23a3-46e2-bf9c-80b5a35fabbe" containerName="revoke-keys"
Jul 31 13:01:15.526366 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.526037    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e39770-23a3-46e2-bf9c-80b5a35fabbe" containerName="revoke-keys"
Jul 31 13:01:15.526366 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.526058    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy"
Jul 31 13:01:15.526366 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.526067    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy"
Jul 31 13:01:15.526366 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.526186    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy"
Jul 31 13:01:15.526366 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.526213    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e39770-23a3-46e2-bf9c-80b5a35fabbe" containerName="revoke-keys"
Jul 31 13:01:15.529380 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.529360    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.534212 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.534194    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b21077-openshift-default-dockercfg-jk7nq\""
Jul 31 13:01:15.543522 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.543497    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"]
Jul 31 13:01:15.568356 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.568327    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:15.617847 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.617818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-data\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.617968 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.617890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-credential-socket\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.617968 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.617923    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-podinfo\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.618060 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.617980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b5c143-5f6f-484a-b6fd-94d5145537f7-istiod-ca-cert\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.618060 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.618021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-token\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.618141 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.618061    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-certs\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.618141 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.618085    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvglt\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-kube-api-access-tvglt\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.618241 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.618141    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-socket\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.618241 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.618205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-envoy\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.668740 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.668712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:15.718886 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.718855    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-data\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.718993 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.718904    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-credential-socket\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.718993 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.718933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-podinfo\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.718993 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.718966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b5c143-5f6f-484a-b6fd-94d5145537f7-istiod-ca-cert\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719148 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719002    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-token\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719148 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-certs\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719148 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719082    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvglt\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-kube-api-access-tvglt\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719148 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-socket\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719381 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719188    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-envoy\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719381 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719371    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-data\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719459 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719429    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-credential-socket\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719576 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719556    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-certs\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719713 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-socket\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.719851 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.719832    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b5c143-5f6f-484a-b6fd-94d5145537f7-istiod-ca-cert\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.721561 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.721532    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-envoy\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.721649 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.721639    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-podinfo\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.727025 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.726996    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-token\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.727439 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.727419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvglt\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-kube-api-access-tvglt\") pod \"e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") " pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.767794 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.767769    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:15.839939 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.839876    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:15.977745 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.977718    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"]
Jul 31 13:01:15.979254 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:01:15.979227    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b5c143_5f6f_484a_b6fd_94d5145537f7.slice/crio-e39dd0b1ff69ddf67e22c60b65f10457ed504a25fa347bdf34c20485787c78d1 WatchSource:0}: Error finding container e39dd0b1ff69ddf67e22c60b65f10457ed504a25fa347bdf34c20485787c78d1: Status 404 returned error can't find the container with id e39dd0b1ff69ddf67e22c60b65f10457ed504a25fa347bdf34c20485787c78d1
Jul 31 13:01:15.981412 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.981370    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:01:15.981501 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.981444    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:01:15.981501 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:15.981476    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:01:16.800501 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:16.800467    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" event={"ID":"58b5c143-5f6f-484a-b6fd-94d5145537f7","Type":"ContainerStarted","Data":"8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36"}
Jul 31 13:01:16.800853 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:16.800517    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" event={"ID":"58b5c143-5f6f-484a-b6fd-94d5145537f7","Type":"ContainerStarted","Data":"e39dd0b1ff69ddf67e22c60b65f10457ed504a25fa347bdf34c20485787c78d1"}
Jul 31 13:01:16.822246 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:16.822200    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" podStartSLOduration=1.8221856509999999 podStartE2EDuration="1.822185651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:01:16.820499383 +0000 UTC m=+2754.184481163" watchObservedRunningTime="2026-07-31 13:01:16.822185651 +0000 UTC m=+2754.186167430"
Jul 31 13:01:16.840770 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:16.840746    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:17.848915 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:17.848884    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:18.809840 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:18.809808    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:18.810876 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:18.810854    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:18.849698 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:18.849672    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:18.947815 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:18.947785    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:20.156206 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:20.156173    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:20.538343 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:20.538267    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:20.646904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:20.646873    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:20.744321 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:20.744286    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:31.882788 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:31.882757    2584 generic.go:356] "Generic (PLEG): container finished" podID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerID="8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36" exitCode=0
Jul 31 13:01:31.883254 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:31.882801    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" event={"ID":"58b5c143-5f6f-484a-b6fd-94d5145537f7","Type":"ContainerDied","Data":"8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36"}
Jul 31 13:01:31.883254 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:31.883145    2584 scope.go:117] "RemoveContainer" containerID="8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36"
Jul 31 13:01:31.884100 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:31.884073    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:01:31.884149 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:31.884140    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:01:31.884229 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:31.884197    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:01:32.893413 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:32.893375    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" event={"ID":"58b5c143-5f6f-484a-b6fd-94d5145537f7","Type":"ContainerStarted","Data":"c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624"}
Jul 31 13:01:33.810755 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:33.810726    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:33.840403 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:33.840376    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:33.841257 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:33.841234    2584 patch_prober.go:28] interesting pod/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 31 13:01:33.841349 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:33.841325    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 31 13:01:34.840778 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:34.840742    2584 patch_prober.go:28] interesting pod/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 31 13:01:34.841195 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:34.840815    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 31 13:01:35.840769 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:35.840737    2584 patch_prober.go:28] interesting pod/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 31 13:01:35.840954 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:35.840793    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 31 13:01:36.840670 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:36.840630    2584 patch_prober.go:28] interesting pod/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 31 13:01:36.840837 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:36.840699    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 31 13:01:37.840623 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:37.840583    2584 patch_prober.go:28] interesting pod/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 31 13:01:37.841073 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:37.840641    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 31 13:01:38.845518 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:38.845484    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:38.846666 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:38.846640    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:01:43.777147 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:43.777056    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:01:46.721999 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.721954    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"]
Jul 31 13:01:46.722437 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.722342    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy"
Jul 31 13:01:46.722437 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.722355    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy"
Jul 31 13:01:46.722519 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.722443    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f5af696-df19-4527-a5ee-e555f71e0b6d" containerName="istio-proxy"
Jul 31 13:01:46.724841 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.724817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"
Jul 31 13:01:46.728252 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.728210    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 13:01:46.728433 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.728403    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 13:01:46.734112 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.734073    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"]
Jul 31 13:01:46.788456 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.788418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6660fdd1-90c3-4741-8eec-d6db55f5d962-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl\" (UID: \"6660fdd1-90c3-4741-8eec-d6db55f5d962\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"
Jul 31 13:01:46.889752 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.889724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6660fdd1-90c3-4741-8eec-d6db55f5d962-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl\" (UID: \"6660fdd1-90c3-4741-8eec-d6db55f5d962\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"
Jul 31 13:01:46.890148 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:46.890129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6660fdd1-90c3-4741-8eec-d6db55f5d962-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl\" (UID: \"6660fdd1-90c3-4741-8eec-d6db55f5d962\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"
Jul 31 13:01:47.041618 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:47.041544    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"
Jul 31 13:01:47.171633 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:47.171607    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"]
Jul 31 13:01:47.174052 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:01:47.174026    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6660fdd1_90c3_4741_8eec_d6db55f5d962.slice/crio-25920fad159abe744fcf659e95a5f4efb6596f50e5c3e2b16a71cce4c8fd440f WatchSource:0}: Error finding container 25920fad159abe744fcf659e95a5f4efb6596f50e5c3e2b16a71cce4c8fd440f: Status 404 returned error can't find the container with id 25920fad159abe744fcf659e95a5f4efb6596f50e5c3e2b16a71cce4c8fd440f
Jul 31 13:01:47.964819 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:47.964790    2584 generic.go:356] "Generic (PLEG): container finished" podID="6660fdd1-90c3-4741-8eec-d6db55f5d962" containerID="dfabb8bfd2ef6baa4109fd1d8a40d4dcdcfa5ec7db050c5ec70f60ec892bcdb3" exitCode=0
Jul 31 13:01:47.965131 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:47.964839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl" event={"ID":"6660fdd1-90c3-4741-8eec-d6db55f5d962","Type":"ContainerDied","Data":"dfabb8bfd2ef6baa4109fd1d8a40d4dcdcfa5ec7db050c5ec70f60ec892bcdb3"}
Jul 31 13:01:47.965131 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:47.964883    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl" event={"ID":"6660fdd1-90c3-4741-8eec-d6db55f5d962","Type":"ContainerStarted","Data":"25920fad159abe744fcf659e95a5f4efb6596f50e5c3e2b16a71cce4c8fd440f"}
Jul 31 13:01:49.099723 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:49.099699    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"
Jul 31 13:01:49.209988 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:49.209961    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6660fdd1-90c3-4741-8eec-d6db55f5d962-maas-api-service-ca\") pod \"6660fdd1-90c3-4741-8eec-d6db55f5d962\" (UID: \"6660fdd1-90c3-4741-8eec-d6db55f5d962\") "
Jul 31 13:01:49.210300 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:49.210281    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6660fdd1-90c3-4741-8eec-d6db55f5d962-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6660fdd1-90c3-4741-8eec-d6db55f5d962" (UID: "6660fdd1-90c3-4741-8eec-d6db55f5d962"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:01:49.310798 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:49.310736    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6660fdd1-90c3-4741-8eec-d6db55f5d962-maas-api-service-ca\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:01:49.975365 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:49.975331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl" event={"ID":"6660fdd1-90c3-4741-8eec-d6db55f5d962","Type":"ContainerDied","Data":"25920fad159abe744fcf659e95a5f4efb6596f50e5c3e2b16a71cce4c8fd440f"}
Jul 31 13:01:49.975365 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:49.975357    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"
Jul 31 13:01:49.975589 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:01:49.975381    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25920fad159abe744fcf659e95a5f4efb6596f50e5c3e2b16a71cce4c8fd440f"
Jul 31 13:02:02.225176 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:02.225083    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:02.453513 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:02.453473    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"]
Jul 31 13:02:02.460012 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:02.459988    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0c802-p4fvl"]
Jul 31 13:02:03.166750 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:03.166713    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6660fdd1-90c3-4741-8eec-d6db55f5d962" path="/var/lib/kubelet/pods/6660fdd1-90c3-4741-8eec-d6db55f5d962/volumes"
Jul 31 13:02:06.083617 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:06.083578    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:08.589957 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:08.589904    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:08.671609 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:08.671563    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:08.872288 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:08.872186    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:09.106339 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.106303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:09.222945 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.222915    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"]
Jul 31 13:02:09.223288 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.223276    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6660fdd1-90c3-4741-8eec-d6db55f5d962" containerName="revoke-keys"
Jul 31 13:02:09.223337 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.223290    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6660fdd1-90c3-4741-8eec-d6db55f5d962" containerName="revoke-keys"
Jul 31 13:02:09.223373 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.223346    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6660fdd1-90c3-4741-8eec-d6db55f5d962" containerName="revoke-keys"
Jul 31 13:02:09.225247 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.225233    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"
Jul 31 13:02:09.227873 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.227855    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 13:02:09.228264 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.228250    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 13:02:09.233001 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.232974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"]
Jul 31 13:02:09.374032 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.374001    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b21077-p658b\" (UID: \"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"
Jul 31 13:02:09.474736 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.474660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b21077-p658b\" (UID: \"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"
Jul 31 13:02:09.475307 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.475287    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b21077-p658b\" (UID: \"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"
Jul 31 13:02:09.536248 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.536220    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"
Jul 31 13:02:09.668960 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:09.668936    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"]
Jul 31 13:02:09.671257 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:02:09.671230    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9e3d83_f1bc_42ba_81ff_ad1dcb9c15dd.slice/crio-15a6824a75cf52fa0bda6ad351d682ca4072e88d1c873ba884cd3c871fc3887f WatchSource:0}: Error finding container 15a6824a75cf52fa0bda6ad351d682ca4072e88d1c873ba884cd3c871fc3887f: Status 404 returned error can't find the container with id 15a6824a75cf52fa0bda6ad351d682ca4072e88d1c873ba884cd3c871fc3887f
Jul 31 13:02:10.065930 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:10.065894    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b" event={"ID":"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd","Type":"ContainerStarted","Data":"3e58b004d4f8e11c97053701e2649973c48a0077fd7d842a602ef439cef92185"}
Jul 31 13:02:10.066139 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:10.065956    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b" event={"ID":"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd","Type":"ContainerStarted","Data":"15a6824a75cf52fa0bda6ad351d682ca4072e88d1c873ba884cd3c871fc3887f"}
Jul 31 13:02:10.083500 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:10.083452    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b" podStartSLOduration=1.083435963 podStartE2EDuration="1.083435963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:02:10.081737952 +0000 UTC m=+2807.445719733" watchObservedRunningTime="2026-07-31 13:02:10.083435963 +0000 UTC m=+2807.447417742"
Jul 31 13:02:11.072231 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:11.072199    2584 generic.go:356] "Generic (PLEG): container finished" podID="1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd" containerID="3e58b004d4f8e11c97053701e2649973c48a0077fd7d842a602ef439cef92185" exitCode=0
Jul 31 13:02:11.072636 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:11.072296    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b" event={"ID":"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd","Type":"ContainerDied","Data":"3e58b004d4f8e11c97053701e2649973c48a0077fd7d842a602ef439cef92185"}
Jul 31 13:02:12.200929 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:12.200906    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"
Jul 31 13:02:12.299435 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:12.299399    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd-maas-api-service-ca\") pod \"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd\" (UID: \"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd\") "
Jul 31 13:02:12.299793 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:12.299768    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd" (UID: "1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:02:12.400954 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:12.400934    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd-maas-api-service-ca\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:13.082316 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:13.082279    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b" event={"ID":"1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd","Type":"ContainerDied","Data":"15a6824a75cf52fa0bda6ad351d682ca4072e88d1c873ba884cd3c871fc3887f"}
Jul 31 13:02:13.082316 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:13.082306    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"
Jul 31 13:02:13.082529 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:13.082339    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15a6824a75cf52fa0bda6ad351d682ca4072e88d1c873ba884cd3c871fc3887f"
Jul 31 13:02:23.278594 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:23.278561    2584 scope.go:117] "RemoveContainer" containerID="8dfb41941b418bd65fc269400c34a26fbd68e4c8d7a3eee755bffa5bba26a632"
Jul 31 13:02:24.653553 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:24.653517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:24.804399 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:24.804363    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:24.894342 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:24.894304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:24.910953 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:24.910891    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"]
Jul 31 13:02:24.914319 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:24.914295    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b21077-p658b"]
Jul 31 13:02:24.963102 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:24.963054    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:25.165532 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:25.165460    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd" path="/var/lib/kubelet/pods/1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd/volumes"
Jul 31 13:02:25.301424 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:25.301387    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:31.349402 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:31.349364    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:31.449823 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:31.449788    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:31.583347 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:31.583318    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"]
Jul 31 13:02:31.583577 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:31.583553    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy" containerID="cri-o://c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624" gracePeriod=30
Jul 31 13:02:31.608259 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:31.608200    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:31.833950 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:31.833912    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:32.177471 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:32.177440    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:32.494113 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:32.494038    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:33.475481 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:33.475449    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:36.835822 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.835796    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:02:36.886050 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.885989    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-data\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886050 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886040    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvglt\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-kube-api-access-tvglt\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886260 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886087    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-envoy\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886260 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886146    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-token\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886260 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886218    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-credential-socket\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886260 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886244    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-podinfo\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886461 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886272    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b5c143-5f6f-484a-b6fd-94d5145537f7-istiod-ca-cert\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886461 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886297    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-certs\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886461 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886321    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-socket\") pod \"58b5c143-5f6f-484a-b6fd-94d5145537f7\" (UID: \"58b5c143-5f6f-484a-b6fd-94d5145537f7\") "
Jul 31 13:02:36.886461 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886308    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:02:36.886654 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886584    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.886840 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886725    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:02:36.886840 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886799    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:02:36.886840 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886814    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b5c143-5f6f-484a-b6fd-94d5145537f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:02:36.887089 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.886897    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:02:36.889210 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.889067    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 13:02:36.889210 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.889095    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:02:36.889400 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.889216    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:02:36.889567 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.889548    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-kube-api-access-tvglt" (OuterVolumeSpecName: "kube-api-access-tvglt") pod "58b5c143-5f6f-484a-b6fd-94d5145537f7" (UID: "58b5c143-5f6f-484a-b6fd-94d5145537f7"). InnerVolumeSpecName "kube-api-access-tvglt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:02:36.987846 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987819    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.987846 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987845    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.987986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987855    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b5c143-5f6f-484a-b6fd-94d5145537f7-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.987986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987863    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.987986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987871    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.987986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987879    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvglt\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-kube-api-access-tvglt\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.987986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987887    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:36.987986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:36.987895    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b5c143-5f6f-484a-b6fd-94d5145537f7-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:02:37.197257 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.197224    2584 generic.go:356] "Generic (PLEG): container finished" podID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerID="c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624" exitCode=0
Jul 31 13:02:37.197382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.197267    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" event={"ID":"58b5c143-5f6f-484a-b6fd-94d5145537f7","Type":"ContainerDied","Data":"c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624"}
Jul 31 13:02:37.197382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.197311    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm" event={"ID":"58b5c143-5f6f-484a-b6fd-94d5145537f7","Type":"ContainerDied","Data":"e39dd0b1ff69ddf67e22c60b65f10457ed504a25fa347bdf34c20485787c78d1"}
Jul 31 13:02:37.197382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.197323    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"
Jul 31 13:02:37.197382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.197344    2584 scope.go:117] "RemoveContainer" containerID="c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624"
Jul 31 13:02:37.205793 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.205778    2584 scope.go:117] "RemoveContainer" containerID="8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36"
Jul 31 13:02:37.214060 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.213980    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"]
Jul 31 13:02:37.214125 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.214088    2584 scope.go:117] "RemoveContainer" containerID="c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624"
Jul 31 13:02:37.214376 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:02:37.214357    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624\": container with ID starting with c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624 not found: ID does not exist" containerID="c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624"
Jul 31 13:02:37.214438 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.214382    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624"} err="failed to get container status \"c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624\": rpc error: code = NotFound desc = could not find container \"c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624\": container with ID starting with c2e8a14d4b5d85d9b213c4fdd6c6d055e622457e73b7e0f871bbfa33cb9dc624 not found: ID does not exist"
Jul 31 13:02:37.214438 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.214398    2584 scope.go:117] "RemoveContainer" containerID="8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36"
Jul 31 13:02:37.214631 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:02:37.214615    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36\": container with ID starting with 8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36 not found: ID does not exist" containerID="8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36"
Jul 31 13:02:37.214670 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.214634    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36"} err="failed to get container status \"8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36\": rpc error: code = NotFound desc = could not find container \"8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36\": container with ID starting with 8406d588db0edf9ef1802e24b680e3357ae4e2154d89b2f7589e0f59945e0d36 not found: ID does not exist"
Jul 31 13:02:37.217656 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.217636    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b21077-openshift-default-6f646669b8-6dxxm"]
Jul 31 13:02:37.831504 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.831475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:37.931477 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:37.931445    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:39.165135 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:39.165107    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" path="/var/lib/kubelet/pods/58b5c143-5f6f-484a-b6fd-94d5145537f7/volumes"
Jul 31 13:02:48.282237 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:48.282105    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:02:48.382928 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:02:48.382874    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:00.317716 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.317679    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:00.650106 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.650025    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:00.910503 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910468    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"]
Jul 31 13:03:00.910797 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910785    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy"
Jul 31 13:03:00.910844 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910800    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy"
Jul 31 13:03:00.910844 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910813    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy"
Jul 31 13:03:00.910844 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910819    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy"
Jul 31 13:03:00.910844 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910830    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd" containerName="revoke-keys"
Jul 31 13:03:00.910844 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910837    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd" containerName="revoke-keys"
Jul 31 13:03:00.910995 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910888    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy"
Jul 31 13:03:00.910995 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.910898    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a9e3d83-f1bc-42ba-81ff-ad1dcb9c15dd" containerName="revoke-keys"
Jul 31 13:03:00.913361 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.913346    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.916252 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.916228    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e55b67-openshift-default-dockercfg-9zbpv\""
Jul 31 13:03:00.928489 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.928457    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"]
Jul 31 13:03:00.955632 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.955604    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:00.969801 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-credential-socket\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.969898 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-envoy\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.969898 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969858    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cc5665-e339-4814-aa97-3ba887413774-istiod-ca-cert\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.969898 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969884    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-socket\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.970006 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-data\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.970006 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969956    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cc5665-e339-4814-aa97-3ba887413774-istio-podinfo\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.970006 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-certs\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.970006 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.969997    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-istio-token\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:00.970135 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:00.970014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzkk7\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-kube-api-access-kzkk7\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.070969    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-envoy\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cc5665-e339-4814-aa97-3ba887413774-istiod-ca-cert\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-socket\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071073    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-data\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cc5665-e339-4814-aa97-3ba887413774-istio-podinfo\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071148    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-certs\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-istio-token\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkk7\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-kube-api-access-kzkk7\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071290    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-credential-socket\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.072041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.071727    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-credential-socket\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.075992 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.075961    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cc5665-e339-4814-aa97-3ba887413774-istio-podinfo\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.076417 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.076301    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-certs\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.076695 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.076647    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-socket\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.076695 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.076668    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-data\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.076924 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.076902    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cc5665-e339-4814-aa97-3ba887413774-istiod-ca-cert\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.078088 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.078071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-envoy\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.084679 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.084655    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-istio-token\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.084962 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.084942    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzkk7\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-kube-api-access-kzkk7\") pod \"e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") " pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.095131 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.095105    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:01.223093 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.223017    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:01.364419 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.364392    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"]
Jul 31 13:03:01.366990 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:03:01.366962    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cc5665_e339_4814_aa97_3ba887413774.slice/crio-12d86cbe6e847c9edcaa7214c92267dbe016b55f538a769f108d50dafeca4fd7 WatchSource:0}: Error finding container 12d86cbe6e847c9edcaa7214c92267dbe016b55f538a769f108d50dafeca4fd7: Status 404 returned error can't find the container with id 12d86cbe6e847c9edcaa7214c92267dbe016b55f538a769f108d50dafeca4fd7
Jul 31 13:03:01.369009 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.368980    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:03:01.369061 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.369049    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:03:01.369103 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:01.369075    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:03:02.317426 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:02.317387    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" event={"ID":"29cc5665-e339-4814-aa97-3ba887413774","Type":"ContainerStarted","Data":"a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b"}
Jul 31 13:03:02.317599 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:02.317443    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" event={"ID":"29cc5665-e339-4814-aa97-3ba887413774","Type":"ContainerStarted","Data":"12d86cbe6e847c9edcaa7214c92267dbe016b55f538a769f108d50dafeca4fd7"}
Jul 31 13:03:02.341323 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:02.341271    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podStartSLOduration=2.34124945 podStartE2EDuration="2.34124945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:03:02.339001305 +0000 UTC m=+2859.702983077" watchObservedRunningTime="2026-07-31 13:03:02.34124945 +0000 UTC m=+2859.705231232"
Jul 31 13:03:03.223428 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:03.223396    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:03.228513 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:03.228487    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:03.321977 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:03.321950    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:03.322696 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:03.322677    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:04.358567 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:04.358534    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:04.456779 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:04.456751    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:06.943182 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:06.943135    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:07.055620 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:07.055575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:07.368726 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:07.368648    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:07.435729 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:07.435699    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:19.017550 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.017523    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:19.069115 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.069081    2584 patch_prober.go:28] interesting pod/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": read tcp 10.134.0.2:36102->10.134.0.35:15021: read: connection reset by peer" start-of-body=
Jul 31 13:03:19.069276 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.069184    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": read tcp 10.134.0.2:36102->10.134.0.35:15021: read: connection reset by peer"
Jul 31 13:03:19.398569 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.398487    2584 generic.go:356] "Generic (PLEG): container finished" podID="29cc5665-e339-4814-aa97-3ba887413774" containerID="a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b" exitCode=0
Jul 31 13:03:19.398569 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.398560    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" event={"ID":"29cc5665-e339-4814-aa97-3ba887413774","Type":"ContainerDied","Data":"a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b"}
Jul 31 13:03:19.398946 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.398930    2584 scope.go:117] "RemoveContainer" containerID="a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b"
Jul 31 13:03:19.399890 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.399859    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:03:19.399968 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.399950    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:03:19.400004 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:19.399993    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:03:20.406458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:20.406422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" event={"ID":"29cc5665-e339-4814-aa97-3ba887413774","Type":"ContainerStarted","Data":"9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381"}
Jul 31 13:03:21.223595 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:21.223561    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:21.223816 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:21.223796    2584 patch_prober.go:28] interesting pod/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 31 13:03:21.223873 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:21.223848    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 31 13:03:21.567379 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:21.567301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:22.224120 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:22.224084    2584 patch_prober.go:28] interesting pod/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 31 13:03:22.224317 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:22.224177    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 31 13:03:23.223885 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:23.223848    2584 patch_prober.go:28] interesting pod/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 31 13:03:23.224285 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:23.223907    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 31 13:03:24.223825 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:24.223787    2584 patch_prober.go:28] interesting pod/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 31 13:03:24.224033 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:24.223845    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 31 13:03:24.884467 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:24.884401    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:03:25.224245 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:25.224210    2584 patch_prober.go:28] interesting pod/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 31 13:03:25.224639 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:25.224273    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 31 13:03:26.227270 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:26.227240    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:26.227641 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:26.227614    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:26.228354 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:26.228319    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:03:45.386126 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:03:45.386088    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:04:18.229348 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:04:18.229304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:04:18.286474 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:04:18.286415    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:04:54.202089 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:04:54.202056    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:05:23.241878 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:05:23.241847    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:05:23.257043 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:05:23.257018    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:06:11.301563 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:06:11.301524    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:06:11.402921 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:06:11.402893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:06:23.325613 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:06:23.325542    2584 scope.go:117] "RemoveContainer" containerID="f5d20373d6bcd4672eb161fb7914089507d6c2b002787ce3c51b3e2323697d28"
Jul 31 13:06:23.333450 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:06:23.333433    2584 scope.go:117] "RemoveContainer" containerID="5fbb0b42eda5d9b46d3bb1c68257dc6b25478f076ce31bba6975033d2ad9ac3c"
Jul 31 13:06:56.381143 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:06:56.381104    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:07:14.703774 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:14.703743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:07:16.643775 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:16.643734    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:07:23.353849 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:23.353818    2584 scope.go:117] "RemoveContainer" containerID="8a3efb3f770aadc457e8972c85e3c3b4a269b37df4ca5ae112adf3bba95806cc"
Jul 31 13:07:24.359313 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.359284    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"]
Jul 31 13:07:24.359679 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.359641    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b5c143-5f6f-484a-b6fd-94d5145537f7" containerName="istio-proxy"
Jul 31 13:07:24.364245 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.364224    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.366831 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.366806    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"openshift-service-ca.crt\""
Jul 31 13:07:24.367729 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.367709    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"sub-test-model-96b3e0-kserve-self-signed-certs\""
Jul 31 13:07:24.367833 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.367748    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"kube-root-ca.crt\""
Jul 31 13:07:24.367922 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.367900    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"default-dockercfg-9sl58\""
Jul 31 13:07:24.372007 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.371981    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"]
Jul 31 13:07:24.377868 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.377834    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:07:24.439511 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.439488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-home\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.439614 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.439528    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-tmp-dir\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.439614 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.439553    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-dshm\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.439688 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.439639    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-model-cache\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.439688 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.439665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56bae3c4-1223-480b-b119-f452eb785e0a-tls-certs\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.439688 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.439681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ct78\" (UniqueName: \"kubernetes.io/projected/56bae3c4-1223-480b-b119-f452eb785e0a-kube-api-access-5ct78\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.540877 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.540852    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-tmp-dir\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.540988 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.540881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-dshm\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.540988 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.540918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-model-cache\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.540988 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.540935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56bae3c4-1223-480b-b119-f452eb785e0a-tls-certs\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.540988 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.540950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ct78\" (UniqueName: \"kubernetes.io/projected/56bae3c4-1223-480b-b119-f452eb785e0a-kube-api-access-5ct78\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.540988 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.540988    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-home\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.541343 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.541318    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-model-cache\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.541410 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.541347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-tmp-dir\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.541410 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.541386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-home\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.543438 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.543407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-dshm\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.543729 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.543708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56bae3c4-1223-480b-b119-f452eb785e0a-tls-certs\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.549282 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.549258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ct78\" (UniqueName: \"kubernetes.io/projected/56bae3c4-1223-480b-b119-f452eb785e0a-kube-api-access-5ct78\") pod \"sub-test-model-96b3e0-kserve-65cd9968f7-pkndj\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") " pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.684940 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.684910    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:24.815704 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.815678    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"]
Jul 31 13:07:24.817783 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:07:24.817755    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56bae3c4_1223_480b_b119_f452eb785e0a.slice/crio-d60e96ca54c8896c50c17ea37d9cc191bb76f696f8c5b656bb278bc37c65ef36 WatchSource:0}: Error finding container d60e96ca54c8896c50c17ea37d9cc191bb76f696f8c5b656bb278bc37c65ef36: Status 404 returned error can't find the container with id d60e96ca54c8896c50c17ea37d9cc191bb76f696f8c5b656bb278bc37c65ef36
Jul 31 13:07:24.819861 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:24.819836    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 13:07:25.553306 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:25.553269    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj" event={"ID":"56bae3c4-1223-480b-b119-f452eb785e0a","Type":"ContainerStarted","Data":"d60e96ca54c8896c50c17ea37d9cc191bb76f696f8c5b656bb278bc37c65ef36"}
Jul 31 13:07:26.559395 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:26.559360    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj" event={"ID":"56bae3c4-1223-480b-b119-f452eb785e0a","Type":"ContainerStarted","Data":"3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6"}
Jul 31 13:07:26.583288 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:26.583242    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj" podStartSLOduration=1.518835165 podStartE2EDuration="2.58322608s" totalImagesPullingTime="1.064390915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:07:26.582844788 +0000 UTC m=+3123.946826572" watchObservedRunningTime="2026-07-31 13:07:26.58322608 +0000 UTC m=+3123.947207864"
Jul 31 13:07:34.685987 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:34.685947    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:34.686533 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:34.686013    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:34.698672 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:34.698645    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:35.610379 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:35.610345    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:07:54.047409 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:54.047368    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:07:57.371726 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:07:57.371690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:08:23.374601 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:08:23.374574    2584 scope.go:117] "RemoveContainer" containerID="3e58b004d4f8e11c97053701e2649973c48a0077fd7d842a602ef439cef92185"
Jul 31 13:08:23.382581 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:08:23.382561    2584 scope.go:117] "RemoveContainer" containerID="dfabb8bfd2ef6baa4109fd1d8a40d4dcdcfa5ec7db050c5ec70f60ec892bcdb3"
Jul 31 13:08:26.354134 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:08:26.354092    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:08:26.453602 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:08:26.453557    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:09:08.638462 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:08.638430    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"]
Jul 31 13:09:09.877173 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:09.877117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:09:09.956458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:09.956418    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:09:23.658432 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:23.658316    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj" podUID="56bae3c4-1223-480b-b119-f452eb785e0a" containerName="main" containerID="cri-o://3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6" gracePeriod=45
Jul 31 13:09:23.923106 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:23.923021    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:09:24.070820 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.070777    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-tmp-dir\") pod \"56bae3c4-1223-480b-b119-f452eb785e0a\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") "
Jul 31 13:09:24.070820 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.070830    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-dshm\") pod \"56bae3c4-1223-480b-b119-f452eb785e0a\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") "
Jul 31 13:09:24.071072 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.070870    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56bae3c4-1223-480b-b119-f452eb785e0a-tls-certs\") pod \"56bae3c4-1223-480b-b119-f452eb785e0a\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") "
Jul 31 13:09:24.071072 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.070893    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ct78\" (UniqueName: \"kubernetes.io/projected/56bae3c4-1223-480b-b119-f452eb785e0a-kube-api-access-5ct78\") pod \"56bae3c4-1223-480b-b119-f452eb785e0a\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") "
Jul 31 13:09:24.071072 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.070942    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-model-cache\") pod \"56bae3c4-1223-480b-b119-f452eb785e0a\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") "
Jul 31 13:09:24.071072 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.071038    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-home\") pod \"56bae3c4-1223-480b-b119-f452eb785e0a\" (UID: \"56bae3c4-1223-480b-b119-f452eb785e0a\") "
Jul 31 13:09:24.071303 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.071092    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "56bae3c4-1223-480b-b119-f452eb785e0a" (UID: "56bae3c4-1223-480b-b119-f452eb785e0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:09:24.071362 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.071328    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "56bae3c4-1223-480b-b119-f452eb785e0a" (UID: "56bae3c4-1223-480b-b119-f452eb785e0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:09:24.071362 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.071337    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-home" (OuterVolumeSpecName: "home") pod "56bae3c4-1223-480b-b119-f452eb785e0a" (UID: "56bae3c4-1223-480b-b119-f452eb785e0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:09:24.071434 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.071366    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-tmp-dir\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:09:24.073569 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.073520    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-dshm" (OuterVolumeSpecName: "dshm") pod "56bae3c4-1223-480b-b119-f452eb785e0a" (UID: "56bae3c4-1223-480b-b119-f452eb785e0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:09:24.073711 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.073575    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56bae3c4-1223-480b-b119-f452eb785e0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "56bae3c4-1223-480b-b119-f452eb785e0a" (UID: "56bae3c4-1223-480b-b119-f452eb785e0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 13:09:24.073711 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.073577    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56bae3c4-1223-480b-b119-f452eb785e0a-kube-api-access-5ct78" (OuterVolumeSpecName: "kube-api-access-5ct78") pod "56bae3c4-1223-480b-b119-f452eb785e0a" (UID: "56bae3c4-1223-480b-b119-f452eb785e0a"). InnerVolumeSpecName "kube-api-access-5ct78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:09:24.091009 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.090971    2584 generic.go:356] "Generic (PLEG): container finished" podID="56bae3c4-1223-480b-b119-f452eb785e0a" containerID="3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6" exitCode=0
Jul 31 13:09:24.091256 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.091018    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"
Jul 31 13:09:24.091256 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.091031    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj" event={"ID":"56bae3c4-1223-480b-b119-f452eb785e0a","Type":"ContainerDied","Data":"3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6"}
Jul 31 13:09:24.091256 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.091076    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj" event={"ID":"56bae3c4-1223-480b-b119-f452eb785e0a","Type":"ContainerDied","Data":"d60e96ca54c8896c50c17ea37d9cc191bb76f696f8c5b656bb278bc37c65ef36"}
Jul 31 13:09:24.091256 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.091104    2584 scope.go:117] "RemoveContainer" containerID="3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6"
Jul 31 13:09:24.101244 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.101221    2584 scope.go:117] "RemoveContainer" containerID="3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6"
Jul 31 13:09:24.101557 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:09:24.101539    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6\": container with ID starting with 3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6 not found: ID does not exist" containerID="3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6"
Jul 31 13:09:24.101615 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.101565    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6"} err="failed to get container status \"3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6\": rpc error: code = NotFound desc = could not find container \"3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6\": container with ID starting with 3c28ad04d0a4f9bc7bba8a143db3304d941546901569d694a53d2c06d9e7f3e6 not found: ID does not exist"
Jul 31 13:09:24.112076 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.112032    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"]
Jul 31 13:09:24.115394 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.115360    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/sub-test-model-96b3e0-kserve-65cd9968f7-pkndj"]
Jul 31 13:09:24.172026 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.171983    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-home\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:09:24.172026 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.172018    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-dshm\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:09:24.172026 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.172029    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56bae3c4-1223-480b-b119-f452eb785e0a-tls-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:09:24.172343 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.172044    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ct78\" (UniqueName: \"kubernetes.io/projected/56bae3c4-1223-480b-b119-f452eb785e0a-kube-api-access-5ct78\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:09:24.172343 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:24.172054    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56bae3c4-1223-480b-b119-f452eb785e0a-model-cache\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:09:25.166297 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:25.166265    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56bae3c4-1223-480b-b119-f452eb785e0a" path="/var/lib/kubelet/pods/56bae3c4-1223-480b-b119-f452eb785e0a/volumes"
Jul 31 13:09:29.955515 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.955476    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"]
Jul 31 13:09:29.955934 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.955825    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56bae3c4-1223-480b-b119-f452eb785e0a" containerName="main"
Jul 31 13:09:29.955934 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.955838    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="56bae3c4-1223-480b-b119-f452eb785e0a" containerName="main"
Jul 31 13:09:29.955934 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.955892    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="56bae3c4-1223-480b-b119-f452eb785e0a" containerName="main"
Jul 31 13:09:29.960578 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.960553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:29.963429 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.963375    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"openshift-service-ca.crt\""
Jul 31 13:09:29.964885 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.964859    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"kube-root-ca.crt\""
Jul 31 13:09:29.965461 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.965332    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"default-dockercfg-9sl58\""
Jul 31 13:09:29.965815 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.965797    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3e0\"/\"rate-test-model-96b3e0-kserve-self-signed-certs\""
Jul 31 13:09:29.970238 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.969874    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"]
Jul 31 13:09:29.980435 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:29.980404    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:09:30.027394 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.027344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-dshm\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.027590 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.027422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tls-certs\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.027590 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.027479    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7fxm\" (UniqueName: \"kubernetes.io/projected/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-kube-api-access-l7fxm\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.027590 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.027537    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-model-cache\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.027728 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.027607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-home\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.027728 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.027632    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tmp-dir\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.128714 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.128678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tls-certs\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.128944 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.128728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7fxm\" (UniqueName: \"kubernetes.io/projected/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-kube-api-access-l7fxm\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.128944 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.128771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-model-cache\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.128944 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.128813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-home\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.128944 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.128839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tmp-dir\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.128944 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.128890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-dshm\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.129346 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.129306    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-model-cache\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.129346 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.129323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-home\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.129455 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.129338    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tmp-dir\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.131408 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.131380    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-dshm\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.131653 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.131635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tls-certs\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.139812 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.139786    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7fxm\" (UniqueName: \"kubernetes.io/projected/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-kube-api-access-l7fxm\") pod \"rate-test-model-96b3e0-kserve-854d55d679-khcfz\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") " pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.284296 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.284198    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:30.433058 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:30.433033    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"]
Jul 31 13:09:30.435613 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:09:30.435589    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c00b9bf_b664_4cd2_a4c2_6c29e54888ab.slice/crio-6f810d97bad7d47c1d4932133a70086bb7330848c0e8b4a19126475e3e05781b WatchSource:0}: Error finding container 6f810d97bad7d47c1d4932133a70086bb7330848c0e8b4a19126475e3e05781b: Status 404 returned error can't find the container with id 6f810d97bad7d47c1d4932133a70086bb7330848c0e8b4a19126475e3e05781b
Jul 31 13:09:31.132806 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:31.132765    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz" event={"ID":"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab","Type":"ContainerStarted","Data":"158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6"}
Jul 31 13:09:31.133232 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:31.132818    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz" event={"ID":"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab","Type":"ContainerStarted","Data":"6f810d97bad7d47c1d4932133a70086bb7330848c0e8b4a19126475e3e05781b"}
Jul 31 13:09:31.152832 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:31.152767    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz" podStartSLOduration=2.152746032 podStartE2EDuration="2.152746032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:09:31.151200094 +0000 UTC m=+3248.515181879" watchObservedRunningTime="2026-07-31 13:09:31.152746032 +0000 UTC m=+3248.516727881"
Jul 31 13:09:40.284736 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:40.284687    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:40.285403 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:40.284764    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:40.297546 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:40.297516    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:41.189545 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:41.189512    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:09:56.907543 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:09:56.907500    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:10:07.215490 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:10:07.215443    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:10:12.279603 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:10:12.279568    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:10:23.270297 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:10:23.270271    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:10:23.286257 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:10:23.286229    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:11:40.479047 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:11:40.479005    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:11:40.579936 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:11:40.579899    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:11:48.448457 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:11:48.448420    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"]
Jul 31 13:11:48.472369 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:11:48.472338    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:11:49.419424 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:11:49.419389    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:03.468393 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.468329    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz" podUID="3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" containerName="main" containerID="cri-o://158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6" gracePeriod=45
Jul 31 13:12:03.717833 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.717803    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:12:03.838026 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.837929    2584 generic.go:356] "Generic (PLEG): container finished" podID="3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" containerID="158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6" exitCode=0
Jul 31 13:12:03.838026 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.837987    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"
Jul 31 13:12:03.838026 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.838014    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz" event={"ID":"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab","Type":"ContainerDied","Data":"158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6"}
Jul 31 13:12:03.838323 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.838067    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz" event={"ID":"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab","Type":"ContainerDied","Data":"6f810d97bad7d47c1d4932133a70086bb7330848c0e8b4a19126475e3e05781b"}
Jul 31 13:12:03.838323 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.838089    2584 scope.go:117] "RemoveContainer" containerID="158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6"
Jul 31 13:12:03.846651 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.846629    2584 scope.go:117] "RemoveContainer" containerID="158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6"
Jul 31 13:12:03.846935 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:12:03.846912    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6\": container with ID starting with 158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6 not found: ID does not exist" containerID="158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6"
Jul 31 13:12:03.847046 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.846944    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6"} err="failed to get container status \"158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6\": rpc error: code = NotFound desc = could not find container \"158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6\": container with ID starting with 158f47d2df125b5a83b538f1dca1821e03e6fe0aca74a3e5fe0887d258bb12c6 not found: ID does not exist"
Jul 31 13:12:03.877337 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877290    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-dshm\") pod \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") "
Jul 31 13:12:03.877515 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877379    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-model-cache\") pod \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") "
Jul 31 13:12:03.877515 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877438    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7fxm\" (UniqueName: \"kubernetes.io/projected/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-kube-api-access-l7fxm\") pod \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") "
Jul 31 13:12:03.877515 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877461    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-home\") pod \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") "
Jul 31 13:12:03.877742 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877522    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tls-certs\") pod \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") "
Jul 31 13:12:03.877742 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877579    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tmp-dir\") pod \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\" (UID: \"3c00b9bf-b664-4cd2-a4c2-6c29e54888ab\") "
Jul 31 13:12:03.877742 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877626    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" (UID: "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:12:03.877911 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877812    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-home" (OuterVolumeSpecName: "home") pod "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" (UID: "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:12:03.877911 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877841    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" (UID: "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:12:03.877911 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.877886    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-model-cache\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:12:03.879872 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.879848    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-kube-api-access-l7fxm" (OuterVolumeSpecName: "kube-api-access-l7fxm") pod "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" (UID: "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab"). InnerVolumeSpecName "kube-api-access-l7fxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:12:03.880340 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.880315    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-dshm" (OuterVolumeSpecName: "dshm") pod "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" (UID: "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:12:03.880340 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.880321    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" (UID: "3c00b9bf-b664-4cd2-a4c2-6c29e54888ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 13:12:03.978678 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.978621    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-dshm\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:12:03.978678 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.978671    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7fxm\" (UniqueName: \"kubernetes.io/projected/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-kube-api-access-l7fxm\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:12:03.978678 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.978682    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-home\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:12:03.978678 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.978690    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tls-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:12:03.978678 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:03.978700    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab-tmp-dir\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:12:04.176170 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:04.176132    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"]
Jul 31 13:12:04.181930 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:04.181896    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96b3e0/rate-test-model-96b3e0-kserve-854d55d679-khcfz"]
Jul 31 13:12:05.167471 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:05.167439    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" path="/var/lib/kubelet/pods/3c00b9bf-b664-4cd2-a4c2-6c29e54888ab/volumes"
Jul 31 13:12:08.521865 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.521805    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:08.817107 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.817018    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"]
Jul 31 13:12:08.817389 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.817376    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" containerName="main"
Jul 31 13:12:08.817448 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.817391    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" containerName="main"
Jul 31 13:12:08.817492 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.817451    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c00b9bf-b664-4cd2-a4c2-6c29e54888ab" containerName="main"
Jul 31 13:12:08.821905 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.821885    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.825213 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.825188    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-fd6ea7-openshift-default-dockercfg-wtj2n\""
Jul 31 13:12:08.836037 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.836008    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"]
Jul 31 13:12:08.842479 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.842442    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:08.926584 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926545    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-data\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.926777 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48k6m\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-kube-api-access-48k6m\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.926777 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-certs\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.926777 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-credential-socket\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.926904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istiod-ca-cert\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.926904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-socket\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.926904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926863    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-podinfo\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.926904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-envoy\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:08.927038 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:08.926908    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-token\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027545 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027506    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-data\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027545 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027546    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48k6m\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-kube-api-access-48k6m\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027764 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-certs\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027764 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-credential-socket\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027764 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027686    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istiod-ca-cert\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027764 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-socket\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027959 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-podinfo\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027959 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027801    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-envoy\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.027959 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.027829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-token\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.028126 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.028003    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-data\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.028126 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.028121    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-credential-socket\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.028276 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.028116    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-socket\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.028276 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.028194    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-certs\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.028571 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.028552    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istiod-ca-cert\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.030347 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.030328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-envoy\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.030495 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.030477    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-podinfo\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.056295 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.056268    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48k6m\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-kube-api-access-48k6m\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.058321 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.058293    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-token\") pod \"e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") " pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.134349 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.134248    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:09.293120 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.293088    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"]
Jul 31 13:12:09.295369 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:12:09.295340    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9c4504_fd3e_4390_bf6b_3eb55417d46f.slice/crio-19f5903d6f54f5ab101cd9920d361d8ddae18f9b29ef34b05165374eea02f900 WatchSource:0}: Error finding container 19f5903d6f54f5ab101cd9920d361d8ddae18f9b29ef34b05165374eea02f900: Status 404 returned error can't find the container with id 19f5903d6f54f5ab101cd9920d361d8ddae18f9b29ef34b05165374eea02f900
Jul 31 13:12:09.297478 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.297439    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:09.297549 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.297515    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:09.297592 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.297544    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:09.302546 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.302519    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:09.869142 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.869102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" event={"ID":"9a9c4504-fd3e-4390-bf6b-3eb55417d46f","Type":"ContainerStarted","Data":"b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e"}
Jul 31 13:12:09.869142 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.869174    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" event={"ID":"9a9c4504-fd3e-4390-bf6b-3eb55417d46f","Type":"ContainerStarted","Data":"19f5903d6f54f5ab101cd9920d361d8ddae18f9b29ef34b05165374eea02f900"}
Jul 31 13:12:09.894548 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:09.894476    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podStartSLOduration=1.89445941 podStartE2EDuration="1.89445941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:12:09.893301878 +0000 UTC m=+3407.257283962" watchObservedRunningTime="2026-07-31 13:12:09.89445941 +0000 UTC m=+3407.258441189"
Jul 31 13:12:10.135399 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:10.135302    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:10.140861 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:10.140834    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:10.873607 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:10.873574    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:10.874556 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:10.874536    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:11.838226 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:11.838193    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:11.935866 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:11.935836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:14.720264 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:14.720176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:15.251631 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:15.251577    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:15.357396 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:15.357366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:26.916390 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:26.916345    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 13:12:26.916881 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:26.916435    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 13:12:27.952181 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:27.952126    2584 generic.go:356] "Generic (PLEG): container finished" podID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerID="b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e" exitCode=0
Jul 31 13:12:27.952653 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:27.952205    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" event={"ID":"9a9c4504-fd3e-4390-bf6b-3eb55417d46f","Type":"ContainerDied","Data":"b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e"}
Jul 31 13:12:27.952704 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:27.952669    2584 scope.go:117] "RemoveContainer" containerID="b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e"
Jul 31 13:12:27.953735 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:27.953707    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:27.953798 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:27.953775    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:27.953840 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:27.953806    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:28.959442 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:28.959404    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" event={"ID":"9a9c4504-fd3e-4390-bf6b-3eb55417d46f","Type":"ContainerStarted","Data":"4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d"}
Jul 31 13:12:29.134893 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:29.134850    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:29.135128 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:29.135100    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 31 13:12:29.135240 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:29.135192    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 31 13:12:30.135764 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:30.135717    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 31 13:12:30.136217 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:30.135777    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 31 13:12:31.135046 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:31.135007    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 31 13:12:31.135280 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:31.135064    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 31 13:12:31.764183 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:31.764122    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:32.135114 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.135018    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 31 13:12:32.135114 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.135074    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 31 13:12:32.747921 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.747874    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"]
Jul 31 13:12:32.751510 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.751486    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.754032 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.754008    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f59489-openshift-default-dockercfg-d94rn\""
Jul 31 13:12:32.764219 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.764188    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"]
Jul 31 13:12:32.837633 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837579    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/796fc041-7007-445f-8f48-7a5175f175d5-istio-podinfo\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.837633 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837636    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-envoy\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.837904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6nt\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-kube-api-access-5t6nt\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.837904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837736    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-certs\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.837904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837794    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-data\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.837904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837835    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-credential-socket\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.837904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/796fc041-7007-445f-8f48-7a5175f175d5-istiod-ca-cert\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.837904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837880    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-istio-token\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.838374 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.837933    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-socket\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.891216 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.891018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:32.939130 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/796fc041-7007-445f-8f48-7a5175f175d5-istio-podinfo\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939130 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939134    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-envoy\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6nt\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-kube-api-access-5t6nt\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-certs\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-data\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-credential-socket\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939382 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/796fc041-7007-445f-8f48-7a5175f175d5-istiod-ca-cert\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939546 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-istio-token\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939546 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-socket\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.939825 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939796    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-credential-socket\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.940007 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-certs\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.940092 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.939925    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-data\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.940199 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.940007    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-socket\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.940681 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.940651    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/796fc041-7007-445f-8f48-7a5175f175d5-istiod-ca-cert\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.941804 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.941730    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-envoy\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.942032 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.942014    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/796fc041-7007-445f-8f48-7a5175f175d5-istio-podinfo\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.947659 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.947630    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6nt\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-kube-api-access-5t6nt\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:32.947809 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:32.947791    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-istio-token\") pod \"e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") " pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:33.016046 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.015960    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:33.063052 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.063014    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:33.134924 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.134891    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 31 13:12:33.135076 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.134957    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 31 13:12:33.259021 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.258985    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"]
Jul 31 13:12:33.262608 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:12:33.262567    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796fc041_7007_445f_8f48_7a5175f175d5.slice/crio-5ae80b1ae49fdaa0816c83395a5f1bb080e78bbf7fa9318e9a1d6bed7d84591f WatchSource:0}: Error finding container 5ae80b1ae49fdaa0816c83395a5f1bb080e78bbf7fa9318e9a1d6bed7d84591f: Status 404 returned error can't find the container with id 5ae80b1ae49fdaa0816c83395a5f1bb080e78bbf7fa9318e9a1d6bed7d84591f
Jul 31 13:12:33.265069 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.265030    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:33.265182 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.265109    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:33.265182 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.265137    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:33.990249 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.990205    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" event={"ID":"796fc041-7007-445f-8f48-7a5175f175d5","Type":"ContainerStarted","Data":"8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4"}
Jul 31 13:12:33.990719 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:33.990276    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" event={"ID":"796fc041-7007-445f-8f48-7a5175f175d5","Type":"ContainerStarted","Data":"5ae80b1ae49fdaa0816c83395a5f1bb080e78bbf7fa9318e9a1d6bed7d84591f"}
Jul 31 13:12:34.014368 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.014309    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podStartSLOduration=2.014289814 podStartE2EDuration="2.014289814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:12:34.012535173 +0000 UTC m=+3431.376516931" watchObservedRunningTime="2026-07-31 13:12:34.014289814 +0000 UTC m=+3431.378271594"
Jul 31 13:12:34.063195 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.063139    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:34.069135 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.069104    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:34.147725 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.147693    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:34.148192 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.148145    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:34.150222 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.150201    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:12:34.994638 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.994603    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:34.995536 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:34.995514    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:35.913313 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:35.913274    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:36.013107 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:36.013071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:37.877596 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:37.877562    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:37.972580 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:37.972507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:38.311926 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:38.311882    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:38.411097 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:38.411061    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:50.752359 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:50.752322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:12:50.860235 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:50.860198    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:50826->10.134.0.39:15021: read: connection reset by peer" start-of-body=
Jul 31 13:12:50.860430 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:50.860291    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:50826->10.134.0.39:15021: read: connection reset by peer"
Jul 31 13:12:51.074664 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:51.074544    2584 generic.go:356] "Generic (PLEG): container finished" podID="796fc041-7007-445f-8f48-7a5175f175d5" containerID="8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4" exitCode=0
Jul 31 13:12:51.074664 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:51.074623    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" event={"ID":"796fc041-7007-445f-8f48-7a5175f175d5","Type":"ContainerDied","Data":"8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4"}
Jul 31 13:12:51.075075 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:51.075060    2584 scope.go:117] "RemoveContainer" containerID="8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4"
Jul 31 13:12:51.076177 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:51.076119    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:51.076273 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:51.076240    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:51.076313 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:51.076278    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:12:52.084594 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:52.084549    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" event={"ID":"796fc041-7007-445f-8f48-7a5175f175d5","Type":"ContainerStarted","Data":"b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b"}
Jul 31 13:12:53.063682 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:53.063641    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:53.063910 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:53.063889    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 31 13:12:53.063974 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:53.063937    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 31 13:12:54.063972 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:54.063934    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 31 13:12:54.064390 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:54.063988    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 31 13:12:55.063658 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:55.063621    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 31 13:12:55.063854 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:55.063684    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 31 13:12:56.064251 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:56.064209    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 31 13:12:56.064695 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:56.064270    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 31 13:12:57.064077 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:57.064028    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 31 13:12:57.064317 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:57.064097    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 31 13:12:58.067728 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:58.067691    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:58.068197 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:58.068096    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:12:58.068824 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:12:58.068806    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:13:09.188741 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:09.188703    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:48.205757 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.205675    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:48.504684 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.504583    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"]
Jul 31 13:13:48.507520 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.507497    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.510081 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.510056    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-2b382a-openshift-default-dockercfg-g7hcf\""
Jul 31 13:13:48.520197 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.520140    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"]
Jul 31 13:13:48.556395 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgvch\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-kube-api-access-zgvch\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556613 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556438    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-socket\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556613 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556475    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-certs\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556613 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556500    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-data\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556613 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-credential-socket\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556613 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556545    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-token\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556613 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556567    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50a94c5c-00b6-4ea4-a339-a150986b676d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556910 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556662    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-envoy\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.556910 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.556763    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-podinfo\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.566441 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.566403    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:48.657688 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.657639    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-token\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.657688 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.657684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50a94c5c-00b6-4ea4-a339-a150986b676d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.657930 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.657820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-envoy\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.657930 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.657920    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-podinfo\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658046 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.657961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgvch\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-kube-api-access-zgvch\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658046 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658039    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-socket\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658191 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-certs\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658191 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-data\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658191 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658117    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-credential-socket\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658483 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-socket\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658483 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658465    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50a94c5c-00b6-4ea4-a339-a150986b676d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658483 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658477    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-credential-socket\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658674 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658598    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-certs\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.658674 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.658626    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-data\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.660352 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.660320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-envoy\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.660700 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.660679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-podinfo\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.666998 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.666976    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-token\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.667301 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.667279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgvch\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-kube-api-access-zgvch\") pod \"e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") " pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.820813 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.820708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:48.964199 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.964170    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"]
Jul 31 13:13:48.966280 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:13:48.966237    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a94c5c_00b6_4ea4_a339_a150986b676d.slice/crio-95b135639adf1da1e56296b1f01d3f73081d4089de9321e852224dec88f9f740 WatchSource:0}: Error finding container 95b135639adf1da1e56296b1f01d3f73081d4089de9321e852224dec88f9f740: Status 404 returned error can't find the container with id 95b135639adf1da1e56296b1f01d3f73081d4089de9321e852224dec88f9f740
Jul 31 13:13:48.968684 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.968649    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:13:48.968780 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.968719    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:13:48.968780 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:48.968748    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:13:49.060666 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:49.060629    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:49.364425 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:49.364390    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" event={"ID":"50a94c5c-00b6-4ea4-a339-a150986b676d","Type":"ContainerStarted","Data":"95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad"}
Jul 31 13:13:49.364849 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:49.364444    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" event={"ID":"50a94c5c-00b6-4ea4-a339-a150986b676d","Type":"ContainerStarted","Data":"95b135639adf1da1e56296b1f01d3f73081d4089de9321e852224dec88f9f740"}
Jul 31 13:13:49.386806 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:49.386739    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podStartSLOduration=1.386719345 podStartE2EDuration="1.386719345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:13:49.385488692 +0000 UTC m=+3506.749470473" watchObservedRunningTime="2026-07-31 13:13:49.386719345 +0000 UTC m=+3506.750701129"
Jul 31 13:13:49.820937 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:49.820898    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:50.826817 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:50.826777    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:51.325560 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:51.325524    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:51.373361 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:51.373324    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:51.374647 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:51.374624    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:13:51.399508 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:51.399474    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:54.028692 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:54.028653    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:54.427258 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:54.427218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:54.521966 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:54.521930    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:13:54.585329 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:13:54.585297    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:07.415364 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:07.415317    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 13:14:07.415766 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:07.415397    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 13:14:08.454798 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.454762    2584 generic.go:356] "Generic (PLEG): container finished" podID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerID="95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad" exitCode=0
Jul 31 13:14:08.454798 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.454801    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" event={"ID":"50a94c5c-00b6-4ea4-a339-a150986b676d","Type":"ContainerDied","Data":"95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad"}
Jul 31 13:14:08.455308 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.455236    2584 scope.go:117] "RemoveContainer" containerID="95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad"
Jul 31 13:14:08.456358 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.456317    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:14:08.456458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.456398    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:14:08.456458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.456429    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 13:14:08.889591 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.889485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:08.950577 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:08.950536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:09.462391 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:09.462355    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" event={"ID":"50a94c5c-00b6-4ea4-a339-a150986b676d","Type":"ContainerStarted","Data":"57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a"}
Jul 31 13:14:09.821898 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:09.821801    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:14:09.822091 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:09.822030    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 31 13:14:09.822195 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:09.822085    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 31 13:14:10.821467 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:10.821428    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 31 13:14:10.821898 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:10.821510    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 31 13:14:11.220595 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:11.220562    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:11.821441 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:11.821399    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 31 13:14:11.821620 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:11.821465    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 31 13:14:12.821140 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:12.821098    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 31 13:14:12.821367 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:12.821186    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 31 13:14:13.821456 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:13.821419    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 31 13:14:13.821861 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:13.821508    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 31 13:14:14.825953 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:14.825920    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:14:14.826408 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:14.826221    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:14:14.827090 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:14.827071    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:14:21.529830 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:21.529793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:21.630362 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:21.630322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:21.709942 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:21.709910    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:21.825629 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:21.825536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:22.075266 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:22.075220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:28.023815 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:28.023761    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:28.124095 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:28.124062    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:28.284347 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:28.284250    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"]
Jul 31 13:14:28.284599 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:28.284573    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" containerID="cri-o://57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a" gracePeriod=30
Jul 31 13:14:28.310310 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:28.310266    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:28.536106 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:28.536011    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:29.828844 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:29.828807    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 13:14:29.829350 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:29.828888    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 13:14:33.536985 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.536952    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:14:33.584414 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.584319    2584 generic.go:356] "Generic (PLEG): container finished" podID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerID="57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a" exitCode=0
Jul 31 13:14:33.584414 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.584387    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"
Jul 31 13:14:33.584414 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.584395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" event={"ID":"50a94c5c-00b6-4ea4-a339-a150986b676d","Type":"ContainerDied","Data":"57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a"}
Jul 31 13:14:33.584639 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.584476    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x" event={"ID":"50a94c5c-00b6-4ea4-a339-a150986b676d","Type":"ContainerDied","Data":"95b135639adf1da1e56296b1f01d3f73081d4089de9321e852224dec88f9f740"}
Jul 31 13:14:33.584639 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.584508    2584 scope.go:117] "RemoveContainer" containerID="57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a"
Jul 31 13:14:33.593390 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.593370    2584 scope.go:117] "RemoveContainer" containerID="95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad"
Jul 31 13:14:33.601777 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.601757    2584 scope.go:117] "RemoveContainer" containerID="57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a"
Jul 31 13:14:33.602093 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:14:33.602072    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a\": container with ID starting with 57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a not found: ID does not exist" containerID="57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a"
Jul 31 13:14:33.602143 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.602107    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a"} err="failed to get container status \"57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a\": rpc error: code = NotFound desc = could not find container \"57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a\": container with ID starting with 57f4100faa974bab2b3461ae90f63fffb011b8ae94085519648da9ddb74ab03a not found: ID does not exist"
Jul 31 13:14:33.602143 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.602127    2584 scope.go:117] "RemoveContainer" containerID="95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad"
Jul 31 13:14:33.602407 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:14:33.602389    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad\": container with ID starting with 95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad not found: ID does not exist" containerID="95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad"
Jul 31 13:14:33.602450 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.602419    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad"} err="failed to get container status \"95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad\": rpc error: code = NotFound desc = could not find container \"95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad\": container with ID starting with 95a2d1abfebb39e6f4c722286f527790fd2a07b7592dd1bc95efaf4dd65665ad not found: ID does not exist"
Jul 31 13:14:33.608356 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608336    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgvch\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-kube-api-access-zgvch\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608438 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608368    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-data\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608487 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608434    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-certs\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608487 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608458    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-credential-socket\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608560 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608501    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50a94c5c-00b6-4ea4-a339-a150986b676d-istiod-ca-cert\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608560 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608528    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-envoy\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608661 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608590    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-token\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608661 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608650    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-podinfo\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608764 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608685    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-socket\") pod \"50a94c5c-00b6-4ea4-a339-a150986b676d\" (UID: \"50a94c5c-00b6-4ea4-a339-a150986b676d\") "
Jul 31 13:14:33.608823 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608763    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:14:33.608823 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608776    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:14:33.608823 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.608795    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-data" (OuterVolumeSpecName: "istio-data") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:14:33.609037 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.609016    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:14:33.609281 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.609254    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50a94c5c-00b6-4ea4-a339-a150986b676d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:14:33.609458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.609308    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.609458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.609326    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.609458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.609340    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.609458 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.609353    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.610706 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.610683    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-kube-api-access-zgvch" (OuterVolumeSpecName: "kube-api-access-zgvch") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "kube-api-access-zgvch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:14:33.611080 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.611059    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-token" (OuterVolumeSpecName: "istio-token") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:14:33.611353 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.611323    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 13:14:33.611445 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.611394    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50a94c5c-00b6-4ea4-a339-a150986b676d" (UID: "50a94c5c-00b6-4ea4-a339-a150986b676d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:14:33.710041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.709996    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.710041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.710029    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgvch\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-kube-api-access-zgvch\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.710041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.710041    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50a94c5c-00b6-4ea4-a339-a150986b676d-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.710041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.710050    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.710372 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.710060    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50a94c5c-00b6-4ea4-a339-a150986b676d-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:14:33.907742 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.907704    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"]
Jul 31 13:14:33.912648 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:33.912617    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2b382a-openshift-default-767699bdcb-gfr5x"]
Jul 31 13:14:35.166983 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:35.166945    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" path="/var/lib/kubelet/pods/50a94c5c-00b6-4ea4-a339-a150986b676d/volumes"
Jul 31 13:14:49.290750 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:49.290705    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:49.353381 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:49.353331    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:49.418348 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:49.418314    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:49.471320 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:49.471280    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:49.828806 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:49.828761    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:14:54.855176 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:14:54.855125    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:00.130911 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.130864    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"]
Jul 31 13:15:00.131582 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.131555    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy"
Jul 31 13:15:00.131753 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.131738    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy"
Jul 31 13:15:00.131873 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.131849    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy"
Jul 31 13:15:00.131873 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.131870    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy"
Jul 31 13:15:00.132013 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.131983    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy"
Jul 31 13:15:00.132013 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.131998    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="50a94c5c-00b6-4ea4-a339-a150986b676d" containerName="istio-proxy"
Jul 31 13:15:00.134094 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.134077    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"]
Jul 31 13:15:00.134233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.134211    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"
Jul 31 13:15:00.136460 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.136437    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"]
Jul 31 13:15:00.137112 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.136950    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"
Jul 31 13:15:00.137112 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.136963    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 13:15:00.143056 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.143024    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85"]
Jul 31 13:15:00.143218 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.143097    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"
Jul 31 13:15:00.149726 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.149260    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"]
Jul 31 13:15:00.149726 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.149354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85"
Jul 31 13:15:00.149726 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.149365    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"]
Jul 31 13:15:00.151919 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.151889    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"]
Jul 31 13:15:00.154290 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.154253    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85"]
Jul 31 13:15:00.155529 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.155497    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"
Jul 31 13:15:00.166844 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.166821    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"
Jul 31 13:15:00.204861 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.204818    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"
Jul 31 13:15:00.213548 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.213518    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85"
Jul 31 13:15:00.348335 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.348189    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"]
Jul 31 13:15:00.350704 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:15:00.350671    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94eeee1_5151_432c_a2a5_31e0c1288d3d.slice/crio-f167304907686ce54c045f6b93f9b3f1eb4a4f68f0e389426fb90dbf63fe7461 WatchSource:0}: Error finding container f167304907686ce54c045f6b93f9b3f1eb4a4f68f0e389426fb90dbf63fe7461: Status 404 returned error can't find the container with id f167304907686ce54c045f6b93f9b3f1eb4a4f68f0e389426fb90dbf63fe7461
Jul 31 13:15:00.410617 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.410541    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"]
Jul 31 13:15:00.413007 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:15:00.412979    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb282188_c7fb_4079_9ef3_630292e91816.slice/crio-d96b75edbe9d2c65a98537e242412b38e94155e71bc2b89a2381bd690457b937 WatchSource:0}: Error finding container d96b75edbe9d2c65a98537e242412b38e94155e71bc2b89a2381bd690457b937: Status 404 returned error can't find the container with id d96b75edbe9d2c65a98537e242412b38e94155e71bc2b89a2381bd690457b937
Jul 31 13:15:00.587834 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.587754    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"]
Jul 31 13:15:00.590692 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:15:00.590659    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecac288_30ab_4079_a237_c8464fd3c78d.slice/crio-bc841bdb4f78dfb0aaee8cb410d40069673638f7ee98bbf8c45afc7cb898cb9a WatchSource:0}: Error finding container bc841bdb4f78dfb0aaee8cb410d40069673638f7ee98bbf8c45afc7cb898cb9a: Status 404 returned error can't find the container with id bc841bdb4f78dfb0aaee8cb410d40069673638f7ee98bbf8c45afc7cb898cb9a
Jul 31 13:15:00.630887 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.630719    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85"]
Jul 31 13:15:00.633517 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:15:00.633483    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c65870f_97b3_476c_8911_d3dbdd617a80.slice/crio-e8f06d86470d61fe1e27e5c72a6f2b258f296d3a3ccdeb4de48e4e0ab5d50ceb WatchSource:0}: Error finding container e8f06d86470d61fe1e27e5c72a6f2b258f296d3a3ccdeb4de48e4e0ab5d50ceb: Status 404 returned error can't find the container with id e8f06d86470d61fe1e27e5c72a6f2b258f296d3a3ccdeb4de48e4e0ab5d50ceb
Jul 31 13:15:00.714468 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.714430    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd" event={"ID":"c94eeee1-5151-432c-a2a5-31e0c1288d3d","Type":"ContainerStarted","Data":"d27b77446201da22d6dffd05f6544036e1883c96f62064478fb2f056d36bd332"}
Jul 31 13:15:00.714657 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.714495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd" event={"ID":"c94eeee1-5151-432c-a2a5-31e0c1288d3d","Type":"ContainerStarted","Data":"f167304907686ce54c045f6b93f9b3f1eb4a4f68f0e389426fb90dbf63fe7461"}
Jul 31 13:15:00.715978 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.715952    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s" event={"ID":"eb282188-c7fb-4079-9ef3-630292e91816","Type":"ContainerStarted","Data":"3305b93f67ca157ef163db70ebc27d330ae3b963784c336188065a5588132507"}
Jul 31 13:15:00.716098 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.716000    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s" event={"ID":"eb282188-c7fb-4079-9ef3-630292e91816","Type":"ContainerStarted","Data":"d96b75edbe9d2c65a98537e242412b38e94155e71bc2b89a2381bd690457b937"}
Jul 31 13:15:00.717213 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.717181    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85" event={"ID":"2c65870f-97b3-476c-8911-d3dbdd617a80","Type":"ContainerStarted","Data":"e8f06d86470d61fe1e27e5c72a6f2b258f296d3a3ccdeb4de48e4e0ab5d50ceb"}
Jul 31 13:15:00.718350 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.718324    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b" event={"ID":"7ecac288-30ab-4079-a237-c8464fd3c78d","Type":"ContainerStarted","Data":"bc841bdb4f78dfb0aaee8cb410d40069673638f7ee98bbf8c45afc7cb898cb9a"}
Jul 31 13:15:00.731007 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.730959    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd" podStartSLOduration=0.73094433 podStartE2EDuration="730.94433ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:15:00.729991661 +0000 UTC m=+3578.093973442" watchObservedRunningTime="2026-07-31 13:15:00.73094433 +0000 UTC m=+3578.094926109"
Jul 31 13:15:00.747846 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:00.747790    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s" podStartSLOduration=0.747776326 podStartE2EDuration="747.776326ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:15:00.745722315 +0000 UTC m=+3578.109704095" watchObservedRunningTime="2026-07-31 13:15:00.747776326 +0000 UTC m=+3578.111758105"
Jul 31 13:15:01.726095 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.726053    2584 generic.go:356] "Generic (PLEG): container finished" podID="2c65870f-97b3-476c-8911-d3dbdd617a80" containerID="36bdbb574e761f6d8cc24ee784e05987f461adc567d46574fbe07ee69d33a41e" exitCode=0
Jul 31 13:15:01.726555 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.726098    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85" event={"ID":"2c65870f-97b3-476c-8911-d3dbdd617a80","Type":"ContainerDied","Data":"36bdbb574e761f6d8cc24ee784e05987f461adc567d46574fbe07ee69d33a41e"}
Jul 31 13:15:01.727677 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.727655    2584 generic.go:356] "Generic (PLEG): container finished" podID="7ecac288-30ab-4079-a237-c8464fd3c78d" containerID="62d10807c22b98522ffc846d4562f82d57b23d573fd1a50b9029dd657d6ace5f" exitCode=0
Jul 31 13:15:01.727766 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.727742    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b" event={"ID":"7ecac288-30ab-4079-a237-c8464fd3c78d","Type":"ContainerDied","Data":"62d10807c22b98522ffc846d4562f82d57b23d573fd1a50b9029dd657d6ace5f"}
Jul 31 13:15:01.729229 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.729204    2584 generic.go:356] "Generic (PLEG): container finished" podID="c94eeee1-5151-432c-a2a5-31e0c1288d3d" containerID="d27b77446201da22d6dffd05f6544036e1883c96f62064478fb2f056d36bd332" exitCode=0
Jul 31 13:15:01.729362 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.729295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd" event={"ID":"c94eeee1-5151-432c-a2a5-31e0c1288d3d","Type":"ContainerDied","Data":"d27b77446201da22d6dffd05f6544036e1883c96f62064478fb2f056d36bd332"}
Jul 31 13:15:01.730712 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.730693    2584 generic.go:356] "Generic (PLEG): container finished" podID="eb282188-c7fb-4079-9ef3-630292e91816" containerID="3305b93f67ca157ef163db70ebc27d330ae3b963784c336188065a5588132507" exitCode=0
Jul 31 13:15:01.730815 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:01.730726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s" event={"ID":"eb282188-c7fb-4079-9ef3-630292e91816","Type":"ContainerDied","Data":"3305b93f67ca157ef163db70ebc27d330ae3b963784c336188065a5588132507"}
Jul 31 13:15:02.887769 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:02.887739    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"
Jul 31 13:15:02.936173 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:02.936130    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85"
Jul 31 13:15:02.961670 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:02.961640    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"
Jul 31 13:15:02.965367 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:02.965342    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"
Jul 31 13:15:03.743577 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.743542    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85"
Jul 31 13:15:03.743751 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.743531    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758395-5sp85" event={"ID":"2c65870f-97b3-476c-8911-d3dbdd617a80","Type":"ContainerDied","Data":"e8f06d86470d61fe1e27e5c72a6f2b258f296d3a3ccdeb4de48e4e0ab5d50ceb"}
Jul 31 13:15:03.743751 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.743683    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f06d86470d61fe1e27e5c72a6f2b258f296d3a3ccdeb4de48e4e0ab5d50ceb"
Jul 31 13:15:03.745035 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.745017    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"
Jul 31 13:15:03.745200 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.745038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b" event={"ID":"7ecac288-30ab-4079-a237-c8464fd3c78d","Type":"ContainerDied","Data":"bc841bdb4f78dfb0aaee8cb410d40069673638f7ee98bbf8c45afc7cb898cb9a"}
Jul 31 13:15:03.745200 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.745086    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc841bdb4f78dfb0aaee8cb410d40069673638f7ee98bbf8c45afc7cb898cb9a"
Jul 31 13:15:03.746787 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.746769    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"
Jul 31 13:15:03.746890 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.746785    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd" event={"ID":"c94eeee1-5151-432c-a2a5-31e0c1288d3d","Type":"ContainerDied","Data":"f167304907686ce54c045f6b93f9b3f1eb4a4f68f0e389426fb90dbf63fe7461"}
Jul 31 13:15:03.746890 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.746828    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f167304907686ce54c045f6b93f9b3f1eb4a4f68f0e389426fb90dbf63fe7461"
Jul 31 13:15:03.748269 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.748243    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s" event={"ID":"eb282188-c7fb-4079-9ef3-630292e91816","Type":"ContainerDied","Data":"d96b75edbe9d2c65a98537e242412b38e94155e71bc2b89a2381bd690457b937"}
Jul 31 13:15:03.748269 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.748264    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"
Jul 31 13:15:03.748476 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:03.748286    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d96b75edbe9d2c65a98537e242412b38e94155e71bc2b89a2381bd690457b937"
Jul 31 13:15:23.304267 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:23.304240    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:15:23.317233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:23.317206    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:15:23.397816 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:23.397780    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:31.879475 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:31.879434    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:32.590334 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:32.590298    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:38.326483 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:38.326425    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:38.426188 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:38.426131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:38.589384 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:38.589288    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"]
Jul 31 13:15:38.589625 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:38.589593    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy" containerID="cri-o://4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d" gracePeriod=30
Jul 31 13:15:38.604795 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:38.604765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:38.838614 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:38.838573    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:43.857820 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.857725    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:15:43.945440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.945402    2584 generic.go:356] "Generic (PLEG): container finished" podID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerID="4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d" exitCode=0
Jul 31 13:15:43.945648 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.945450    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"
Jul 31 13:15:43.945648 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.945494    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" event={"ID":"9a9c4504-fd3e-4390-bf6b-3eb55417d46f","Type":"ContainerDied","Data":"4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d"}
Jul 31 13:15:43.945648 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.945548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp" event={"ID":"9a9c4504-fd3e-4390-bf6b-3eb55417d46f","Type":"ContainerDied","Data":"19f5903d6f54f5ab101cd9920d361d8ddae18f9b29ef34b05165374eea02f900"}
Jul 31 13:15:43.945648 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.945572    2584 scope.go:117] "RemoveContainer" containerID="4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d"
Jul 31 13:15:43.956266 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.956241    2584 scope.go:117] "RemoveContainer" containerID="b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e"
Jul 31 13:15:43.961339 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961311    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-data\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961488 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961371    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-socket\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961488 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961419    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-certs\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961488 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961447    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-credential-socket\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961488 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961475    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-token\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961712 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961506    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istiod-ca-cert\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961712 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961539    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-podinfo\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961712 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961625    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48k6m\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-kube-api-access-48k6m\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961712 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961690    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:43.961936 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961713    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:43.961936 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961706    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-envoy\") pod \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\" (UID: \"9a9c4504-fd3e-4390-bf6b-3eb55417d46f\") "
Jul 31 13:15:43.961936 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.961802    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:43.962105 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.962084    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:43.962184 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.962113    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:43.962184 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.962128    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:43.962341 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.962252    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:15:43.962899 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.962863    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:43.964367 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.964343    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:43.964746 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.964718    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-kube-api-access-48k6m" (OuterVolumeSpecName: "kube-api-access-48k6m") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "kube-api-access-48k6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:15:43.965016 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.964993    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:15:43.965106 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.965015    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a9c4504-fd3e-4390-bf6b-3eb55417d46f" (UID: "9a9c4504-fd3e-4390-bf6b-3eb55417d46f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 13:15:43.967998 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.967972    2584 scope.go:117] "RemoveContainer" containerID="4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d"
Jul 31 13:15:43.968296 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:15:43.968273    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d\": container with ID starting with 4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d not found: ID does not exist" containerID="4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d"
Jul 31 13:15:43.968379 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.968309    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d"} err="failed to get container status \"4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d\": rpc error: code = NotFound desc = could not find container \"4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d\": container with ID starting with 4b22072941f6aa6afbb15187a85f75c21c2c8bd40b8ea2b13c3b9b816aeb759d not found: ID does not exist"
Jul 31 13:15:43.968379 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.968336    2584 scope.go:117] "RemoveContainer" containerID="b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e"
Jul 31 13:15:43.968662 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:15:43.968644    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e\": container with ID starting with b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e not found: ID does not exist" containerID="b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e"
Jul 31 13:15:43.968718 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:43.968667    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e"} err="failed to get container status \"b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e\": rpc error: code = NotFound desc = could not find container \"b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e\": container with ID starting with b0a564331bdb3c314e9a975885f24a99ee018f053378a1d3e0238ae935dae10e not found: ID does not exist"
Jul 31 13:15:44.063031 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.062994    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:44.063031 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.063025    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:44.063031 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.063036    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:44.063325 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.063044    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:44.063325 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.063053    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48k6m\" (UniqueName: \"kubernetes.io/projected/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-kube-api-access-48k6m\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:44.063325 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.063063    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9c4504-fd3e-4390-bf6b-3eb55417d46f-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:44.270000 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.269966    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"]
Jul 31 13:15:44.275522 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:44.275492    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-fd6ea7-openshift-default-598fb9dc8d-j52tp"]
Jul 31 13:15:45.166130 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:45.166092    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" path="/var/lib/kubelet/pods/9a9c4504-fd3e-4390-bf6b-3eb55417d46f/volumes"
Jul 31 13:15:46.238519 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:46.238488    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:46.239660 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:46.239638    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"]
Jul 31 13:15:46.241139 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:46.241117    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-f59489-29758395-wk48s"]
Jul 31 13:15:46.303080 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:46.303048    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:46.405087 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:46.405054    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:46.503173 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:46.503067    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:46.962595 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:46.962558    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:47.166041 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:47.165996    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb282188-c7fb-4079-9ef3-630292e91816" path="/var/lib/kubelet/pods/eb282188-c7fb-4079-9ef3-630292e91816/volumes"
Jul 31 13:15:52.898098 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:52.898064    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:52.999402 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:52.999370    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:53.205939 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:53.205900    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"]
Jul 31 13:15:53.206187 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:53.206139    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" containerID="cri-o://b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b" gracePeriod=30
Jul 31 13:15:53.237922 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:53.237880    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:53.410925 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:53.410880    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:15:58.071079 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.071041    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 13:15:58.071491 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.071120    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 13:15:58.462192 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.462149    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:15:58.497292 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497257    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-envoy\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497292 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497292    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t6nt\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-kube-api-access-5t6nt\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497525 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497321    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-istio-token\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497525 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497370    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-socket\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497525 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497398    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/796fc041-7007-445f-8f48-7a5175f175d5-istio-podinfo\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497525 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497494    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-certs\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497525 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497524    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-data\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497780 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497557    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/796fc041-7007-445f-8f48-7a5175f175d5-istiod-ca-cert\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497780 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497595    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-credential-socket\") pod \"796fc041-7007-445f-8f48-7a5175f175d5\" (UID: \"796fc041-7007-445f-8f48-7a5175f175d5\") "
Jul 31 13:15:58.497780 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497731    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:58.497964 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497934    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.498053 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.497955    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:58.498140 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.498109    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:58.498253 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.498132    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:58.498501 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.498479    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/796fc041-7007-445f-8f48-7a5175f175d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:15:58.499913 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.499887    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:15:58.500022 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.499912    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-kube-api-access-5t6nt" (OuterVolumeSpecName: "kube-api-access-5t6nt") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "kube-api-access-5t6nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:15:58.500127 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.500106    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:15:58.500478 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.500445    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/796fc041-7007-445f-8f48-7a5175f175d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "796fc041-7007-445f-8f48-7a5175f175d5" (UID: "796fc041-7007-445f-8f48-7a5175f175d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 13:15:58.599233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599129    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.599233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599199    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.599233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599210    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t6nt\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-kube-api-access-5t6nt\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.599233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599218    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/796fc041-7007-445f-8f48-7a5175f175d5-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.599233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599227    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/796fc041-7007-445f-8f48-7a5175f175d5-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.599233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599235    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.599233 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599242    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/796fc041-7007-445f-8f48-7a5175f175d5-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:58.599587 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:58.599250    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/796fc041-7007-445f-8f48-7a5175f175d5-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:15:59.020121 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.020081    2584 generic.go:356] "Generic (PLEG): container finished" podID="796fc041-7007-445f-8f48-7a5175f175d5" containerID="b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b" exitCode=0
Jul 31 13:15:59.020314 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.020143    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"
Jul 31 13:15:59.020314 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.020185    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" event={"ID":"796fc041-7007-445f-8f48-7a5175f175d5","Type":"ContainerDied","Data":"b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b"}
Jul 31 13:15:59.020314 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.020252    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh" event={"ID":"796fc041-7007-445f-8f48-7a5175f175d5","Type":"ContainerDied","Data":"5ae80b1ae49fdaa0816c83395a5f1bb080e78bbf7fa9318e9a1d6bed7d84591f"}
Jul 31 13:15:59.020314 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.020281    2584 scope.go:117] "RemoveContainer" containerID="b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b"
Jul 31 13:15:59.030329 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.030307    2584 scope.go:117] "RemoveContainer" containerID="8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4"
Jul 31 13:15:59.038943 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.038918    2584 scope.go:117] "RemoveContainer" containerID="b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b"
Jul 31 13:15:59.039304 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:15:59.039282    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b\": container with ID starting with b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b not found: ID does not exist" containerID="b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b"
Jul 31 13:15:59.039411 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.039313    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b"} err="failed to get container status \"b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b\": rpc error: code = NotFound desc = could not find container \"b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b\": container with ID starting with b9f9f946ac38d76cefa00b3ef8471636d149b85c13b0c5fb7a6ef60ac7e8ba6b not found: ID does not exist"
Jul 31 13:15:59.039411 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.039332    2584 scope.go:117] "RemoveContainer" containerID="8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4"
Jul 31 13:15:59.039597 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:15:59.039574    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4\": container with ID starting with 8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4 not found: ID does not exist" containerID="8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4"
Jul 31 13:15:59.039657 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.039606    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4"} err="failed to get container status \"8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4\": rpc error: code = NotFound desc = could not find container \"8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4\": container with ID starting with 8a312d098e8826fcede6ea24433f5a2c364aa83b42e94dfec3dd738796c9aaa4 not found: ID does not exist"
Jul 31 13:15:59.043666 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.043641    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"]
Jul 31 13:15:59.047773 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.047746    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f59489-openshift-default-7c8df4b4db-9mfsh"]
Jul 31 13:15:59.166590 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:15:59.166557    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="796fc041-7007-445f-8f48-7a5175f175d5" path="/var/lib/kubelet/pods/796fc041-7007-445f-8f48-7a5175f175d5/volumes"
Jul 31 13:16:00.303092 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:00.303048    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:00.311055 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:00.311026    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"]
Jul 31 13:16:00.315642 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:00.315615    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-96b3e0-29758395-75m5b"]
Jul 31 13:16:00.526738 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:00.526710    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:00.626693 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:00.626595    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:00.694244 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:00.694212    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:01.023951 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:01.023917    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:01.165980 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:01.165946    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ecac288-30ab-4079-a237-c8464fd3c78d" path="/var/lib/kubelet/pods/7ecac288-30ab-4079-a237-c8464fd3c78d/volumes"
Jul 31 13:16:07.115602 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.115569    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:07.216591 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.216559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:07.380887 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.380799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:07.686309 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.686271    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:07.763851 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.763814    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"]
Jul 31 13:16:07.764177 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764149    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c94eeee1-5151-432c-a2a5-31e0c1288d3d" containerName="cleanup"
Jul 31 13:16:07.764227 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764178    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c94eeee1-5151-432c-a2a5-31e0c1288d3d" containerName="cleanup"
Jul 31 13:16:07.764227 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764193    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy"
Jul 31 13:16:07.764227 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764200    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy"
Jul 31 13:16:07.764227 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764206    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy"
Jul 31 13:16:07.764227 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764211    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy"
Jul 31 13:16:07.764227 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764223    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy"
Jul 31 13:16:07.764227 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764229    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764236    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ecac288-30ab-4079-a237-c8464fd3c78d" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764241    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ecac288-30ab-4079-a237-c8464fd3c78d" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764253    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c65870f-97b3-476c-8911-d3dbdd617a80" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764259    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c65870f-97b3-476c-8911-d3dbdd617a80" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764266    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764271    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764281    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb282188-c7fb-4079-9ef3-630292e91816" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764286    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb282188-c7fb-4079-9ef3-630292e91816" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764332    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c65870f-97b3-476c-8911-d3dbdd617a80" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764340    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764348    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c94eeee1-5151-432c-a2a5-31e0c1288d3d" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764353    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ecac288-30ab-4079-a237-c8464fd3c78d" containerName="cleanup"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764359    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764364    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="796fc041-7007-445f-8f48-7a5175f175d5" containerName="istio-proxy"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764369    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9c4504-fd3e-4390-bf6b-3eb55417d46f" containerName="istio-proxy"
Jul 31 13:16:07.764440 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.764374    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb282188-c7fb-4079-9ef3-630292e91816" containerName="cleanup"
Jul 31 13:16:07.766527 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.766507    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"
Jul 31 13:16:07.769053 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.769027    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 13:16:07.769140 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.769027    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lxtlm\""
Jul 31 13:16:07.774906 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.774878    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"]
Jul 31 13:16:07.884997 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.884960    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5062f5eb-e9a4-4106-92d6-71794db9ebc9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm\" (UID: \"5062f5eb-e9a4-4106-92d6-71794db9ebc9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"
Jul 31 13:16:07.985862 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.985771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5062f5eb-e9a4-4106-92d6-71794db9ebc9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm\" (UID: \"5062f5eb-e9a4-4106-92d6-71794db9ebc9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"
Jul 31 13:16:07.986471 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:07.986451    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5062f5eb-e9a4-4106-92d6-71794db9ebc9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm\" (UID: \"5062f5eb-e9a4-4106-92d6-71794db9ebc9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"
Jul 31 13:16:08.078224 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:08.078182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"
Jul 31 13:16:08.216857 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:08.216823    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"]
Jul 31 13:16:08.221078 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:16:08.221046    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5062f5eb_e9a4_4106_92d6_71794db9ebc9.slice/crio-a8ac83e4950387a6c07075c0b8ac26e48fc8f17d187430f83735a07c34d68c80 WatchSource:0}: Error finding container a8ac83e4950387a6c07075c0b8ac26e48fc8f17d187430f83735a07c34d68c80: Status 404 returned error can't find the container with id a8ac83e4950387a6c07075c0b8ac26e48fc8f17d187430f83735a07c34d68c80
Jul 31 13:16:09.069725 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:09.069687    2584 generic.go:356] "Generic (PLEG): container finished" podID="5062f5eb-e9a4-4106-92d6-71794db9ebc9" containerID="6f705d37732ece589833081e697c0a698ccf7b559261040982994278ce0845bb" exitCode=0
Jul 31 13:16:09.069908 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:09.069768    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm" event={"ID":"5062f5eb-e9a4-4106-92d6-71794db9ebc9","Type":"ContainerDied","Data":"6f705d37732ece589833081e697c0a698ccf7b559261040982994278ce0845bb"}
Jul 31 13:16:09.069908 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:09.069813    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm" event={"ID":"5062f5eb-e9a4-4106-92d6-71794db9ebc9","Type":"ContainerStarted","Data":"a8ac83e4950387a6c07075c0b8ac26e48fc8f17d187430f83735a07c34d68c80"}
Jul 31 13:16:10.209034 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:10.209000    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"
Jul 31 13:16:10.307124 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:10.307088    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5062f5eb-e9a4-4106-92d6-71794db9ebc9-maas-api-service-ca\") pod \"5062f5eb-e9a4-4106-92d6-71794db9ebc9\" (UID: \"5062f5eb-e9a4-4106-92d6-71794db9ebc9\") "
Jul 31 13:16:10.307485 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:10.307460    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5062f5eb-e9a4-4106-92d6-71794db9ebc9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5062f5eb-e9a4-4106-92d6-71794db9ebc9" (UID: "5062f5eb-e9a4-4106-92d6-71794db9ebc9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:16:10.408231 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:10.408196    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5062f5eb-e9a4-4106-92d6-71794db9ebc9-maas-api-service-ca\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:11.079917 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:11.079891    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"
Jul 31 13:16:11.080085 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:11.079891    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm" event={"ID":"5062f5eb-e9a4-4106-92d6-71794db9ebc9","Type":"ContainerDied","Data":"a8ac83e4950387a6c07075c0b8ac26e48fc8f17d187430f83735a07c34d68c80"}
Jul 31 13:16:11.080085 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:11.080018    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8ac83e4950387a6c07075c0b8ac26e48fc8f17d187430f83735a07c34d68c80"
Jul 31 13:16:13.247920 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.247869    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"]
Jul 31 13:16:13.249658 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.249631    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e55b67-29758395-5p5cd"]
Jul 31 13:16:13.250978 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.250952    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:13.351215 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.351177    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:13.407413 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.407376    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"]
Jul 31 13:16:13.409741 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.409711    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e55b67-rqjkm"]
Jul 31 13:16:13.409896 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.409877    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:13.803702 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:13.803670    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:15.166262 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:15.166227    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5062f5eb-e9a4-4106-92d6-71794db9ebc9" path="/var/lib/kubelet/pods/5062f5eb-e9a4-4106-92d6-71794db9ebc9/volumes"
Jul 31 13:16:15.166662 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:15.166515    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c94eeee1-5151-432c-a2a5-31e0c1288d3d" path="/var/lib/kubelet/pods/c94eeee1-5151-432c-a2a5-31e0c1288d3d/volumes"
Jul 31 13:16:19.733616 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:19.733573    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:19.796941 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:19.796906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:20.044200 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:20.044089    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"]
Jul 31 13:16:20.044374 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:20.044347    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy" containerID="cri-o://9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381" gracePeriod=30
Jul 31 13:16:20.098394 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:20.098357    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:20.267981 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:20.267942    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:25.308626 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.308598    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:16:25.456681 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456647    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-credential-socket\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.456904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456708    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-istio-token\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.456904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456754    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-envoy\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.456904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456776    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-data\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.456904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456801    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cc5665-e339-4814-aa97-3ba887413774-istiod-ca-cert\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.456904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456823    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzkk7\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-kube-api-access-kzkk7\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.456904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456848    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-certs\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.456904 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456874    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-socket\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.457309 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.456931    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cc5665-e339-4814-aa97-3ba887413774-istio-podinfo\") pod \"29cc5665-e339-4814-aa97-3ba887413774\" (UID: \"29cc5665-e339-4814-aa97-3ba887413774\") "
Jul 31 13:16:25.457309 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.457028    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:16:25.457309 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.457127    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-data" (OuterVolumeSpecName: "istio-data") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:16:25.457485 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.457328    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:16:25.457485 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.457301    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29cc5665-e339-4814-aa97-3ba887413774-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 13:16:25.457485 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.457369    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:16:25.457485 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.457388    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-credential-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.457485 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.457409    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-data\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.459384 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.459270    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 13:16:25.459384 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.459302    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-kube-api-access-kzkk7" (OuterVolumeSpecName: "kube-api-access-kzkk7") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "kube-api-access-kzkk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:16:25.459384 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.459355    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-istio-token" (OuterVolumeSpecName: "istio-token") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 13:16:25.459583 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.459557    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29cc5665-e339-4814-aa97-3ba887413774-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29cc5665-e339-4814-aa97-3ba887413774" (UID: "29cc5665-e339-4814-aa97-3ba887413774"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 13:16:25.558036 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.557997    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29cc5665-e339-4814-aa97-3ba887413774-istio-podinfo\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.558036 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.558031    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-istio-token\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.558036 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.558039    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-istio-envoy\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.558036 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.558047    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29cc5665-e339-4814-aa97-3ba887413774-istiod-ca-cert\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.558368 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.558056    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzkk7\" (UniqueName: \"kubernetes.io/projected/29cc5665-e339-4814-aa97-3ba887413774-kube-api-access-kzkk7\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.558368 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.558066    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-certs\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:25.558368 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:25.558074    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29cc5665-e339-4814-aa97-3ba887413774-workload-socket\") on node \"ip-10-0-138-37.ec2.internal\" DevicePath \"\""
Jul 31 13:16:26.151235 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.151197    2584 generic.go:356] "Generic (PLEG): container finished" podID="29cc5665-e339-4814-aa97-3ba887413774" containerID="9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381" exitCode=0
Jul 31 13:16:26.151445 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.151254    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"
Jul 31 13:16:26.151445 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.151283    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" event={"ID":"29cc5665-e339-4814-aa97-3ba887413774","Type":"ContainerDied","Data":"9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381"}
Jul 31 13:16:26.151445 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.151375    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8" event={"ID":"29cc5665-e339-4814-aa97-3ba887413774","Type":"ContainerDied","Data":"12d86cbe6e847c9edcaa7214c92267dbe016b55f538a769f108d50dafeca4fd7"}
Jul 31 13:16:26.151445 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.151402    2584 scope.go:117] "RemoveContainer" containerID="9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381"
Jul 31 13:16:26.161066 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.161038    2584 scope.go:117] "RemoveContainer" containerID="a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b"
Jul 31 13:16:26.169427 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.169408    2584 scope.go:117] "RemoveContainer" containerID="9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381"
Jul 31 13:16:26.169716 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:16:26.169695    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381\": container with ID starting with 9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381 not found: ID does not exist" containerID="9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381"
Jul 31 13:16:26.169760 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.169729    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381"} err="failed to get container status \"9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381\": rpc error: code = NotFound desc = could not find container \"9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381\": container with ID starting with 9b3fb84f25c7cb88a1bc953440b420edb751780da9994714dd76a2c2e100c381 not found: ID does not exist"
Jul 31 13:16:26.169760 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.169751    2584 scope.go:117] "RemoveContainer" containerID="a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b"
Jul 31 13:16:26.169983 ip-10-0-138-37 kubenswrapper[2584]: E0731 13:16:26.169968    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b\": container with ID starting with a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b not found: ID does not exist" containerID="a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b"
Jul 31 13:16:26.170022 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.169987    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b"} err="failed to get container status \"a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b\": rpc error: code = NotFound desc = could not find container \"a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b\": container with ID starting with a87a14291aff4abadad499fceba5ec931e953fe543b71a63a6daa8f0a102b51b not found: ID does not exist"
Jul 31 13:16:26.175339 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.175309    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"]
Jul 31 13:16:26.179056 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.179030    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e55b67-openshift-default-7d4969986d-ksqc8"]
Jul 31 13:16:26.940115 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.940082    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5996b4548f-jfns6_3ca49fdd-bed4-47fe-8020-a56f714d53d7/copy-manifests/0.log"
Jul 31 13:16:26.946686 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:26.946659    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5996b4548f-jfns6_3ca49fdd-bed4-47fe-8020-a56f714d53d7/manager/0.log"
Jul 31 13:16:27.166683 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:27.166651    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29cc5665-e339-4814-aa97-3ba887413774" path="/var/lib/kubelet/pods/29cc5665-e339-4814-aa97-3ba887413774/volumes"
Jul 31 13:16:27.645519 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:27.645493    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758380-r9282_f278ca43-1c2f-4c28-9f6c-082243e70979/cleanup/0.log"
Jul 31 13:16:27.753377 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:27.753347    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758395-5sp85_2c65870f-97b3-476c-8911-d3dbdd617a80/cleanup/0.log"
Jul 31 13:16:29.695391 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:29.695361    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9_67a5f21c-0ef2-44ab-970a-2b0fd992b449/istio-proxy/0.log"
Jul 31 13:16:29.808144 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:29.808115    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tvstf_c6724ba8-6404-41e2-bac4-6fd046eeba54/discovery/0.log"
Jul 31 13:16:29.921381 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:29.921348    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84cd848656-799gr_02a65523-f000-43b8-969c-e38ca24683ac/kube-auth-proxy/0.log"
Jul 31 13:16:30.525075 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:30.525043    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b678d4d-k9nfk_2e80e9c1-e676-4614-96fb-fe892d44faff/router/0.log"
Jul 31 13:16:36.595897 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:36.595860    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:36.651662 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:36.651621    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:39.349459 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:39.349411    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mbflb_e84e8374-1010-4349-94f2-c25277188f41/global-pull-secret-syncer/0.log"
Jul 31 13:16:39.472521 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:39.472477    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log"
Jul 31 13:16:39.584642 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:39.584612    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-37.ec2.internal_54a85cf51d5501222ef690dfbb2ff6f9/haproxy/0.log"
Jul 31 13:16:46.572205 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.572171    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-cglfm_851ba084-882c-43b2-9ff6-82d6b11bf96b/kube-state-metrics/0.log"
Jul 31 13:16:46.590816 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.590790    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-cglfm_851ba084-882c-43b2-9ff6-82d6b11bf96b/kube-rbac-proxy-main/0.log"
Jul 31 13:16:46.612809 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.612783    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-cglfm_851ba084-882c-43b2-9ff6-82d6b11bf96b/kube-rbac-proxy-self/0.log"
Jul 31 13:16:46.891554 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.891522    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gthjr_361a2d3c-4b17-4382-af91-9b05471b89a0/node-exporter/0.log"
Jul 31 13:16:46.910585 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.910535    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gthjr_361a2d3c-4b17-4382-af91-9b05471b89a0/kube-rbac-proxy/0.log"
Jul 31 13:16:46.929930 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.929902    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gthjr_361a2d3c-4b17-4382-af91-9b05471b89a0/init-textfile/0.log"
Jul 31 13:16:46.957200 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.957150    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m8xkm_62d46553-1704-4482-8656-c8f799b0f8ba/kube-rbac-proxy-main/0.log"
Jul 31 13:16:46.978298 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:46.978268    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m8xkm_62d46553-1704-4482-8656-c8f799b0f8ba/kube-rbac-proxy-self/0.log"
Jul 31 13:16:47.001533 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.001500    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m8xkm_62d46553-1704-4482-8656-c8f799b0f8ba/openshift-state-metrics/0.log"
Jul 31 13:16:47.039582 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.039555    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e961eef5-c3d2-4548-aa41-7d8ab8a43f25/prometheus/0.log"
Jul 31 13:16:47.061872 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.061834    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e961eef5-c3d2-4548-aa41-7d8ab8a43f25/config-reloader/0.log"
Jul 31 13:16:47.082745 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.082718    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e961eef5-c3d2-4548-aa41-7d8ab8a43f25/thanos-sidecar/0.log"
Jul 31 13:16:47.104150 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.104123    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e961eef5-c3d2-4548-aa41-7d8ab8a43f25/kube-rbac-proxy-web/0.log"
Jul 31 13:16:47.123658 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.123570    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e961eef5-c3d2-4548-aa41-7d8ab8a43f25/kube-rbac-proxy/0.log"
Jul 31 13:16:47.142428 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.142397    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e961eef5-c3d2-4548-aa41-7d8ab8a43f25/kube-rbac-proxy-thanos/0.log"
Jul 31 13:16:47.164626 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.164596    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e961eef5-c3d2-4548-aa41-7d8ab8a43f25/init-config-reloader/0.log"
Jul 31 13:16:47.200923 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.200857    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-frtlx_743926bd-f184-444d-b830-ece8b840e27b/prometheus-operator/0.log"
Jul 31 13:16:47.220363 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.220335    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-frtlx_743926bd-f184-444d-b830-ece8b840e27b/kube-rbac-proxy/0.log"
Jul 31 13:16:47.242242 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:47.242213    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-z88s9_a8e863c1-3556-4d92-9be8-147315f3fc08/prometheus-operator-admission-webhook/0.log"
Jul 31 13:16:48.821989 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:48.821957    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-8xz97_eaf680b6-f8e4-4297-a644-7af5c12f844d/networking-console-plugin/0.log"
Jul 31 13:16:49.340109 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340072    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"]
Jul 31 13:16:49.340479 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340454    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy"
Jul 31 13:16:49.340479 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340481    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy"
Jul 31 13:16:49.340612 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340493    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy"
Jul 31 13:16:49.340612 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340499    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy"
Jul 31 13:16:49.340612 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340512    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5062f5eb-e9a4-4106-92d6-71794db9ebc9" containerName="revoke-keys"
Jul 31 13:16:49.340612 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340518    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5062f5eb-e9a4-4106-92d6-71794db9ebc9" containerName="revoke-keys"
Jul 31 13:16:49.340612 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340574    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5062f5eb-e9a4-4106-92d6-71794db9ebc9" containerName="revoke-keys"
Jul 31 13:16:49.340612 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340584    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy"
Jul 31 13:16:49.340612 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.340591    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="29cc5665-e339-4814-aa97-3ba887413774" containerName="istio-proxy"
Jul 31 13:16:49.343653 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.343636    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.346004 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.345977    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c6r5k\"/\"default-dockercfg-bpt22\""
Jul 31 13:16:49.346127 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.346033    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c6r5k\"/\"kube-root-ca.crt\""
Jul 31 13:16:49.346986 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.346967    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c6r5k\"/\"openshift-service-ca.crt\""
Jul 31 13:16:49.352479 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.352445    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"]
Jul 31 13:16:49.359781 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.359751    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-lib-modules\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.359919 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.359788    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-proc\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.359919 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.359825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-podres\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.359919 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.359891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snhrm\" (UniqueName: \"kubernetes.io/projected/275827ec-4811-475f-a03f-144abff4e20a-kube-api-access-snhrm\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.360021 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.359929    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-sys\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.438401 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.438366    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/1.log"
Jul 31 13:16:49.450871 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.450829    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-dt557_bd084b10-562f-4e45-a1a8-5ec09618414f/console-operator/2.log"
Jul 31 13:16:49.460830 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.460786    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snhrm\" (UniqueName: \"kubernetes.io/projected/275827ec-4811-475f-a03f-144abff4e20a-kube-api-access-snhrm\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.460987 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.460850    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-sys\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.460987 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.460919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-lib-modules\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.460987 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.460947    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-proc\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.460987 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.460962    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-sys\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.461235 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.460999    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-podres\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.461235 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.461019    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-proc\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.461235 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.461077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-lib-modules\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.461235 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.461109    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/275827ec-4811-475f-a03f-144abff4e20a-podres\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.468782 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.468755    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snhrm\" (UniqueName: \"kubernetes.io/projected/275827ec-4811-475f-a03f-144abff4e20a-kube-api-access-snhrm\") pod \"perf-node-gather-daemonset-z844r\" (UID: \"275827ec-4811-475f-a03f-144abff4e20a\") " pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.655441 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.655393    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:49.793583 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:49.793549    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"]
Jul 31 13:16:49.797045 ip-10-0-138-37 kubenswrapper[2584]: W0731 13:16:49.797013    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod275827ec_4811_475f_a03f_144abff4e20a.slice/crio-017a70d4c26ead15b6a0529cc8dbda38fd92475dbfc59d866562e6cd0a92f98c WatchSource:0}: Error finding container 017a70d4c26ead15b6a0529cc8dbda38fd92475dbfc59d866562e6cd0a92f98c: Status 404 returned error can't find the container with id 017a70d4c26ead15b6a0529cc8dbda38fd92475dbfc59d866562e6cd0a92f98c
Jul 31 13:16:50.278622 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:50.278583    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r" event={"ID":"275827ec-4811-475f-a03f-144abff4e20a","Type":"ContainerStarted","Data":"4a33c04208363f601a5521dba16cbdb2fcd96110e770d6968136bd55882ed64d"}
Jul 31 13:16:50.279023 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:50.278640    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r" event={"ID":"275827ec-4811-475f-a03f-144abff4e20a","Type":"ContainerStarted","Data":"017a70d4c26ead15b6a0529cc8dbda38fd92475dbfc59d866562e6cd0a92f98c"}
Jul 31 13:16:50.279023 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:50.278699    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:50.293839 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:50.293786    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r" podStartSLOduration=1.2937699280000001 podStartE2EDuration="1.293769928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 13:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 13:16:50.293086153 +0000 UTC m=+3687.657067934" watchObservedRunningTime="2026-07-31 13:16:50.293769928 +0000 UTC m=+3687.657751707"
Jul 31 13:16:51.882022 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:51.881990    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p6kcl_ec511360-937c-4dd5-9a57-0f10382c2130/dns/0.log"
Jul 31 13:16:51.900320 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:51.900291    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p6kcl_ec511360-937c-4dd5-9a57-0f10382c2130/kube-rbac-proxy/0.log"
Jul 31 13:16:51.950427 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:51.950394    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nnkbg_7e0270da-c956-4820-aa42-c274b29395e3/dns-node-resolver/0.log"
Jul 31 13:16:52.522963 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:52.522930    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9b8wp_df889202-3bef-48b6-89d0-1efdda4100a1/node-ca/0.log"
Jul 31 13:16:53.486290 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:53.486258    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9_67a5f21c-0ef2-44ab-970a-2b0fd992b449/istio-proxy/0.log"
Jul 31 13:16:53.655896 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:53.655860    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tvstf_c6724ba8-6404-41e2-bac4-6fd046eeba54/discovery/0.log"
Jul 31 13:16:53.679626 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:53.679597    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84cd848656-799gr_02a65523-f000-43b8-969c-e38ca24683ac/kube-auth-proxy/0.log"
Jul 31 13:16:53.855568 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:53.855452    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b678d4d-k9nfk_2e80e9c1-e676-4614-96fb-fe892d44faff/router/0.log"
Jul 31 13:16:54.702345 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:54.702301    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zp6fw_f7d43255-0879-4cf5-8ac3-0cdaa84456a3/serve-healthcheck-canary/0.log"
Jul 31 13:16:55.286632 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:55.286582    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tj8pr_c8a4b341-1866-4f10-be64-41a944dab346/kube-rbac-proxy/0.log"
Jul 31 13:16:55.306647 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:55.306619    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tj8pr_c8a4b341-1866-4f10-be64-41a944dab346/exporter/0.log"
Jul 31 13:16:55.326093 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:55.326059    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tj8pr_c8a4b341-1866-4f10-be64-41a944dab346/extractor/0.log"
Jul 31 13:16:56.273724 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:56.273672    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fmd8k_065bcf50-4b01-4c1e-8250-057318bb5c65/konnectivity-agent/0.log" limit=1024
Jul 31 13:16:56.293950 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:56.293920    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c6r5k/perf-node-gather-daemonset-z844r"
Jul 31 13:16:58.548838 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:58.548798    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5996b4548f-jfns6_3ca49fdd-bed4-47fe-8020-a56f714d53d7/manager/0.log"
Jul 31 13:16:58.567658 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:58.567631    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5996b4548f-jfns6_3ca49fdd-bed4-47fe-8020-a56f714d53d7/copy-manifests/0.log"
Jul 31 13:16:59.744847 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:59.744815    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9_67a5f21c-0ef2-44ab-970a-2b0fd992b449/istio-proxy/0.log"
Jul 31 13:16:59.922176 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:59.922133    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tvstf_c6724ba8-6404-41e2-bac4-6fd046eeba54/discovery/0.log"
Jul 31 13:16:59.935076 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:16:59.935050    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84cd848656-799gr_02a65523-f000-43b8-969c-e38ca24683ac/kube-auth-proxy/0.log"
Jul 31 13:17:00.033136 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:00.033053    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f679cb99-8cr57_ecdcda26-b97a-4889-9d0b-17af7e658e8a/manager/0.log"
Jul 31 13:17:00.069847 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:00.069817    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b678d4d-k9nfk_2e80e9c1-e676-4614-96fb-fe892d44faff/router/0.log"
Jul 31 13:17:01.558557 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:01.558531    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t7sn9_67a5f21c-0ef2-44ab-970a-2b0fd992b449/istio-proxy/0.log"
Jul 31 13:17:01.724849 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:01.724758    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tvstf_c6724ba8-6404-41e2-bac4-6fd046eeba54/discovery/0.log"
Jul 31 13:17:01.736980 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:01.736944    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84cd848656-799gr_02a65523-f000-43b8-969c-e38ca24683ac/kube-auth-proxy/0.log"
Jul 31 13:17:01.868995 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:01.868966    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b678d4d-k9nfk_2e80e9c1-e676-4614-96fb-fe892d44faff/router/0.log"
Jul 31 13:17:06.308852 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.308821    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6w8bq_2fe447c6-fb71-44fb-9791-d81c06899e5c/kube-multus/0.log"
Jul 31 13:17:06.329851 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.329822    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcr66_557922f6-6f9d-4a00-92ce-71d8452b6645/kube-multus-additional-cni-plugins/0.log"
Jul 31 13:17:06.348665 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.348636    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcr66_557922f6-6f9d-4a00-92ce-71d8452b6645/egress-router-binary-copy/0.log"
Jul 31 13:17:06.367748 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.367718    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcr66_557922f6-6f9d-4a00-92ce-71d8452b6645/cni-plugins/0.log"
Jul 31 13:17:06.389372 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.389339    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcr66_557922f6-6f9d-4a00-92ce-71d8452b6645/bond-cni-plugin/0.log"
Jul 31 13:17:06.408536 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.408508    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcr66_557922f6-6f9d-4a00-92ce-71d8452b6645/routeoverride-cni/0.log"
Jul 31 13:17:06.426771 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.426743    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcr66_557922f6-6f9d-4a00-92ce-71d8452b6645/whereabouts-cni-bincopy/0.log"
Jul 31 13:17:06.445260 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.445219    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcr66_557922f6-6f9d-4a00-92ce-71d8452b6645/whereabouts-cni/0.log"
Jul 31 13:17:06.911296 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.911262    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zz2qs_6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7/network-metrics-daemon/0.log"
Jul 31 13:17:06.929309 ip-10-0-138-37 kubenswrapper[2584]: I0731 13:17:06.929278    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zz2qs_6590a2f9-f9c3-4f5d-ba30-3fbbeb32f2c7/kube-rbac-proxy/0.log"