Aug 05 17:20:17.723114 ip-10-0-138-196 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 05 17:20:17.723126 ip-10-0-138-196 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 05 17:20:17.723134 ip-10-0-138-196 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 05 17:20:17.723413 ip-10-0-138-196 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 05 17:20:27.759994 ip-10-0-138-196 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 05 17:20:27.760013 ip-10-0-138-196 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c3b0eb5a707f4676ac3e0a8deb3e311f --
Aug 05 17:22:30.304422 ip-10-0-138-196 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 17:22:30.668732 ip-10-0-138-196 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:22:30.668732 ip-10-0-138-196 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 17:22:30.668732 ip-10-0-138-196 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:22:30.668732 ip-10-0-138-196 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 17:22:30.668732 ip-10-0-138-196 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:22:30.670329 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.670207    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 17:22:30.677582 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677555    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:22:30.677582 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677576    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:22:30.677582 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677583    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:22:30.677582 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677588    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677593    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677598    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677603    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677607    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677611    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677615    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677619    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677622    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677626    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677629    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677633    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677637    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677641    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677645    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677649    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677652    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677656    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677660    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:22:30.677844 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677666    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677672    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677677    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677682    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677686    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677689    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677693    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677700    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677711    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677715    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677719    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677724    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677729    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677733    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677738    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677742    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677747    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677751    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677756    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677760    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:22:30.678633 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677763    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677768    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677772    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677776    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677780    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677785    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677789    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677793    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677798    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677802    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677806    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677810    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677814    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677819    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677823    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677828    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677832    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677836    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677840    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677845    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:22:30.679260 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677849    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677853    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677857    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677861    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677866    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677872    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677876    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677881    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677886    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677891    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677895    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677901    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677907    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677912    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677918    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677923    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677928    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677932    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677936    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:22:30.679931 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677940    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677944    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677950    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677954    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677959    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677964    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677968    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677972    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677976    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677980    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677984    2560 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677989    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677993    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.677998    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.678002    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.678006    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.678010    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.678015    2560 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679873    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679886    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:22:30.680737 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679891    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679897    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679901    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679906    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679910    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679914    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679919    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679923    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679927    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679931    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679935    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679939    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679942    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679946    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679951    2560 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679955    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679959    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679963    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679967    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679971    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:22:30.681659 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679976    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679980    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679984    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679990    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679994    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.679999    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680003    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680007    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680011    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680016    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680021    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680025    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680030    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680034    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680039    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680043    2560 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680048    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680052    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680057    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680061    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:22:30.682550 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680065    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680069    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680073    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680077    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680081    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680085    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680089    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680093    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680118    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680123    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680127    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680131    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680138    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680143    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680148    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680153    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680157    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680162    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680166    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:22:30.683325 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680171    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680176    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680181    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680186    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680190    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680194    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680198    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680202    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680206    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680213    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680219    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680223    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680228    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680234    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680241    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680246    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680250    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680255    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680259    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:22:30.683879 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680264    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680268    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680273    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680278    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680282    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680287    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680291    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680297    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680302    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680308    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680312    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680317    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680321    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680325    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680329    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680334    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680337    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680342    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680346    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680966    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:22:30.684433 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680974    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680979    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680984    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680988    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680993    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.680997    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681002    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681006    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681010    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681014    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681019    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681023    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681027    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681031    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681036    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681041    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681045    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681049    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681053    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681058    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:22:30.685164 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681063    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681068    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681073    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681077    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681081    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681085    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681090    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681095    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681117    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681121    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681125    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681132    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681138    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681144    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681148    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681152    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681156    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681160    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681165    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681169    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:22:30.685650 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681173    2560 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681177    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681182    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681186    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681190    2560 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681194    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681198    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681203    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681208    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681212    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681216    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681220    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681225    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681229    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681234    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681238    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681242    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681246    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681251    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681255    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:22:30.686221 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681259    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681263    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681268    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681273    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681277    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681282    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681288    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681294    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681298    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681302    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681309    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681313    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681317    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681321    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681325    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681328    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681332    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681336    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681340    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:22:30.686771 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681343    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681347    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681358    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681362    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681366    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681370    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681377    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681381    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681385    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681389    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681394    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681398    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681402    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681407    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681411    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681415    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681419    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681423    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.681427    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681532    2560 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 17:22:30.687302 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681542    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681554    2560 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681561    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681567    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681573    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681579    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681586    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681591    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681596    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681602    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681607    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681611    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681616    2560 flags.go:64] FLAG: --cgroup-root=""
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681621    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681625    2560 flags.go:64] FLAG: --client-ca-file=""
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681631    2560 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681640    2560 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681646    2560 flags.go:64] FLAG: --cluster-domain=""
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681653    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681657    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681662    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681667    2560 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681673    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 17:22:30.687791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681677    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681682    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681687    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681692    2560 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681697    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681702    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681707    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681712    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681718    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681723    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681728    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681732    2560 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681737    2560 flags.go:64] FLAG: --enable-server="true"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681742    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681749    2560 flags.go:64] FLAG: --event-burst="100"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681754    2560 flags.go:64] FLAG: --event-qps="50"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681759    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681764    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681768    2560 flags.go:64] FLAG: --eviction-hard=""
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681774    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681779    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681784    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681788    2560 flags.go:64] FLAG: --eviction-soft=""
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681793    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681797    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 17:22:30.688344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681804    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681809    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681815    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681820    2560 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681824    2560 flags.go:64] FLAG: --feature-gates=""
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681831    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681835    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681840    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681845    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681850    2560 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681877    2560 flags.go:64] FLAG: --help="false"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681883    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-196.ec2.internal"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681889    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681893    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681898    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681903    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681909    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681914    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681918    2560 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681923    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681927    2560 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681931    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681936    2560 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681941    2560 flags.go:64] FLAG: --kube-reserved=""
Aug 05 17:22:30.688944 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681946    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681950    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681955    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681960    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681964    2560 flags.go:64] FLAG: --lock-file=""
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681969    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681973    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681978    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681988    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.681995    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682001    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682006    2560 flags.go:64] FLAG: --logging-format="text"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682010    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682016    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682021    2560 flags.go:64] FLAG: --manifest-url=""
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682025    2560 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682033    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682038    2560 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682044    2560 flags.go:64] FLAG: --max-pods="110"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682049    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682053    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682058    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682063    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682067    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682072    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 17:22:30.689594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682077    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682089    2560 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682093    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682115    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682121    2560 flags.go:64] FLAG: --pod-cidr=""
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682125    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682134    2560 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682138    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682143    2560 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682148    2560 flags.go:64] FLAG: --port="10250"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682153    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682158    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-044e91d0a22253605"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682163    2560 flags.go:64] FLAG: --qos-reserved=""
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682168    2560 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682172    2560 flags.go:64] FLAG: --register-node="true"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682177    2560 flags.go:64] FLAG: --register-with-taints=""
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682185    2560 flags.go:64] FLAG: --registry-burst="10"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682194    2560 flags.go:64] FLAG: --registry-qps="5"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682199    2560 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682203    2560 flags.go:64] FLAG: --reserved-memory=""
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682209    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682214    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682219    2560 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682223    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682228    2560 flags.go:64] FLAG: --runonce="false"
Aug 05 17:22:30.690218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682232    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682238    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682242    2560 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682247    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682252    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682257    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682262    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682267    2560 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682271    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682276    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682281    2560 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682285    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682290    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682296    2560 flags.go:64] FLAG: --system-cgroups=""
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682300    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682309    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682314    2560 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682318    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682325    2560 flags.go:64] FLAG: --tls-min-version=""
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682329    2560 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682334    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682338    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682343    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682350    2560 flags.go:64] FLAG: --v="2"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682359    2560 flags.go:64] FLAG: --version="false"
Aug 05 17:22:30.690846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682366    2560 flags.go:64] FLAG: --vmodule=""
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682372    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.682378    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682557    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682563    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682568    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682572    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682578    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682582    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682587    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682591    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682596    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682600    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682607    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682613    2560 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682617    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682622    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682626    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682630    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682635    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:22:30.691460 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682640    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682644    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682648    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682652    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682656    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682660    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682666    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682672    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682678    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682683    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682690    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682696    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682701    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682706    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682711    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682715    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682720    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682725    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682729    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682734    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:22:30.691935 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682738    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682743    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682747    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682753    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682760    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682764    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682768    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682773    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682777    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682781    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682785    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682789    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682794    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682798    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682802    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682807    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682811    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682815    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682819    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:22:30.692431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682823    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682827    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682831    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682837    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682842    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682846    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682851    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682856    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682860    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682864    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682868    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682873    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682877    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682881    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682886    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682890    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682895    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682899    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682903    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682907    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:22:30.692893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682911    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682915    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682919    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682924    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682928    2560 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682932    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682936    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682941    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682944    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682949    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682953    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682957    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682961    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682965    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682969    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682975    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682981    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682985    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682990    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682994    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:22:30.693411 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.682998    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.683003    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.683007    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.683694    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.691547    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.691564    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.692358    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.692370    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692427    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692432    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692436    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692439    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692442    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692445    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692448    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:22:30.693893 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692451    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692454    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692457    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692459    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692462    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692464    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692467    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692469    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692472    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692475    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692477    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692480    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692482    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692485    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692487    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692490    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692492    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692496    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692500    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:22:30.694356 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692503    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692506    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692509    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692513    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692515    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692518    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692520    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692523    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692525    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692528    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692530    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692533    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692535    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692538    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692540    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692543    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692545    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692548    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692550    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692553    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:22:30.694807 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692555    2560 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692558    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692561    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692564    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692566    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692569    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692571    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692574    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692576    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692579    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692581    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692583    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692586    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692590    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692594    2560 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692598    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692604    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692607    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692610    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692613    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:22:30.695304 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692615    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692619    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692622    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692625    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692627    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692630    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692633    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692635    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692638    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692640    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692643    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692645    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692648    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692650    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692653    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692655    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692658    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692660    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692663    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692665    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:22:30.695790 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692668    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692671    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692673    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692676    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692678    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692681    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692684    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692687    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692689    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692692    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692695    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692698    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692701    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.692706    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:22:30.696292 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692817    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692822    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692825    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692828    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692831    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692833    2560 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692836    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692838    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692841    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692844    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692847    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692849    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692851    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692854    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692857    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692859    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692862    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692864    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692867    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692869    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:22:30.696627 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692871    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692874    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692876    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692878    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692882    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692886    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692890    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692893    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692896    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692899    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692902    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692904    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692907    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692910    2560 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692912    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692915    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692918    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692920    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692923    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:22:30.697129 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692925    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692927    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692930    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692932    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692935    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692937    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692939    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692942    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692944    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692947    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692949    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692961    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692964    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692967    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692969    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692972    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692974    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692977    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692980    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692983    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:22:30.697589 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692986    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692988    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692992    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692994    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692997    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.692999    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693002    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693004    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693007    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693011    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693013    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693016    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693018    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693021    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693023    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693026    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693028    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693031    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693033    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693035    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:22:30.698065 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693038    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693040    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693043    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693046    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693048    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693050    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693053    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693056    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693058    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693061    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693063    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693067    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693071    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693074    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693077    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693080    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693083    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693086    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693088    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:22:30.698658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:30.693091    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:22:30.699135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.693112    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:22:30.699135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.693227    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 17:22:30.699135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.695402    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 17:22:30.699135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.696806    2560 server.go:1019] "Starting client certificate rotation"
Aug 05 17:22:30.699135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.696910    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 17:22:30.699135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.696956    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 17:22:30.699135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.698747    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 17:22:30.701694 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.701561    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 17:22:30.713291 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.713273    2560 log.go:25] "Validated CRI v1 runtime API"
Aug 05 17:22:30.715572 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.715555    2560 log.go:25] "Validated CRI v1 image API"
Aug 05 17:22:30.718376 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.718361    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 17:22:30.720720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.720700    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7c4df6d2-b195-4a52-acae-abf17288829b:/dev/nvme0n1p4 a458f05b-419f-4ae7-92c1-cb738cc7e4ef:/dev/nvme0n1p3]
Aug 05 17:22:30.720797 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.720719    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 17:22:30.723086 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.723068    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 17:22:30.725703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.725580    2560 manager.go:216] Machine: {Timestamp:2026-08-05 17:22:30.724438341 +0000 UTC m=+0.308107739 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105264 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec205de9e5c52b21d67eff1897748d73 SystemUUID:ec205de9-e5c5-2b21-d67e-ff1897748d73 BootID:c3b0eb5a-707f-4676-ac3e-0a8deb3e311f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:d4:32:95:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:d4:32:95:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:01:1e:87:36:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 17:22:30.725703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.725697    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 17:22:30.725823 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.725784    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 17:22:30.728424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.728395    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 17:22:30.728614 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.728425    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-196.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 17:22:30.729818 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.729805    2560 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 17:22:30.729882 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.729823    2560 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 17:22:30.729882 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.729841    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 17:22:30.729882 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.729868    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 17:22:30.730998 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.730986    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 17:22:30.735002 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.734988    2560 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 17:22:30.735173 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735161    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 17:22:30.735241 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735205    2560 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 17:22:30.735241 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735226    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 17:22:30.735328 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735245    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 17:22:30.735328 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735259    2560 kubelet.go:398] "Adding apiserver pod source"
Aug 05 17:22:30.735328 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735272    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 17:22:30.735700 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735686    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 17:22:30.735762 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.735709    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 17:22:30.738185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.738169    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 17:22:30.739932 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.739918    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 17:22:30.739975 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.739949    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 17:22:30.754093 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754070    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 17:22:30.754343 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754326    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 17:22:30.754343 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754354    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 17:22:30.754460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754364    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 17:22:30.754460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754380    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 17:22:30.754460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754391    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 17:22:30.754460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754404    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 17:22:30.754460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754412    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 17:22:30.754460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754423    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 17:22:30.754460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754432    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 17:22:30.754683 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754473    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 17:22:30.754683 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.754485    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 17:22:30.755643 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.755621    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 17:22:30.755748 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.755666    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 17:22:30.756146 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.756111    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 17:22:30.756394 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.756369    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 17:22:30.757687 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.757668    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-196.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 17:22:30.759277 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.759265    2560 server.go:1268] "Started kubelet"
Aug 05 17:22:30.759375 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.759344    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 17:22:30.759494 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.759440    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 17:22:30.759599 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.759513    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 17:22:30.760204 ip-10-0-138-196 systemd[1]: Started Kubernetes Kubelet.
Aug 05 17:22:30.761452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.761440    2560 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 17:22:30.763576 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.763559    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 17:22:30.764425 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.764403    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 17:22:30.766715 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.765482    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-196.ec2.internal.18c8f890446ad810  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-196.ec2.internal,UID:ip-10-0-138-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-196.ec2.internal,},FirstTimestamp:2026-08-05 17:22:30.759233552 +0000 UTC m=+0.342902951,LastTimestamp:2026-08-05 17:22:30.759233552 +0000 UTC m=+0.342902951,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-196.ec2.internal,}"
Aug 05 17:22:30.769367 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.769342    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 17:22:30.769367 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.769359    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 17:22:30.769492 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.769461    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:30.770129 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770114    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 17:22:30.770129 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770124    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 17:22:30.770265 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770145    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 17:22:30.770265 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770261    2560 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 17:22:30.770325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770271    2560 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 17:22:30.770325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770270    2560 factory.go:55] Registering systemd factory
Aug 05 17:22:30.770325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770295    2560 factory.go:223] Registration of the systemd container factory successfully
Aug 05 17:22:30.770587 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770576    2560 factory.go:153] Registering CRI-O factory
Aug 05 17:22:30.770649 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770589    2560 factory.go:223] Registration of the crio container factory successfully
Aug 05 17:22:30.770649 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770641    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 17:22:30.770722 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770683    2560 factory.go:103] Registering Raw factory
Aug 05 17:22:30.770722 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.770698    2560 manager.go:1196] Started watching for new ooms in manager
Aug 05 17:22:30.771425 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.771409    2560 manager.go:349] Starting recovery of all containers
Aug 05 17:22:30.771886 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.771855    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 17:22:30.772005 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.771984    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 17:22:30.785290 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.785177    2560 manager.go:354] Recovery completed
Aug 05 17:22:30.789381 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.789368    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:22:30.790513 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.790497    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2rlc"
Aug 05 17:22:30.791258 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.791244    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:22:30.791312 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.791274    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:22:30.791312 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.791290    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:22:30.791864 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.791850    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 17:22:30.791914 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.791865    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 17:22:30.791914 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.791882    2560 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 17:22:30.791979 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.791857    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:22:30.792655 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.792640    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:22:30.792712 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.792670    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:22:30.792712 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.792680    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:22:30.793391 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.793377    2560 policy_none.go:49] "None policy: Start"
Aug 05 17:22:30.793391 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.793393    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 17:22:30.793481 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.793403    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 17:22:30.794661 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.794651    2560 policy_none.go:47] "Start"
Aug 05 17:22:30.796874 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.796851    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2rlc"
Aug 05 17:22:30.801907 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.801817    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-196.ec2.internal.18c8f89046537e2f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-196.ec2.internal,UID:ip-10-0-138-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-196.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-196.ec2.internal,},FirstTimestamp:2026-08-05 17:22:30.791257647 +0000 UTC m=+0.374927045,LastTimestamp:2026-08-05 17:22:30.791257647 +0000 UTC m=+0.374927045,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-196.ec2.internal,}"
Aug 05 17:22:30.838720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.838701    2560 manager.go:337] "Starting Device Plugin manager"
Aug 05 17:22:30.838846 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.838742    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 17:22:30.838846 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.838756    2560 server.go:87] "Starting device plugin registration server"
Aug 05 17:22:30.839048 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.839035    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 17:22:30.839150 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.839067    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 17:22:30.839238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.839214    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 17:22:30.839301 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.839293    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 17:22:30.839301 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.839301    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 17:22:30.839813 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.839794    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 17:22:30.839882 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.839845    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:30.939401 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.939323    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:22:30.944949 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.944924    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:22:30.945071 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.944973    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:22:30.945071 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.944985    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:22:30.945071 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.945017    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-196.ec2.internal"
Aug 05 17:22:30.953178 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.953143    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 17:22:30.954326 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.954310    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-196.ec2.internal"
Aug 05 17:22:30.954393 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.954333    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-196.ec2.internal\": node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:30.954658 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.954642    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 17:22:30.954709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.954680    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 17:22:30.954759 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.954752    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 17:22:30.954806 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.954793    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 17:22:30.957212 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:30.957192    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:22:30.998424 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:30.998389    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.055629 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.055598    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"]
Aug 05 17:22:31.055717 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.055679    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:22:31.056738 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.056724    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:22:31.056812 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.056755    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:22:31.056812 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.056768    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:22:31.058142 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058128    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:22:31.058219 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058200    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.058368 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058239    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:22:31.058915 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058893    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:22:31.058915 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058911    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:22:31.059030 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058932    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:22:31.059030 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058942    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:22:31.059030 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.058915    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:22:31.059030 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.059029    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:22:31.060319 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.060305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.060360 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.060333    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:22:31.061023 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.061007    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:22:31.061141 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.061036    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:22:31.061141 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.061050    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:22:31.072088 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.072071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/04f08173c011157a79eb69f3582fcd41-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal\" (UID: \"04f08173c011157a79eb69f3582fcd41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.072185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.072095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f08173c011157a79eb69f3582fcd41-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal\" (UID: \"04f08173c011157a79eb69f3582fcd41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.072234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.072179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35ce26a74ea51f8bcd5eeb415ccdf08c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-196.ec2.internal\" (UID: \"35ce26a74ea51f8bcd5eeb415ccdf08c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.085747 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.085727    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-196.ec2.internal\" not found" node="ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.090274 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.090257    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-196.ec2.internal\" not found" node="ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.099312 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.099292    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.172888 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.172860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/04f08173c011157a79eb69f3582fcd41-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal\" (UID: \"04f08173c011157a79eb69f3582fcd41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.173056 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.172907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/04f08173c011157a79eb69f3582fcd41-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal\" (UID: \"04f08173c011157a79eb69f3582fcd41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.173056 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.172961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f08173c011157a79eb69f3582fcd41-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal\" (UID: \"04f08173c011157a79eb69f3582fcd41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.173056 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.172988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35ce26a74ea51f8bcd5eeb415ccdf08c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-196.ec2.internal\" (UID: \"35ce26a74ea51f8bcd5eeb415ccdf08c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.173056 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.173011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35ce26a74ea51f8bcd5eeb415ccdf08c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-196.ec2.internal\" (UID: \"35ce26a74ea51f8bcd5eeb415ccdf08c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.173056 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.173036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f08173c011157a79eb69f3582fcd41-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal\" (UID: \"04f08173c011157a79eb69f3582fcd41\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.200219 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.200159    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.300811 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.300771    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.389415 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.389383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.394052 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.393821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:31.401633 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.401614    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.502304 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.502212    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.602669 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.602636    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.696220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.696194    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 17:22:31.696668 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.696360    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 17:22:31.703460 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:31.703441    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-196.ec2.internal\" not found"
Aug 05 17:22:31.802321 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.801888    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 17:17:31 +0000 UTC" deadline="2028-05-04 04:37:06.997403172 +0000 UTC"
Aug 05 17:22:31.802321 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.802197    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15299h14m35.195216399s"
Aug 05 17:22:31.803408 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.803378    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:22:31.807045 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:31.807021    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:22:32.968729 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:32.968701    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:32.984750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:32.984722    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 17:22:32.985738 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:32.985722    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"
Aug 05 17:22:32.994701 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:32.994679    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 17:22:33.047142 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:33.047096    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f08173c011157a79eb69f3582fcd41.slice/crio-027a5aadaca3332fb286e8252c58d194214eb2f712a91a21ee09aad25dc8d1b3 WatchSource:0}: Error finding container 027a5aadaca3332fb286e8252c58d194214eb2f712a91a21ee09aad25dc8d1b3: Status 404 returned error can't find the container with id 027a5aadaca3332fb286e8252c58d194214eb2f712a91a21ee09aad25dc8d1b3
Aug 05 17:22:33.047452 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:33.047432    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ce26a74ea51f8bcd5eeb415ccdf08c.slice/crio-acbfa95f5b6af804f579c11914671a72e4f1af7370e2b1bf3d0dde1fe33683d9 WatchSource:0}: Error finding container acbfa95f5b6af804f579c11914671a72e4f1af7370e2b1bf3d0dde1fe33683d9: Status 404 returned error can't find the container with id acbfa95f5b6af804f579c11914671a72e4f1af7370e2b1bf3d0dde1fe33683d9
Aug 05 17:22:33.051938 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.051921    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:22:33.056509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.056462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal" event={"ID":"04f08173c011157a79eb69f3582fcd41","Type":"ContainerStarted","Data":"027a5aadaca3332fb286e8252c58d194214eb2f712a91a21ee09aad25dc8d1b3"}
Aug 05 17:22:33.057659 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.057632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal" event={"ID":"35ce26a74ea51f8bcd5eeb415ccdf08c","Type":"ContainerStarted","Data":"acbfa95f5b6af804f579c11914671a72e4f1af7370e2b1bf3d0dde1fe33683d9"}
Aug 05 17:22:33.447103 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.447071    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:22:33.683687 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.683653    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:22:33.834971 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.834892    2560 apiserver.go:52] "Watching apiserver"
Aug 05 17:22:33.841590 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.841559    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 17:22:33.842111 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.842085    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-2vbwd","openshift-image-registry/node-ca-zzmrz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal","openshift-multus/multus-4pbhb","openshift-multus/network-metrics-daemon-l4hvb","openshift-network-operator/iptables-alerter-7wwbp","openshift-ovn-kubernetes/ovnkube-node-77jpd","kube-system/global-pull-secret-syncer-mx8jq","kube-system/konnectivity-agent-c2rb5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p","openshift-dns/node-resolver-zjzfb","openshift-multus/multus-additional-cni-plugins-clpgp","openshift-network-diagnostics/network-check-target-4mqk4","kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal"]
Aug 05 17:22:33.844674 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.844651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.847207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.846879    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.847207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.847014    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:22:33.847207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.847020    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6bmfv\""
Aug 05 17:22:33.847368 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.847247    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 17:22:33.849451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.849085    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 17:22:33.849451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.849214    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 17:22:33.849451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.849280    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vq56f\""
Aug 05 17:22:33.849451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.849307    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 17:22:33.849691 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.849457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.851675 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.851555    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:33.851780 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:33.851672    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:33.851780 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.851722    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 17:22:33.851922 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.851898    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6xh9w\""
Aug 05 17:22:33.852086 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.852009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 17:22:33.852086 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.852065    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 17:22:33.852210 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.852072    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 17:22:33.854424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.853742    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.857245 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.857225    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.858033 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.857435    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 17:22:33.858033 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.857513    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:22:33.858259 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.858221    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 17:22:33.858784 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.858761    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6m8rt\""
Aug 05 17:22:33.859503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.859486    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 17:22:33.859710 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.859681    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 17:22:33.859807 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.859773    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 17:22:33.860160 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.860139    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-75mpn\""
Aug 05 17:22:33.860387 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.860366    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 17:22:33.860551 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.860534    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 17:22:33.861502 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.861456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.861879 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.861760    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 17:22:33.862475 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:33.862300    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:33.864751 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.864734    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:33.866773 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.866752    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 17:22:33.867125 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.867102    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p2tnh\""
Aug 05 17:22:33.867201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.867177    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.867622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.867604    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 17:22:33.868222 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.868204    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 17:22:33.869429 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.869412    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 17:22:33.869590 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.869570    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 17:22:33.869988 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.869795    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 17:22:33.869988 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.869925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q4lw4\""
Aug 05 17:22:33.870216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.870202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.872475 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.872336    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 17:22:33.872475 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.872424    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 17:22:33.872475 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.872428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.872631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.872518    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sfx75\""
Aug 05 17:22:33.874720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.874701    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 17:22:33.875029 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.875011    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2pr4m\""
Aug 05 17:22:33.875224 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.875186    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:33.875285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.875235    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 17:22:33.875285 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:33.875270    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:33.877266 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.877246    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 17:22:33.881019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.880998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afff50be-fdca-4346-bacd-2036a29b48e4-hosts-file\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.881099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-cnibin\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.881099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-sys-fs\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.881099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-var-lib-kubelet\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.881264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93dbf120-6966-43e6-8e07-bd9e299c96a8-host-slash\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.881264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-node-log\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.881264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-env-overrides\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.881264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-sys\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.881451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-lib-modules\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.881451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2cl6\" (UniqueName: \"kubernetes.io/projected/aab1c18f-8c43-4c6d-8496-6544801668c0-kube-api-access-z2cl6\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.881451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-etc-kubernetes\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.881451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdj5p\" (UniqueName: \"kubernetes.io/projected/ac55c236-fd48-44d8-b275-1cda967ca5b2-kube-api-access-fdj5p\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:33.881451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-kubelet\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.881451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71ba3056-a844-4951-8a4a-ff51a4af3bd8-konnectivity-ca\") pod \"konnectivity-agent-c2rb5\" (UID: \"71ba3056-a844-4951-8a4a-ff51a4af3bd8\") " pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:33.881451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-ovnkube-script-lib\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd5bf156-7684-48e1-8c4e-29e6a7553a65-kubelet-config\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd5bf156-7684-48e1-8c4e-29e6a7553a65-dbus\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c611648-4128-4dfb-90e4-5c0cb368164a-cni-binary-copy\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-socket-dir-parent\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-cni-bin\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-hostroot\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-multus-certs\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-cni-netd\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.881775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-829xs\" (UniqueName: \"kubernetes.io/projected/3fd7a386-704c-4728-bf5b-bc4120a13633-kube-api-access-829xs\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-cni-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-kubelet\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-conf-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-ovn\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-device-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.881991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-tuned\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-serviceca\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93dbf120-6966-43e6-8e07-bd9e299c96a8-iptables-alerter-script\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-cni-multus\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71ba3056-a844-4951-8a4a-ff51a4af3bd8-agent-certs\") pod \"konnectivity-agent-c2rb5\" (UID: \"71ba3056-a844-4951-8a4a-ff51a4af3bd8\") " pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-host\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-netns\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:33.882310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-slash\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-registration-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-systemd\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-var-lib-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-log-socket\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-os-release\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-etc-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-ovnkube-config\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-socket-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysconfig\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-kubernetes\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-k8s-cni-cncf-io\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-systemd-units\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-modprobe-d\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-host\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbgqs\" (UniqueName: \"kubernetes.io/projected/93dbf120-6966-43e6-8e07-bd9e299c96a8-kube-api-access-qbgqs\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-run-ovn-kubernetes\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aab1c18f-8c43-4c6d-8496-6544801668c0-tmp\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afff50be-fdca-4346-bacd-2036a29b48e4-tmp-dir\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d98s8\" (UniqueName: \"kubernetes.io/projected/afff50be-fdca-4346-bacd-2036a29b48e4-kube-api-access-d98s8\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysctl-d\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysctl-conf\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-systemd\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m2fj\" (UniqueName: \"kubernetes.io/projected/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-kube-api-access-2m2fj\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.882995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-daemon-config\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-cni-bin\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnn5\" (UniqueName: \"kubernetes.io/projected/fef39388-9130-48fb-a799-c965f7ae620e-kube-api-access-hrnn5\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlgfn\" (UniqueName: \"kubernetes.io/projected/3c611648-4128-4dfb-90e4-5c0cb368164a-kube-api-access-dlgfn\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-run-netns\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fd7a386-704c-4728-bf5b-bc4120a13633-ovn-node-metrics-cert\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.883726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-run\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.884508 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.883172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-system-cni-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.919739 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.919716    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpq26"
Aug 05 17:22:33.927178 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.927149    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpq26"
Aug 05 17:22:33.969701 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.969670    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 17:22:33.984325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2cl6\" (UniqueName: \"kubernetes.io/projected/aab1c18f-8c43-4c6d-8496-6544801668c0-kube-api-access-z2cl6\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.984490 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-etc-kubernetes\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.984490 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdj5p\" (UniqueName: \"kubernetes.io/projected/ac55c236-fd48-44d8-b275-1cda967ca5b2-kube-api-access-fdj5p\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:33.984490 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-kubelet\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.984490 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71ba3056-a844-4951-8a4a-ff51a4af3bd8-konnectivity-ca\") pod \"konnectivity-agent-c2rb5\" (UID: \"71ba3056-a844-4951-8a4a-ff51a4af3bd8\") " pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:33.984490 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-cni-binary-copy\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-ovnkube-script-lib\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd5bf156-7684-48e1-8c4e-29e6a7553a65-kubelet-config\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd5bf156-7684-48e1-8c4e-29e6a7553a65-dbus\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c611648-4128-4dfb-90e4-5c0cb368164a-cni-binary-copy\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-socket-dir-parent\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.984725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-cni-bin\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-hostroot\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-multus-certs\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-cni-netd\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-829xs\" (UniqueName: \"kubernetes.io/projected/3fd7a386-704c-4728-bf5b-bc4120a13633-kube-api-access-829xs\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-cni-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-kubelet\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-conf-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-ovn\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-device-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.984999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-tuned\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-serviceca\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93dbf120-6966-43e6-8e07-bd9e299c96a8-iptables-alerter-script\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-cni-multus\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71ba3056-a844-4951-8a4a-ff51a4af3bd8-agent-certs\") pod \"konnectivity-agent-c2rb5\" (UID: \"71ba3056-a844-4951-8a4a-ff51a4af3bd8\") " pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:33.985134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-host\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-system-cni-dir\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-netns\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-slash\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-registration-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-systemd\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-var-lib-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-log-socket\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-os-release\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-etc-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-ovnkube-config\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-socket-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysconfig\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-kubernetes\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.985703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-os-release\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-k8s-cni-cncf-io\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-systemd-units\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-modprobe-d\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-host\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbgqs\" (UniqueName: \"kubernetes.io/projected/93dbf120-6966-43e6-8e07-bd9e299c96a8-kube-api-access-qbgqs\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7z22\" (UniqueName: \"kubernetes.io/projected/d87ed6f7-6039-46de-806d-bd104381dd06-kube-api-access-t7z22\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-run-ovn-kubernetes\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aab1c18f-8c43-4c6d-8496-6544801668c0-tmp\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-cnibin\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.985860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afff50be-fdca-4346-bacd-2036a29b48e4-tmp-dir\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d98s8\" (UniqueName: \"kubernetes.io/projected/afff50be-fdca-4346-bacd-2036a29b48e4-kube-api-access-d98s8\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysctl-d\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysctl-conf\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-systemd\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m2fj\" (UniqueName: \"kubernetes.io/projected/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-kube-api-access-2m2fj\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.986426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-daemon-config\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-cni-bin\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnn5\" (UniqueName: \"kubernetes.io/projected/fef39388-9130-48fb-a799-c965f7ae620e-kube-api-access-hrnn5\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlgfn\" (UniqueName: \"kubernetes.io/projected/3c611648-4128-4dfb-90e4-5c0cb368164a-kube-api-access-dlgfn\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-run-netns\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fd7a386-704c-4728-bf5b-bc4120a13633-ovn-node-metrics-cert\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-run\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-system-cni-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afff50be-fdca-4346-bacd-2036a29b48e4-hosts-file\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-cnibin\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-sys-fs\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-var-lib-kubelet\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93dbf120-6966-43e6-8e07-bd9e299c96a8-host-slash\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-node-log\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-env-overrides\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.987220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-sys\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.987918 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.986766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-lib-modules\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.987918 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.987002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-lib-modules\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.987918 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.987437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-etc-kubernetes\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.987918 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.987678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-kubelet\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.988388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-systemd\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.988401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.988449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.988511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-run\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.988960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-cni-bin\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.988976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-ovnkube-config\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989073    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-ovnkube-script-lib\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd5bf156-7684-48e1-8c4e-29e6a7553a65-kubelet-config\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-socket-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-daemon-config\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71ba3056-a844-4951-8a4a-ff51a4af3bd8-konnectivity-ca\") pod \"konnectivity-agent-c2rb5\" (UID: \"71ba3056-a844-4951-8a4a-ff51a4af3bd8\") " pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-run-netns\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-systemd-units\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-k8s-cni-cncf-io\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-kubernetes\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd5bf156-7684-48e1-8c4e-29e6a7553a65-dbus\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:33.989833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989292    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-host\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-modprobe-d\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-sys\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-socket-dir-parent\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-run-ovn-kubernetes\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989482    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysctl-d\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afff50be-fdca-4346-bacd-2036a29b48e4-tmp-dir\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysconfig\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-sysctl-conf\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aab1c18f-8c43-4c6d-8496-6544801668c0-var-lib-kubelet\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-registration-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c611648-4128-4dfb-90e4-5c0cb368164a-cni-binary-copy\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-cni-multus\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afff50be-fdca-4346-bacd-2036a29b48e4-hosts-file\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.989908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-system-cni-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:33.990012    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fd7a386-704c-4728-bf5b-bc4120a13633-env-overrides\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-log-socket\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.990757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-systemd\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-var-lib-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-kubelet\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-os-release\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93dbf120-6966-43e6-8e07-bd9e299c96a8-iptables-alerter-script\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-etc-openvswitch\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-conf-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990548    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-multus-cni-dir\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-run-ovn\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-device-dir\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-sys-fs\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fef39388-9130-48fb-a799-c965f7ae620e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:33.990732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret podName:cd5bf156-7684-48e1-8c4e-29e6a7553a65 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:34.490685701 +0000 UTC m=+2.975609119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret") pod "global-pull-secret-syncer-mx8jq" (UID: "cd5bf156-7684-48e1-8c4e-29e6a7553a65") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-serviceca\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-hostroot\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93dbf120-6966-43e6-8e07-bd9e299c96a8-host-slash\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-multus-certs\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:33.990887    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:33.991656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-cnibin\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.992452 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:33.990950    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:34.490932113 +0000 UTC m=+2.975855525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:33.992452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-node-log\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.992452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.990982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-run-netns\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.992452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.991008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-host\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:33.992452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.991024    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-slash\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.992452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.991052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fd7a386-704c-4728-bf5b-bc4120a13633-host-cni-netd\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.992452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.991091    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c611648-4128-4dfb-90e4-5c0cb368164a-host-var-lib-cni-bin\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:33.993437 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.993413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aab1c18f-8c43-4c6d-8496-6544801668c0-tmp\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.993978 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.993776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71ba3056-a844-4951-8a4a-ff51a4af3bd8-agent-certs\") pod \"konnectivity-agent-c2rb5\" (UID: \"71ba3056-a844-4951-8a4a-ff51a4af3bd8\") " pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:33.994279 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.994255    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fd7a386-704c-4728-bf5b-bc4120a13633-ovn-node-metrics-cert\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:33.995054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.995021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aab1c18f-8c43-4c6d-8496-6544801668c0-etc-tuned\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.996492 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.996465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdj5p\" (UniqueName: \"kubernetes.io/projected/ac55c236-fd48-44d8-b275-1cda967ca5b2-kube-api-access-fdj5p\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:33.998343 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.998297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2cl6\" (UniqueName: \"kubernetes.io/projected/aab1c18f-8c43-4c6d-8496-6544801668c0-kube-api-access-z2cl6\") pod \"tuned-2vbwd\" (UID: \"aab1c18f-8c43-4c6d-8496-6544801668c0\") " pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:33.999409 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:33.999391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlgfn\" (UniqueName: \"kubernetes.io/projected/3c611648-4128-4dfb-90e4-5c0cb368164a-kube-api-access-dlgfn\") pod \"multus-4pbhb\" (UID: \"3c611648-4128-4dfb-90e4-5c0cb368164a\") " pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:34.000777 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.000737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-829xs\" (UniqueName: \"kubernetes.io/projected/3fd7a386-704c-4728-bf5b-bc4120a13633-kube-api-access-829xs\") pod \"ovnkube-node-77jpd\" (UID: \"3fd7a386-704c-4728-bf5b-bc4120a13633\") " pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:34.000917 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.000738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d98s8\" (UniqueName: \"kubernetes.io/projected/afff50be-fdca-4346-bacd-2036a29b48e4-kube-api-access-d98s8\") pod \"node-resolver-zjzfb\" (UID: \"afff50be-fdca-4346-bacd-2036a29b48e4\") " pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:34.000917 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.000763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m2fj\" (UniqueName: \"kubernetes.io/projected/a0835e42-bf73-4bf5-8dbb-7819bd0d508f-kube-api-access-2m2fj\") pod \"node-ca-zzmrz\" (UID: \"a0835e42-bf73-4bf5-8dbb-7819bd0d508f\") " pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:34.001515 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.001449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnn5\" (UniqueName: \"kubernetes.io/projected/fef39388-9130-48fb-a799-c965f7ae620e-kube-api-access-hrnn5\") pod \"aws-ebs-csi-driver-node-qzb9p\" (UID: \"fef39388-9130-48fb-a799-c965f7ae620e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:34.002909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.002886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbgqs\" (UniqueName: \"kubernetes.io/projected/93dbf120-6966-43e6-8e07-bd9e299c96a8-kube-api-access-qbgqs\") pod \"iptables-alerter-7wwbp\" (UID: \"93dbf120-6966-43e6-8e07-bd9e299c96a8\") " pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:34.088149 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:34.088149 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-os-release\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088149 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7z22\" (UniqueName: \"kubernetes.io/projected/d87ed6f7-6039-46de-806d-bd104381dd06-kube-api-access-t7z22\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088149 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-cnibin\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088404 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088404 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088404 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-cni-binary-copy\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088404 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088404 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-system-cni-dir\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088404 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-system-cni-dir\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088724 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-os-release\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088788 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-cnibin\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.088967 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.088942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d87ed6f7-6039-46de-806d-bd104381dd06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.089058 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.089014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.089318 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.089299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-cni-binary-copy\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.089386 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.089312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d87ed6f7-6039-46de-806d-bd104381dd06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.094009 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.093989    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:22:34.094098 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.094014    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:22:34.094098 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.094028    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dhpv2 for pod openshift-network-diagnostics/network-check-target-4mqk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:34.094098 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.094094    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2 podName:8f22e48d-62bc-40aa-8264-544d75594eb1 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:34.594078715 +0000 UTC m=+3.079002134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dhpv2" (UniqueName: "kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2") pod "network-check-target-4mqk4" (UID: "8f22e48d-62bc-40aa-8264-544d75594eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:34.096488 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.096469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7z22\" (UniqueName: \"kubernetes.io/projected/d87ed6f7-6039-46de-806d-bd104381dd06-kube-api-access-t7z22\") pod \"multus-additional-cni-plugins-clpgp\" (UID: \"d87ed6f7-6039-46de-806d-bd104381dd06\") " pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.159568 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.159534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vbwd"
Aug 05 17:22:34.168874 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.168840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zzmrz"
Aug 05 17:22:34.177716 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.177696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4pbhb"
Aug 05 17:22:34.184576 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.184551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7wwbp"
Aug 05 17:22:34.192661 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.192637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:34.199382 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.199363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:34.207018 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.206996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p"
Aug 05 17:22:34.219649 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.219627    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zjzfb"
Aug 05 17:22:34.226236 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.226218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-clpgp"
Aug 05 17:22:34.590720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.590687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:34.590882 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.590729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:34.590882 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.590858    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:34.590956 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.590922    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:35.590907711 +0000 UTC m=+4.075831112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:34.590956 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.590859    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:34.591024 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.590991    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret podName:cd5bf156-7684-48e1-8c4e-29e6a7553a65 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:35.590980135 +0000 UTC m=+4.075903532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret") pod "global-pull-secret-syncer-mx8jq" (UID: "cd5bf156-7684-48e1-8c4e-29e6a7553a65") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:34.691381 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.691339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:34.691546 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.691526    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:22:34.691589 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.691548    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:22:34.691589 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.691560    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dhpv2 for pod openshift-network-diagnostics/network-check-target-4mqk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:34.691658 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:34.691617    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2 podName:8f22e48d-62bc-40aa-8264-544d75594eb1 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:35.691599919 +0000 UTC m=+4.176523316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dhpv2" (UniqueName: "kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2") pod "network-check-target-4mqk4" (UID: "8f22e48d-62bc-40aa-8264-544d75594eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:34.931325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.931231    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:17:33 +0000 UTC" deadline="2028-04-27 03:48:53.15501193 +0000 UTC"
Aug 05 17:22:34.931325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:34.931267    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15130h26m18.223748079s"
Aug 05 17:22:34.992496 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:34.992470    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93dbf120_6966_43e6_8e07_bd9e299c96a8.slice/crio-7ecb3d281f3b208830016b6f3119ac550dcae075b756a0048111301479d90da6 WatchSource:0}: Error finding container 7ecb3d281f3b208830016b6f3119ac550dcae075b756a0048111301479d90da6: Status 404 returned error can't find the container with id 7ecb3d281f3b208830016b6f3119ac550dcae075b756a0048111301479d90da6
Aug 05 17:22:34.994118 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:34.993731    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef39388_9130_48fb_a799_c965f7ae620e.slice/crio-caa105e2642c46d28f797047a4df0ee90f68244743eeaed1666020485c77dcef WatchSource:0}: Error finding container caa105e2642c46d28f797047a4df0ee90f68244743eeaed1666020485c77dcef: Status 404 returned error can't find the container with id caa105e2642c46d28f797047a4df0ee90f68244743eeaed1666020485c77dcef
Aug 05 17:22:34.994370 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:34.994344    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87ed6f7_6039_46de_806d_bd104381dd06.slice/crio-73fab56cfde7f9d193a0d7902c3f7e6726f34db56a9d0c10ffbd5fb54e58125e WatchSource:0}: Error finding container 73fab56cfde7f9d193a0d7902c3f7e6726f34db56a9d0c10ffbd5fb54e58125e: Status 404 returned error can't find the container with id 73fab56cfde7f9d193a0d7902c3f7e6726f34db56a9d0c10ffbd5fb54e58125e
Aug 05 17:22:34.995601 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:34.995580    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafff50be_fdca_4346_bacd_2036a29b48e4.slice/crio-6abce5530fd3109f12e27aa5cf9db34dc07626fbc8b885b53fbfa453b00c5f61 WatchSource:0}: Error finding container 6abce5530fd3109f12e27aa5cf9db34dc07626fbc8b885b53fbfa453b00c5f61: Status 404 returned error can't find the container with id 6abce5530fd3109f12e27aa5cf9db34dc07626fbc8b885b53fbfa453b00c5f61
Aug 05 17:22:34.997279 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:34.997251    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab1c18f_8c43_4c6d_8496_6544801668c0.slice/crio-f40f96d2cb6e82f24ffe7bf3077e6f74f494eb0ae9797f80bcd98784450fc68a WatchSource:0}: Error finding container f40f96d2cb6e82f24ffe7bf3077e6f74f494eb0ae9797f80bcd98784450fc68a: Status 404 returned error can't find the container with id f40f96d2cb6e82f24ffe7bf3077e6f74f494eb0ae9797f80bcd98784450fc68a
Aug 05 17:22:34.997968 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:34.997796    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0835e42_bf73_4bf5_8dbb_7819bd0d508f.slice/crio-f77c5a638d51698547dc9afb21e4f077e1c0eacb6b40626361d3a4a74e1aa4f7 WatchSource:0}: Error finding container f77c5a638d51698547dc9afb21e4f077e1c0eacb6b40626361d3a4a74e1aa4f7: Status 404 returned error can't find the container with id f77c5a638d51698547dc9afb21e4f077e1c0eacb6b40626361d3a4a74e1aa4f7
Aug 05 17:22:34.999928 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:34.999908    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd7a386_704c_4728_bf5b_bc4120a13633.slice/crio-3f9f7450a1ab85977b7b01e0fa6343324b937ac7c18fde5d35a445e8be31b44c WatchSource:0}: Error finding container 3f9f7450a1ab85977b7b01e0fa6343324b937ac7c18fde5d35a445e8be31b44c: Status 404 returned error can't find the container with id 3f9f7450a1ab85977b7b01e0fa6343324b937ac7c18fde5d35a445e8be31b44c
Aug 05 17:22:35.001942 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:35.001922    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ba3056_a844_4951_8a4a_ff51a4af3bd8.slice/crio-cfc2bada9061cd567b553408012fc01714d71c6ba19c8a9dfd3fa79c8db83c15 WatchSource:0}: Error finding container cfc2bada9061cd567b553408012fc01714d71c6ba19c8a9dfd3fa79c8db83c15: Status 404 returned error can't find the container with id cfc2bada9061cd567b553408012fc01714d71c6ba19c8a9dfd3fa79c8db83c15
Aug 05 17:22:35.003949 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:22:35.003932    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c611648_4128_4dfb_90e4_5c0cb368164a.slice/crio-f34999ee17b2d19c7a09be4b707cb2cc2c60c098c3f6a1cb2739cff981d3a015 WatchSource:0}: Error finding container f34999ee17b2d19c7a09be4b707cb2cc2c60c098c3f6a1cb2739cff981d3a015: Status 404 returned error can't find the container with id f34999ee17b2d19c7a09be4b707cb2cc2c60c098c3f6a1cb2739cff981d3a015
Aug 05 17:22:35.061421 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.061129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4pbhb" event={"ID":"3c611648-4128-4dfb-90e4-5c0cb368164a","Type":"ContainerStarted","Data":"f34999ee17b2d19c7a09be4b707cb2cc2c60c098c3f6a1cb2739cff981d3a015"}
Aug 05 17:22:35.062443 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.062421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zzmrz" event={"ID":"a0835e42-bf73-4bf5-8dbb-7819bd0d508f","Type":"ContainerStarted","Data":"f77c5a638d51698547dc9afb21e4f077e1c0eacb6b40626361d3a4a74e1aa4f7"}
Aug 05 17:22:35.063799 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.063765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vbwd" event={"ID":"aab1c18f-8c43-4c6d-8496-6544801668c0","Type":"ContainerStarted","Data":"f40f96d2cb6e82f24ffe7bf3077e6f74f494eb0ae9797f80bcd98784450fc68a"}
Aug 05 17:22:35.064898 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.064875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerStarted","Data":"73fab56cfde7f9d193a0d7902c3f7e6726f34db56a9d0c10ffbd5fb54e58125e"}
Aug 05 17:22:35.066065 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.066039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7wwbp" event={"ID":"93dbf120-6966-43e6-8e07-bd9e299c96a8","Type":"ContainerStarted","Data":"7ecb3d281f3b208830016b6f3119ac550dcae075b756a0048111301479d90da6"}
Aug 05 17:22:35.067108 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.067087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c2rb5" event={"ID":"71ba3056-a844-4951-8a4a-ff51a4af3bd8","Type":"ContainerStarted","Data":"cfc2bada9061cd567b553408012fc01714d71c6ba19c8a9dfd3fa79c8db83c15"}
Aug 05 17:22:35.068233 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.068213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"3f9f7450a1ab85977b7b01e0fa6343324b937ac7c18fde5d35a445e8be31b44c"}
Aug 05 17:22:35.069233 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.069205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p" event={"ID":"fef39388-9130-48fb-a799-c965f7ae620e","Type":"ContainerStarted","Data":"caa105e2642c46d28f797047a4df0ee90f68244743eeaed1666020485c77dcef"}
Aug 05 17:22:35.070241 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.070217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zjzfb" event={"ID":"afff50be-fdca-4346-bacd-2036a29b48e4","Type":"ContainerStarted","Data":"6abce5530fd3109f12e27aa5cf9db34dc07626fbc8b885b53fbfa453b00c5f61"}
Aug 05 17:22:35.597270 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.597182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:35.597270 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.597234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:35.597530 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.597392    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:35.597530 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.597451    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret podName:cd5bf156-7684-48e1-8c4e-29e6a7553a65 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:37.597434092 +0000 UTC m=+6.082357491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret") pod "global-pull-secret-syncer-mx8jq" (UID: "cd5bf156-7684-48e1-8c4e-29e6a7553a65") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:35.597881 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.597840    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:35.597989 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.597918    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:37.597901398 +0000 UTC m=+6.082824798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:35.702879 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.698251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:35.702879 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.698451    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:22:35.702879 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.698475    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:22:35.702879 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.698488    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dhpv2 for pod openshift-network-diagnostics/network-check-target-4mqk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:35.702879 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:35.698547    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2 podName:8f22e48d-62bc-40aa-8264-544d75594eb1 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:37.698529858 +0000 UTC m=+6.183453257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dhpv2" (UniqueName: "kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2") pod "network-check-target-4mqk4" (UID: "8f22e48d-62bc-40aa-8264-544d75594eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:35.932048 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.931952    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:17:33 +0000 UTC" deadline="2028-01-30 17:22:45.758939928 +0000 UTC"
Aug 05 17:22:35.932048 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:35.931999    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13032h0m9.82694671s"
Aug 05 17:22:36.056004 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:36.055975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:36.056191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:36.056111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:36.056191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:36.055986    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:36.056301 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:36.056227    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:36.056301 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:36.056109    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:36.056403 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:36.056318    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:36.088287 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:36.087496    2560 generic.go:356] "Generic (PLEG): container finished" podID="04f08173c011157a79eb69f3582fcd41" containerID="63661ecff50fd051be293d28e18947c71238642ac23147c34caad523b04c1806" exitCode=0
Aug 05 17:22:36.088287 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:36.087581    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal" event={"ID":"04f08173c011157a79eb69f3582fcd41","Type":"ContainerDied","Data":"63661ecff50fd051be293d28e18947c71238642ac23147c34caad523b04c1806"}
Aug 05 17:22:36.095323 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:36.095294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal" event={"ID":"35ce26a74ea51f8bcd5eeb415ccdf08c","Type":"ContainerStarted","Data":"5f1854033518d489444d87c5c43c32be74cdf6abb6d0b166fe0de2bfd80df50f"}
Aug 05 17:22:37.118392 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:37.118343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal" event={"ID":"04f08173c011157a79eb69f3582fcd41","Type":"ContainerStarted","Data":"f4584e0e998ccad5d0c9ef8d7a16ee349a16e66c6d560c843090f0f26c9a8323"}
Aug 05 17:22:37.134288 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:37.134228    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-196.ec2.internal" podStartSLOduration=5.134208169 podStartE2EDuration="5.134208169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:36.122264524 +0000 UTC m=+4.607187942" watchObservedRunningTime="2026-08-05 17:22:37.134208169 +0000 UTC m=+5.619131591"
Aug 05 17:22:37.615011 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:37.614345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:37.615011 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:37.614410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:37.615011 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.614510    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:37.615011 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.614558    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:41.614543999 +0000 UTC m=+10.099467396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:37.615011 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.614893    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:37.615011 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.614928    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret podName:cd5bf156-7684-48e1-8c4e-29e6a7553a65 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:41.614918088 +0000 UTC m=+10.099841485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret") pod "global-pull-secret-syncer-mx8jq" (UID: "cd5bf156-7684-48e1-8c4e-29e6a7553a65") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:37.715834 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:37.715257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:37.715834 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.715438    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:22:37.715834 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.715457    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:22:37.715834 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.715472    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dhpv2 for pod openshift-network-diagnostics/network-check-target-4mqk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:37.715834 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:37.715558    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2 podName:8f22e48d-62bc-40aa-8264-544d75594eb1 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:41.715538365 +0000 UTC m=+10.200461766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dhpv2" (UniqueName: "kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2") pod "network-check-target-4mqk4" (UID: "8f22e48d-62bc-40aa-8264-544d75594eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:38.054325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:38.054244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:38.054484 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:38.054249    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:38.054484 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:38.054377    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:38.054484 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:38.054399    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:38.054634 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:38.054500    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:38.054634 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:38.054589    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:40.054967 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:40.054932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:40.054967 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:40.054948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:40.055454 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:40.055062    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:40.055532 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:40.055457    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:40.055532 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:40.055514    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:40.055629 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:40.055602    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:41.648289 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:41.648249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:41.648289 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:41.648295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:41.648744 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.648415    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:41.648744 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.648472    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret podName:cd5bf156-7684-48e1-8c4e-29e6a7553a65 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:49.648459872 +0000 UTC m=+18.133383269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret") pod "global-pull-secret-syncer-mx8jq" (UID: "cd5bf156-7684-48e1-8c4e-29e6a7553a65") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:41.648881 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.648838    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:41.648968 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.648907    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:49.648892572 +0000 UTC m=+18.133815971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:41.749478 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:41.749435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:41.749688 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.749637    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:22:41.749688 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.749659    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:22:41.749688 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.749672    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dhpv2 for pod openshift-network-diagnostics/network-check-target-4mqk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:41.749870 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:41.749737    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2 podName:8f22e48d-62bc-40aa-8264-544d75594eb1 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:49.749716918 +0000 UTC m=+18.234640334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dhpv2" (UniqueName: "kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2") pod "network-check-target-4mqk4" (UID: "8f22e48d-62bc-40aa-8264-544d75594eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:42.055405 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:42.055329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:42.055566 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:42.055439    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:42.056104 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:42.055819    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:42.056104 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:42.055942    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:42.056104 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:42.056000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:42.056104 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:42.056067    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:44.054990 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:44.054958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:44.054990 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:44.054976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:44.055495 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:44.054958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:44.055495 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:44.055093    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:44.055495 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:44.055207    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:44.055495 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:44.055313    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:46.053811 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:46.053774    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:46.054288 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:46.053782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:46.054288 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:46.053918    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:46.054288 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:46.053954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:46.054458 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:46.054299    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:46.054458 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:46.054373    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:48.054115 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:48.054076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:48.054585 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:48.054076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:48.054585 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:48.054206    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:48.054585 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:48.054233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:48.054585 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:48.054311    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:48.054585 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:48.054403    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:49.709281 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:49.709237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:49.709281 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:49.709281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:49.709758 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.709413    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:49.709758 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.709419    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:49.709758 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.709469    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret podName:cd5bf156-7684-48e1-8c4e-29e6a7553a65 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:05.709453692 +0000 UTC m=+34.194377089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret") pod "global-pull-secret-syncer-mx8jq" (UID: "cd5bf156-7684-48e1-8c4e-29e6a7553a65") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:22:49.709758 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.709494    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:05.709474449 +0000 UTC m=+34.194397865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:22:49.809687 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:49.809651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:49.809893 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.809862    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:22:49.809893 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.809890    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:22:49.810012 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.809904    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dhpv2 for pod openshift-network-diagnostics/network-check-target-4mqk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:49.810012 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:49.809973    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2 podName:8f22e48d-62bc-40aa-8264-544d75594eb1 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:05.809952297 +0000 UTC m=+34.294875697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dhpv2" (UniqueName: "kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2") pod "network-check-target-4mqk4" (UID: "8f22e48d-62bc-40aa-8264-544d75594eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:22:50.054556 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:50.054522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:50.054556 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:50.054549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:50.054796 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:50.054522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:50.054796 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:50.054651    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:50.054796 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:50.054727    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:50.054947 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:50.054807    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:52.054945 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:52.054910    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:52.055403 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:52.055015    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:52.055403 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:52.055025    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:52.055403 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:52.055130    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:52.055403 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:52.055179    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:52.055403 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:52.055251    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:54.054166 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.053860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:54.054769 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.053863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:54.054769 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:54.054258    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:54.054769 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.053863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:54.054769 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:54.054325    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:54.054769 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:54.054371    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:54.153856 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.153812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"7cef1cc4ed618e6d76a389e521f74af5559a19ca3bc86951b9631b250ec2b817"}
Aug 05 17:22:54.153982 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.153919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"3319725a933fabe1fe600c883a55e151c4a18e0de5063e3b5a47a4005f6c2fe0"}
Aug 05 17:22:54.153982 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.153966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"cd541e3c51f99436cc9ec84a5e6dd590bf17d64a4d874b33c1a38349d8a4be53"}
Aug 05 17:22:54.155286 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.155263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p" event={"ID":"fef39388-9130-48fb-a799-c965f7ae620e","Type":"ContainerStarted","Data":"16e7bf0570cecd87a52687c964d5423632e21983b3e0f13517a6d53c394a33f9"}
Aug 05 17:22:54.156598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.156574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zjzfb" event={"ID":"afff50be-fdca-4346-bacd-2036a29b48e4","Type":"ContainerStarted","Data":"c0ede9e47e3ac59f81065ce142cb7d7d2405adaab7d0e5d1081a0c5e9d0053a9"}
Aug 05 17:22:54.157905 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.157880    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4pbhb" event={"ID":"3c611648-4128-4dfb-90e4-5c0cb368164a","Type":"ContainerStarted","Data":"04342ef5662e310a42dddcdbd9728a3f79c25daeb4e6c9ebe5b26eb4fd3e8c50"}
Aug 05 17:22:54.159296 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.159275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zzmrz" event={"ID":"a0835e42-bf73-4bf5-8dbb-7819bd0d508f","Type":"ContainerStarted","Data":"36c7d121cf984a835c9513888be8182664c471cb005913b1a66fb8b39bf78eef"}
Aug 05 17:22:54.160547 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.160523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vbwd" event={"ID":"aab1c18f-8c43-4c6d-8496-6544801668c0","Type":"ContainerStarted","Data":"183a00b11894852a0d8fe3fc4c012c6b84cdc4d893a26f37b093741087f2f096"}
Aug 05 17:22:54.161831 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.161811    2560 generic.go:356] "Generic (PLEG): container finished" podID="d87ed6f7-6039-46de-806d-bd104381dd06" containerID="fbd700c9e4a23441cc239c25765e7e5a225d9875efae6f5f2d41f63ce1e97611" exitCode=0
Aug 05 17:22:54.161936 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.161874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerDied","Data":"fbd700c9e4a23441cc239c25765e7e5a225d9875efae6f5f2d41f63ce1e97611"}
Aug 05 17:22:54.163318 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.163301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c2rb5" event={"ID":"71ba3056-a844-4951-8a4a-ff51a4af3bd8","Type":"ContainerStarted","Data":"c53df60c7ed9260beecc3fc7018edbd09a3cd8b80396fb42c81db38d539e3da5"}
Aug 05 17:22:54.174243 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.174204    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-196.ec2.internal" podStartSLOduration=22.174191145 podStartE2EDuration="22.174191145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:37.135475637 +0000 UTC m=+5.620399058" watchObservedRunningTime="2026-08-05 17:22:54.174191145 +0000 UTC m=+22.659114563"
Aug 05 17:22:54.174752 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.174720    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zjzfb" podStartSLOduration=3.446678679 podStartE2EDuration="22.174710776s" totalImagesPullingTime="18.728032097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:54.173898562 +0000 UTC m=+22.658821980" watchObservedRunningTime="2026-08-05 17:22:54.174710776 +0000 UTC m=+22.659634194"
Aug 05 17:22:54.195645 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.195595    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4pbhb" podStartSLOduration=3.41982302 podStartE2EDuration="22.195578261s" totalImagesPullingTime="18.775755241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:54.19537411 +0000 UTC m=+22.680297529" watchObservedRunningTime="2026-08-05 17:22:54.195578261 +0000 UTC m=+22.680501685"
Aug 05 17:22:54.210212 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.210171    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c2rb5" podStartSLOduration=7.612925519 podStartE2EDuration="22.21015803s" totalImagesPullingTime="14.597232511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:54.209891127 +0000 UTC m=+22.694814546" watchObservedRunningTime="2026-08-05 17:22:54.21015803 +0000 UTC m=+22.695081449"
Aug 05 17:22:54.258511 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.258473    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2vbwd" podStartSLOduration=3.5306633659999997 podStartE2EDuration="22.258458343s" totalImagesPullingTime="18.727794977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:54.258288777 +0000 UTC m=+22.743212196" watchObservedRunningTime="2026-08-05 17:22:54.258458343 +0000 UTC m=+22.743381761"
Aug 05 17:22:54.339625 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.339587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:54.423812 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:54.423780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:55.171286 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:55.171254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"9a0d121d36c921b853e6d0a67af24b20d9f5acd7cc55ef44d8a127f3fb36765f"}
Aug 05 17:22:55.171703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:55.171361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"09345576f61a96e3c34a859f06c2e21873382301270c8d16a32006259d386c8b"}
Aug 05 17:22:55.171703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:55.171415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"6d91724499a246cc4cdb9d740c95e51f4c6c10bb9114dfbfd4f8dd62a534634f"}
Aug 05 17:22:55.372887 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:55.372822    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 17:22:55.952061 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:55.951939    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T17:22:55.3728699Z","UUID":"b262ea91-59b1-44d5-aaa4-2f2e05593e86","Handler":null,"Name":"","Endpoint":""}
Aug 05 17:22:55.954449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:55.954355    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 17:22:55.954449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:55.954402    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 17:22:56.054320 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.054288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:56.054502 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.054288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:56.054502 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:56.054417    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:56.054502 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.054438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:56.054665 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:56.054551    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:56.054665 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:56.054638    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:56.175557 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.175515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7wwbp" event={"ID":"93dbf120-6966-43e6-8e07-bd9e299c96a8","Type":"ContainerStarted","Data":"b49f73f81da016c28f6dff2da618d90c1a8e72cbfe6b44a4d89d284f00e00ebb"}
Aug 05 17:22:56.178108 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.178074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p" event={"ID":"fef39388-9130-48fb-a799-c965f7ae620e","Type":"ContainerStarted","Data":"cc71d9638b209cedf63e0ba4f6a903aa97b7b80ca015a007c21188d000c7b61f"}
Aug 05 17:22:56.191964 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.191908    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zzmrz" podStartSLOduration=5.466182199 podStartE2EDuration="24.191887561s" totalImagesPullingTime="18.725705362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:54.280592672 +0000 UTC m=+22.765516100" watchObservedRunningTime="2026-08-05 17:22:56.191887561 +0000 UTC m=+24.676810982"
Aug 05 17:22:56.192212 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.192185    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7wwbp" podStartSLOduration=5.460171746 podStartE2EDuration="24.192176032s" totalImagesPullingTime="18.732004286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:56.191824864 +0000 UTC m=+24.676748285" watchObservedRunningTime="2026-08-05 17:22:56.192176032 +0000 UTC m=+24.677099451"
Aug 05 17:22:56.312819 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.312720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:56.388451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:56.388375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:57.184071 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:57.184033    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"a1d2f0a4e76a0d31ddc5303d50e7722f01581dc5f926f5f6d11e484f1f4415be"}
Aug 05 17:22:57.186231 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:57.186204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p" event={"ID":"fef39388-9130-48fb-a799-c965f7ae620e","Type":"ContainerStarted","Data":"1b201e76434645c7274870665852247fbed96cc695fd4203cc1bc97612266a8c"}
Aug 05 17:22:57.205310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:57.205262    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzb9p" podStartSLOduration=3.9944490200000002 podStartE2EDuration="25.205247344s" totalImagesPullingTime="21.210798324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:57.204576626 +0000 UTC m=+25.689500045" watchObservedRunningTime="2026-08-05 17:22:57.205247344 +0000 UTC m=+25.690170762"
Aug 05 17:22:57.716314 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:57.716109    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:57.716776 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:57.716742    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:57.938585 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:57.938549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:58.054196 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:58.054116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:22:58.054196 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:58.054148    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:22:58.054390 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:58.054116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:22:58.054390 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:58.054249    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:22:58.054390 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:58.054358    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:22:58.054515 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:22:58.054425    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:22:58.199478 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:58.199432    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:58.200034 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:58.199787    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c2rb5"
Aug 05 17:22:59.039624 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.039355    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:59.203145 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.203116    2560 generic.go:356] "Generic (PLEG): container finished" podID="d87ed6f7-6039-46de-806d-bd104381dd06" containerID="1ab0f9c8b80b957a6e18ff2123684a4db783f0b6766c8ac7cac091854448122b" exitCode=0
Aug 05 17:22:59.203812 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.203194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerDied","Data":"1ab0f9c8b80b957a6e18ff2123684a4db783f0b6766c8ac7cac091854448122b"}
Aug 05 17:22:59.206819 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.206792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" event={"ID":"3fd7a386-704c-4728-bf5b-bc4120a13633","Type":"ContainerStarted","Data":"ef6cc230e8bf21c33532b1bd9d1d029bbb33e0a49718f6313a5f1adbd9b6d593"}
Aug 05 17:22:59.207112 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.207092    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:59.207195 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.207171    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:59.223979 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.223957    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:22:59.251511 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:22:59.251461    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd" podStartSLOduration=8.464896765 podStartE2EDuration="27.251446277s" totalImagesPullingTime="18.786549512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:59.250335934 +0000 UTC m=+27.735259352" watchObservedRunningTime="2026-08-05 17:22:59.251446277 +0000 UTC m=+27.736369695"
Aug 05 17:23:00.054287 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.054208    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:00.054462 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:00.054315    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:23:00.054462 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.054215    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:00.054462 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.054340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:00.054462 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:00.054394    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:23:00.054665 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:00.054482    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:23:00.210415 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.210313    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:23:00.225310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.225286    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:23:00.752892 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.752832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mqk4"]
Aug 05 17:23:00.753079 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.753036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:00.753172 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:00.753153    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:23:00.755435 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.755409    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mx8jq"]
Aug 05 17:23:00.755578 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.755501    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:00.755635 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:00.755577    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:23:00.756080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.756061    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l4hvb"]
Aug 05 17:23:00.756181 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:00.756168    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:00.756286 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:00.756263    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:23:01.214167 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:01.214139    2560 generic.go:356] "Generic (PLEG): container finished" podID="d87ed6f7-6039-46de-806d-bd104381dd06" containerID="9880e141b81f17f8823eaec2c1987a4da4390383647d6d58fe174dd1e2fbe594" exitCode=0
Aug 05 17:23:01.214558 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:01.214220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerDied","Data":"9880e141b81f17f8823eaec2c1987a4da4390383647d6d58fe174dd1e2fbe594"}
Aug 05 17:23:02.054676 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:02.054490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:02.054857 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:02.054556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:02.054857 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:02.054747    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:23:02.054857 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:02.054825    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:23:03.054143 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:03.054064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:03.054568 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:03.054173    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:23:03.221625 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:03.221592    2560 generic.go:356] "Generic (PLEG): container finished" podID="d87ed6f7-6039-46de-806d-bd104381dd06" containerID="336ff4ce283fd143c4e4fe7542b4a436aef62e020dc2d96b1e15e763e35d9ee6" exitCode=0
Aug 05 17:23:03.221762 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:03.221642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerDied","Data":"336ff4ce283fd143c4e4fe7542b4a436aef62e020dc2d96b1e15e763e35d9ee6"}
Aug 05 17:23:03.305216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:03.305139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:03.408910 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:03.408836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:04.054811 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:04.054775    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:04.055496 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:04.054938    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:23:04.055496 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:04.054988    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:04.055496 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:04.055128    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:23:04.339347 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:04.339241    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:04.412923 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:04.412877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:05.054710 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:05.054683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:05.054896 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.054794    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:23:05.728703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:05.728651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:05.728703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:05.728701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:05.728972 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.728832    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:23:05.728972 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.728834    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:23:05.728972 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.728922    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:37.728902043 +0000 UTC m=+66.213825445 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:23:05.728972 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.728942    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret podName:cd5bf156-7684-48e1-8c4e-29e6a7553a65 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:37.728932083 +0000 UTC m=+66.213855481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret") pod "global-pull-secret-syncer-mx8jq" (UID: "cd5bf156-7684-48e1-8c4e-29e6a7553a65") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:23:05.829827 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:05.829736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:05.829982 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.829918    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:23:05.829982 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.829947    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:23:05.829982 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.829959    2560 projected.go:196] Error preparing data for projected volume kube-api-access-dhpv2 for pod openshift-network-diagnostics/network-check-target-4mqk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:23:05.830146 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:05.830022    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2 podName:8f22e48d-62bc-40aa-8264-544d75594eb1 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:37.830004375 +0000 UTC m=+66.314927785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dhpv2" (UniqueName: "kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2") pod "network-check-target-4mqk4" (UID: "8f22e48d-62bc-40aa-8264-544d75594eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:23:06.053903 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:06.053860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:06.054076 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:06.054012    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mx8jq" podUID="cd5bf156-7684-48e1-8c4e-29e6a7553a65"
Aug 05 17:23:06.054160 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:06.054066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:06.054215 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:06.054175    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mqk4" podUID="8f22e48d-62bc-40aa-8264-544d75594eb1"
Aug 05 17:23:07.054464 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.054428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:07.055055 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:07.054563    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4hvb" podUID="ac55c236-fd48-44d8-b275-1cda967ca5b2"
Aug 05 17:23:07.316277 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.316255    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-196.ec2.internal" event="NodeReady"
Aug 05 17:23:07.316429 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.316417    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 17:23:07.360433 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.360400    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p6dvk"]
Aug 05 17:23:07.362461 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.362441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.363459 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.363437    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zgzk2"]
Aug 05 17:23:07.364890 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.364869    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 17:23:07.365005 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.364922    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hv8kx\""
Aug 05 17:23:07.365005 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.364930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 17:23:07.365093 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.365064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.367575 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.367557    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 17:23:07.367679 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.367593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bkmmp\""
Aug 05 17:23:07.367910 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.367896    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 17:23:07.367976 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.367917    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 17:23:07.376806 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.376349    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p6dvk"]
Aug 05 17:23:07.376806 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.376794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zgzk2"]
Aug 05 17:23:07.449301 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.449272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19e14f0f-27a2-429c-ad0a-79f7da761469-cert\") pod \"ingress-canary-zgzk2\" (UID: \"19e14f0f-27a2-429c-ad0a-79f7da761469\") " pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.449440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.449308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-config-volume\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.449440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.449416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-tmp-dir\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.449440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.449438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqvd\" (UniqueName: \"kubernetes.io/projected/19e14f0f-27a2-429c-ad0a-79f7da761469-kube-api-access-ndqvd\") pod \"ingress-canary-zgzk2\" (UID: \"19e14f0f-27a2-429c-ad0a-79f7da761469\") " pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.449568 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.449456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjnl\" (UniqueName: \"kubernetes.io/projected/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-kube-api-access-xjjnl\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.449568 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.449475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.504627 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.504596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:07.550496 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.550465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-config-volume\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.550592 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.550546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-tmp-dir\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.550592 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.550568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqvd\" (UniqueName: \"kubernetes.io/projected/19e14f0f-27a2-429c-ad0a-79f7da761469-kube-api-access-ndqvd\") pod \"ingress-canary-zgzk2\" (UID: \"19e14f0f-27a2-429c-ad0a-79f7da761469\") " pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.550592 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.550585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjnl\" (UniqueName: \"kubernetes.io/projected/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-kube-api-access-xjjnl\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.550721 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.550606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.550721 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.550627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19e14f0f-27a2-429c-ad0a-79f7da761469-cert\") pod \"ingress-canary-zgzk2\" (UID: \"19e14f0f-27a2-429c-ad0a-79f7da761469\") " pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.550817 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:07.550749    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:23:07.550905 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:07.550832    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls podName:81125c9f-7d7c-4f1a-833f-5d7c4e00f09e nodeName:}" failed. No retries permitted until 2026-08-05 17:23:08.050806589 +0000 UTC m=+36.535729986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls") pod "dns-default-p6dvk" (UID: "81125c9f-7d7c-4f1a-833f-5d7c4e00f09e") : secret "dns-default-metrics-tls" not found
Aug 05 17:23:07.550967 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.550945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-tmp-dir\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.551197 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.551172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-config-volume\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.554948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.554923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19e14f0f-27a2-429c-ad0a-79f7da761469-cert\") pod \"ingress-canary-zgzk2\" (UID: \"19e14f0f-27a2-429c-ad0a-79f7da761469\") " pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.561050 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.561000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjnl\" (UniqueName: \"kubernetes.io/projected/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-kube-api-access-xjjnl\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:07.561332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.561316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqvd\" (UniqueName: \"kubernetes.io/projected/19e14f0f-27a2-429c-ad0a-79f7da761469-kube-api-access-ndqvd\") pod \"ingress-canary-zgzk2\" (UID: \"19e14f0f-27a2-429c-ad0a-79f7da761469\") " pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.606157 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.606115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:07.679918 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.679881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zgzk2"
Aug 05 17:23:07.816530 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:07.816302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zgzk2"]
Aug 05 17:23:07.820993 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:23:07.820967    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e14f0f_27a2_429c_ad0a_79f7da761469.slice/crio-72b4e612305ee25ea13670ae68ad36a724245f1040707c3029c1488a0e8a1782 WatchSource:0}: Error finding container 72b4e612305ee25ea13670ae68ad36a724245f1040707c3029c1488a0e8a1782: Status 404 returned error can't find the container with id 72b4e612305ee25ea13670ae68ad36a724245f1040707c3029c1488a0e8a1782
Aug 05 17:23:08.054280 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.054236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:08.054280 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.054266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:08.054942 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.054914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:08.055328 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:08.055029    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:23:08.055328 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:08.055091    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls podName:81125c9f-7d7c-4f1a-833f-5d7c4e00f09e nodeName:}" failed. No retries permitted until 2026-08-05 17:23:09.055077558 +0000 UTC m=+37.540000955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls") pod "dns-default-p6dvk" (UID: "81125c9f-7d7c-4f1a-833f-5d7c4e00f09e") : secret "dns-default-metrics-tls" not found
Aug 05 17:23:08.056834 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.056802    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 17:23:08.056834 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.056804    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 17:23:08.057026 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.056875    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8p6dg\""
Aug 05 17:23:08.058158 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.058134    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 17:23:08.236564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.236521    2560 generic.go:356] "Generic (PLEG): container finished" podID="d87ed6f7-6039-46de-806d-bd104381dd06" containerID="8011ae53f6e3a44605bf92066c910965f21e890752506ed961ad85c5e7c530c2" exitCode=0
Aug 05 17:23:08.236745 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.236624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerDied","Data":"8011ae53f6e3a44605bf92066c910965f21e890752506ed961ad85c5e7c530c2"}
Aug 05 17:23:08.238217 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:08.238163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zgzk2" event={"ID":"19e14f0f-27a2-429c-ad0a-79f7da761469","Type":"ContainerStarted","Data":"72b4e612305ee25ea13670ae68ad36a724245f1040707c3029c1488a0e8a1782"}
Aug 05 17:23:09.054436 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:09.054405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:09.056861 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:09.056823    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l8xxn\""
Aug 05 17:23:09.057247 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:09.056832    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 17:23:09.064579 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:09.064553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:09.064719 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:09.064702    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:23:09.064788 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:09.064759    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls podName:81125c9f-7d7c-4f1a-833f-5d7c4e00f09e nodeName:}" failed. No retries permitted until 2026-08-05 17:23:11.064744071 +0000 UTC m=+39.549667471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls") pod "dns-default-p6dvk" (UID: "81125c9f-7d7c-4f1a-833f-5d7c4e00f09e") : secret "dns-default-metrics-tls" not found
Aug 05 17:23:09.244071 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:09.244037    2560 generic.go:356] "Generic (PLEG): container finished" podID="d87ed6f7-6039-46de-806d-bd104381dd06" containerID="99d39ce8abd05cf664f3793ecd6a3936b19f6a546bcd9a0fb1af388cc85c3118" exitCode=0
Aug 05 17:23:09.244231 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:09.244103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerDied","Data":"99d39ce8abd05cf664f3793ecd6a3936b19f6a546bcd9a0fb1af388cc85c3118"}
Aug 05 17:23:10.249573 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:10.249401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clpgp" event={"ID":"d87ed6f7-6039-46de-806d-bd104381dd06","Type":"ContainerStarted","Data":"8f866398d5b19f8cd1e53735356bc57e199c7d9d9f5e8b58e0f1abb4d6ce2ccc"}
Aug 05 17:23:10.283216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:10.283163    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-clpgp" podStartSLOduration=8.821426362 podStartE2EDuration="38.283147031s" totalImagesPullingTime="29.461720669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:10.281915601 +0000 UTC m=+38.766839020" watchObservedRunningTime="2026-08-05 17:23:10.283147031 +0000 UTC m=+38.768070427"
Aug 05 17:23:10.406791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:10.406750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:10.468677 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:10.468640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:11.080698 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:11.080654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:11.080885 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:11.080840    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:23:11.080939 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:11.080928    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls podName:81125c9f-7d7c-4f1a-833f-5d7c4e00f09e nodeName:}" failed. No retries permitted until 2026-08-05 17:23:15.080911388 +0000 UTC m=+43.565834785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls") pod "dns-default-p6dvk" (UID: "81125c9f-7d7c-4f1a-833f-5d7c4e00f09e") : secret "dns-default-metrics-tls" not found
Aug 05 17:23:11.169250 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:11.169213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:11.231508 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:11.231467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:11.253527 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:11.253491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zgzk2" event={"ID":"19e14f0f-27a2-429c-ad0a-79f7da761469","Type":"ContainerStarted","Data":"a44395cecc74f8682e322384d64f4d9e8ea70d3b05b65e52a6e8fe567d9f3306"}
Aug 05 17:23:11.270344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:11.270296    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zgzk2" podStartSLOduration=1.857979439 podStartE2EDuration="4.270279801s" totalImagesPullingTime="2.412300362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:11.269548835 +0000 UTC m=+39.754472271" watchObservedRunningTime="2026-08-05 17:23:11.270279801 +0000 UTC m=+39.755203214"
Aug 05 17:23:15.108450 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:15.108412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:15.108839 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:15.108536    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:23:15.108839 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:15.108588    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls podName:81125c9f-7d7c-4f1a-833f-5d7c4e00f09e nodeName:}" failed. No retries permitted until 2026-08-05 17:23:23.108575662 +0000 UTC m=+51.593499059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls") pod "dns-default-p6dvk" (UID: "81125c9f-7d7c-4f1a-833f-5d7c4e00f09e") : secret "dns-default-metrics-tls" not found
Aug 05 17:23:16.472300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:16.472261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:16.534987 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:16.534953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:23.169159 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:23.169106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:23.169579 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:23.169257    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:23:23.169579 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:23.169334    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls podName:81125c9f-7d7c-4f1a-833f-5d7c4e00f09e nodeName:}" failed. No retries permitted until 2026-08-05 17:23:39.169316876 +0000 UTC m=+67.654240272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls") pod "dns-default-p6dvk" (UID: "81125c9f-7d7c-4f1a-833f-5d7c4e00f09e") : secret "dns-default-metrics-tls" not found
Aug 05 17:23:24.306264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:24.306219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:24.367974 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:24.367941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:32.227591 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:32.227563    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77jpd"
Aug 05 17:23:32.398162 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:32.398127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:32.464450 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:32.464417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:32.530101 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:32.530024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:33.929457 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.929422    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"]
Aug 05 17:23:33.932465 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.932433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:33.933138 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.933113    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6995c87859-bq2ht"]
Aug 05 17:23:33.934729 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.934711    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qsxxs\""
Aug 05 17:23:33.934823 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.934812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.934993 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.934968    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 05 17:23:33.935255 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.935236    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 05 17:23:33.935632 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.935616    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:23:33.937180 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.937168    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4cfrs\""
Aug 05 17:23:33.937238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.937198    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 17:23:33.938774 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.938752    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 17:23:33.938975 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.938941    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 17:23:33.942931 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.942912    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"]
Aug 05 17:23:33.945350 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.945332    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 17:23:33.946090 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjnn\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-kube-api-access-bxjnn\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.946202 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-certificates\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.946202 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-bound-sa-token\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.946332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-installation-pull-secrets\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.946332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-image-registry-private-configuration\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.946332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946295    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:33.946332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvvv\" (UniqueName: \"kubernetes.io/projected/fe763e6c-e0cd-4595-9952-3db5b2478017-kube-api-access-spvvv\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:33.946544 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.946544 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-trusted-ca\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.946544 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.946499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-ca-trust-extracted\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:33.950359 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:33.950340    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6995c87859-bq2ht"]
Aug 05 17:23:34.038037 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.038003    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"]
Aug 05 17:23:34.039897 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.039882    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"
Aug 05 17:23:34.042490 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.042463    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:23:34.042634 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.042621    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 05 17:23:34.042736 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.042719    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-w4kdk\""
Aug 05 17:23:34.047611 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjnn\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-kube-api-access-bxjnn\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.047720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-certificates\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.047720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-bound-sa-token\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.047720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-installation-pull-secrets\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.047901 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-image-registry-private-configuration\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.047901 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:34.047901 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvvv\" (UniqueName: \"kubernetes.io/projected/fe763e6c-e0cd-4595-9952-3db5b2478017-kube-api-access-spvvv\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:34.048050 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.048050 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.047940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-trusted-ca\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.048050 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.047993    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:23:34.048204 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.048055    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls podName:fe763e6c-e0cd-4595-9952-3db5b2478017 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:34.548037235 +0000 UTC m=+63.032960737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-sc8tq" (UID: "fe763e6c-e0cd-4595-9952-3db5b2478017") : secret "samples-operator-tls" not found
Aug 05 17:23:34.048204 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.048056    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:23:34.048204 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.048074    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6995c87859-bq2ht: secret "image-registry-tls" not found
Aug 05 17:23:34.048204 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.048107    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls podName:82156fa3-0a73-4c8c-a138-b5a00a0a95d4 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:34.548095201 +0000 UTC m=+63.033018611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls") pod "image-registry-6995c87859-bq2ht" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4") : secret "image-registry-tls" not found
Aug 05 17:23:34.048204 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.048082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-ca-trust-extracted\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.048421 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.048304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-certificates\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.048454 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.048435    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-ca-trust-extracted\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.048745 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.048729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-trusted-ca\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.051691 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.051663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-installation-pull-secrets\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.051776 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.051720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-image-registry-private-configuration\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.057492 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.057472    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"]
Aug 05 17:23:34.060535 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.060506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-bound-sa-token\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.063383 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.063358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvvv\" (UniqueName: \"kubernetes.io/projected/fe763e6c-e0cd-4595-9952-3db5b2478017-kube-api-access-spvvv\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:34.066313 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.066294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjnn\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-kube-api-access-bxjnn\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.102862 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.102824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:34.148541 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.148508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xxtz\" (UniqueName: \"kubernetes.io/projected/1e5aa9b2-37a3-40f5-825e-37250749fa26-kube-api-access-7xxtz\") pod \"volume-data-source-validator-5b8776669-r9252\" (UID: \"1e5aa9b2-37a3-40f5-825e-37250749fa26\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"
Aug 05 17:23:34.205416 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.205337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:34.249742 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.249713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xxtz\" (UniqueName: \"kubernetes.io/projected/1e5aa9b2-37a3-40f5-825e-37250749fa26-kube-api-access-7xxtz\") pod \"volume-data-source-validator-5b8776669-r9252\" (UID: \"1e5aa9b2-37a3-40f5-825e-37250749fa26\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"
Aug 05 17:23:34.257406 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.257383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xxtz\" (UniqueName: \"kubernetes.io/projected/1e5aa9b2-37a3-40f5-825e-37250749fa26-kube-api-access-7xxtz\") pod \"volume-data-source-validator-5b8776669-r9252\" (UID: \"1e5aa9b2-37a3-40f5-825e-37250749fa26\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"
Aug 05 17:23:34.348239 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.348214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"
Aug 05 17:23:34.471839 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.471732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252"]
Aug 05 17:23:34.475658 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:23:34.475623    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5aa9b2_37a3_40f5_825e_37250749fa26.slice/crio-afde219452d50670b010d807db184a31ed5cc2eeb81c2b324449076dec71c9e8 WatchSource:0}: Error finding container afde219452d50670b010d807db184a31ed5cc2eeb81c2b324449076dec71c9e8: Status 404 returned error can't find the container with id afde219452d50670b010d807db184a31ed5cc2eeb81c2b324449076dec71c9e8
Aug 05 17:23:34.552439 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.552401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:34.552594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:34.552455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:34.552594 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.552545    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:23:34.552707 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.552596    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:23:34.552707 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.552611    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6995c87859-bq2ht: secret "image-registry-tls" not found
Aug 05 17:23:34.552707 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.552613    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls podName:fe763e6c-e0cd-4595-9952-3db5b2478017 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:35.552597378 +0000 UTC m=+64.037520774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-sc8tq" (UID: "fe763e6c-e0cd-4595-9952-3db5b2478017") : secret "samples-operator-tls" not found
Aug 05 17:23:34.552707 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:34.552668    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls podName:82156fa3-0a73-4c8c-a138-b5a00a0a95d4 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:35.552652693 +0000 UTC m=+64.037576094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls") pod "image-registry-6995c87859-bq2ht" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4") : secret "image-registry-tls" not found
Aug 05 17:23:35.309320 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:35.309274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252" event={"ID":"1e5aa9b2-37a3-40f5-825e-37250749fa26","Type":"ContainerStarted","Data":"afde219452d50670b010d807db184a31ed5cc2eeb81c2b324449076dec71c9e8"}
Aug 05 17:23:35.560261 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:35.560178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:35.560261 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:35.560230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:35.560458 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:35.560351    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:23:35.560458 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:35.560423    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls podName:fe763e6c-e0cd-4595-9952-3db5b2478017 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:37.560405278 +0000 UTC m=+66.045328694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-sc8tq" (UID: "fe763e6c-e0cd-4595-9952-3db5b2478017") : secret "samples-operator-tls" not found
Aug 05 17:23:35.560553 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:35.560459    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:23:35.560553 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:35.560483    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6995c87859-bq2ht: secret "image-registry-tls" not found
Aug 05 17:23:35.560553 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:35.560546    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls podName:82156fa3-0a73-4c8c-a138-b5a00a0a95d4 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:37.560526509 +0000 UTC m=+66.045449909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls") pod "image-registry-6995c87859-bq2ht" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4") : secret "image-registry-tls" not found
Aug 05 17:23:36.312860 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:36.312813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252" event={"ID":"1e5aa9b2-37a3-40f5-825e-37250749fa26","Type":"ContainerStarted","Data":"e360f30b2d021d9e3a4d7a80d333e6ab5e3e4d8829730f1c1aeb22415a2b3491"}
Aug 05 17:23:36.327810 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:36.327762    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-r9252" podStartSLOduration=1.019255793 podStartE2EDuration="2.32774567s" totalImagesPullingTime="1.308489877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:36.327407586 +0000 UTC m=+64.812331005" watchObservedRunningTime="2026-08-05 17:23:36.32774567 +0000 UTC m=+64.812669089"
Aug 05 17:23:36.414763 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:36.414732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:37.577688 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.577650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:37.578106 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.577734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:37.578106 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:37.577813    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:23:37.578106 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:37.577837    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6995c87859-bq2ht: secret "image-registry-tls" not found
Aug 05 17:23:37.578106 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:37.577817    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:23:37.578106 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:37.577917    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls podName:fe763e6c-e0cd-4595-9952-3db5b2478017 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:41.577903464 +0000 UTC m=+70.062826861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-sc8tq" (UID: "fe763e6c-e0cd-4595-9952-3db5b2478017") : secret "samples-operator-tls" not found
Aug 05 17:23:37.578106 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:37.577931    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls podName:82156fa3-0a73-4c8c-a138-b5a00a0a95d4 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:41.577924602 +0000 UTC m=+70.062847999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls") pod "image-registry-6995c87859-bq2ht" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4") : secret "image-registry-tls" not found
Aug 05 17:23:37.779535 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.779501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:23:37.779535 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.779538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:37.782433 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.782415    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 17:23:37.782528 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.782512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 17:23:37.790410 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:37.790393    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 05 17:23:37.790458 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:37.790446    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs podName:ac55c236-fd48-44d8-b275-1cda967ca5b2 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:41.790429618 +0000 UTC m=+130.275353015 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs") pod "network-metrics-daemon-l4hvb" (UID: "ac55c236-fd48-44d8-b275-1cda967ca5b2") : secret "metrics-daemon-secret" not found
Aug 05 17:23:37.792684 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.792658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5bf156-7684-48e1-8c4e-29e6a7553a65-original-pull-secret\") pod \"global-pull-secret-syncer-mx8jq\" (UID: \"cd5bf156-7684-48e1-8c4e-29e6a7553a65\") " pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:37.880584 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.880480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:37.883126 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.883109    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 17:23:37.893403 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.893385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 17:23:37.903761 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:37.903739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhpv2\" (UniqueName: \"kubernetes.io/projected/8f22e48d-62bc-40aa-8264-544d75594eb1-kube-api-access-dhpv2\") pod \"network-check-target-4mqk4\" (UID: \"8f22e48d-62bc-40aa-8264-544d75594eb1\") " pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:38.068632 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:38.068602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mx8jq"
Aug 05 17:23:38.075909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:38.075886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8p6dg\""
Aug 05 17:23:38.083398 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:38.083374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:38.206433 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:38.206402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mx8jq"]
Aug 05 17:23:38.209511 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:23:38.209483    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5bf156_7684_48e1_8c4e_29e6a7553a65.slice/crio-37ab0584b253ab80f8679c5b6c879aba1445922f58a271affa3a50a059a97b5e WatchSource:0}: Error finding container 37ab0584b253ab80f8679c5b6c879aba1445922f58a271affa3a50a059a97b5e: Status 404 returned error can't find the container with id 37ab0584b253ab80f8679c5b6c879aba1445922f58a271affa3a50a059a97b5e
Aug 05 17:23:38.220663 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:38.220637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mqk4"]
Aug 05 17:23:38.223298 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:23:38.223271    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f22e48d_62bc_40aa_8264_544d75594eb1.slice/crio-3e4132375cad6e753a75e478cfcbe845e9fb4bd23533c16b38899c7fc58cab82 WatchSource:0}: Error finding container 3e4132375cad6e753a75e478cfcbe845e9fb4bd23533c16b38899c7fc58cab82: Status 404 returned error can't find the container with id 3e4132375cad6e753a75e478cfcbe845e9fb4bd23533c16b38899c7fc58cab82
Aug 05 17:23:38.318806 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:38.318770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mx8jq" event={"ID":"cd5bf156-7684-48e1-8c4e-29e6a7553a65","Type":"ContainerStarted","Data":"37ab0584b253ab80f8679c5b6c879aba1445922f58a271affa3a50a059a97b5e"}
Aug 05 17:23:38.319862 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:38.319828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mqk4" event={"ID":"8f22e48d-62bc-40aa-8264-544d75594eb1","Type":"ContainerStarted","Data":"3e4132375cad6e753a75e478cfcbe845e9fb4bd23533c16b38899c7fc58cab82"}
Aug 05 17:23:39.190926 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.190891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:23:39.191398 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:39.191096    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:23:39.191398 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:39.191159    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls podName:81125c9f-7d7c-4f1a-833f-5d7c4e00f09e nodeName:}" failed. No retries permitted until 2026-08-05 17:24:11.191141049 +0000 UTC m=+99.676064445 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls") pod "dns-default-p6dvk" (UID: "81125c9f-7d7c-4f1a-833f-5d7c4e00f09e") : secret "dns-default-metrics-tls" not found
Aug 05 17:23:39.521551 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.521382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:39.523413 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.523385    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6gzxb"]
Aug 05 17:23:39.546617 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.546591    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gzxb"]
Aug 05 17:23:39.546771 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.546729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.549294 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.549268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 17:23:39.549622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.549603    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vf4w2\""
Aug 05 17:23:39.549807 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.549793    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 17:23:39.549987 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.549974    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 17:23:39.550253 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.550234    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 17:23:39.589205 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.589175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:39.593707 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.593675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-crio-socket\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.593994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.593769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j69pk\" (UniqueName: \"kubernetes.io/projected/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-api-access-j69pk\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.593994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.593807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-data-volume\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.593994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.593823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.593994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.593841    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.646723 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.646643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:39.694303 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.694265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-data-volume\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.694496 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.694350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.694496 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.694386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.694496 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.694434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-crio-socket\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.694496 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:39.694483    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:23:39.694704 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:39.694560    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:40.194545262 +0000 UTC m=+68.679468673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : configmap "kube-rbac-proxy" not found
Aug 05 17:23:39.694704 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.694492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69pk\" (UniqueName: \"kubernetes.io/projected/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-api-access-j69pk\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.694704 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.694672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-data-volume\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.694834 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:39.694725    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:39.694834 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:39.694758    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:40.194748993 +0000 UTC m=+68.679672390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:39.694975 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.694904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-crio-socket\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:39.703452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:39.703353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j69pk\" (UniqueName: \"kubernetes.io/projected/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-api-access-j69pk\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:40.032452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:40.032407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:40.129910 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:40.129860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:40.209037 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:40.209009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:40.209440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:40.209041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:40.209440 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:40.209160    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:40.209440 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:40.209219    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:41.209204506 +0000 UTC m=+69.694127902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:40.209579 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:40.209559    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:23:40.209622 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:40.209609    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:41.20959654 +0000 UTC m=+69.694519936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : configmap "kube-rbac-proxy" not found
Aug 05 17:23:40.234192 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:40.234157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:40.293371 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:40.293285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:41.218656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.218615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:41.219125 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.218672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:41.219125 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.218745    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:23:41.219125 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.218821    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:43.218801371 +0000 UTC m=+71.703724787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : configmap "kube-rbac-proxy" not found
Aug 05 17:23:41.219125 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.218835    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:41.219125 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.218912    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:43.218895839 +0000 UTC m=+71.703819236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:41.623216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.623119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:41.623216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.623187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:41.623446 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.623296    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:23:41.623446 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.623294    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:23:41.623446 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.623382    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls podName:fe763e6c-e0cd-4595-9952-3db5b2478017 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:49.623361364 +0000 UTC m=+78.108284777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-sc8tq" (UID: "fe763e6c-e0cd-4595-9952-3db5b2478017") : secret "samples-operator-tls" not found
Aug 05 17:23:41.623446 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.623308    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6995c87859-bq2ht: secret "image-registry-tls" not found
Aug 05 17:23:41.623446 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:41.623447    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls podName:82156fa3-0a73-4c8c-a138-b5a00a0a95d4 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:49.623434376 +0000 UTC m=+78.108357773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls") pod "image-registry-6995c87859-bq2ht" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4") : secret "image-registry-tls" not found
Aug 05 17:23:41.676971 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.676941    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zjzfb_afff50be-fdca-4346-bacd-2036a29b48e4/dns-node-resolver/0.log"
Aug 05 17:23:41.886518 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.886432    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-zm7dl"]
Aug 05 17:23:41.888723 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.888698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:41.891443 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.891415    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 05 17:23:41.891935 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.891914    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 05 17:23:41.892482 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.892463    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 05 17:23:41.892482 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.892477    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 05 17:23:41.892685 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.892543    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dw5zz\""
Aug 05 17:23:41.898570 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.898548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-zm7dl"]
Aug 05 17:23:41.926300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.926265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59d8e9e0-4808-4085-964a-32349f283592-signing-key\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:41.926529 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.926333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59d8e9e0-4808-4085-964a-32349f283592-signing-cabundle\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:41.926529 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.926358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljdg\" (UniqueName: \"kubernetes.io/projected/59d8e9e0-4808-4085-964a-32349f283592-kube-api-access-jljdg\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:41.942509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:41.942466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.026861 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.026808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59d8e9e0-4808-4085-964a-32349f283592-signing-key\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:42.027023 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.026895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59d8e9e0-4808-4085-964a-32349f283592-signing-cabundle\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:42.027023 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.026925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljdg\" (UniqueName: \"kubernetes.io/projected/59d8e9e0-4808-4085-964a-32349f283592-kube-api-access-jljdg\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:42.027723 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.027662    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59d8e9e0-4808-4085-964a-32349f283592-signing-cabundle\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:42.029482 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.029459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59d8e9e0-4808-4085-964a-32349f283592-signing-key\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:42.033561 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.033467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.036775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.036751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljdg\" (UniqueName: \"kubernetes.io/projected/59d8e9e0-4808-4085-964a-32349f283592-kube-api-access-jljdg\") pod \"service-ca-98c88fbb5-zm7dl\" (UID: \"59d8e9e0-4808-4085-964a-32349f283592\") " pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:42.199573 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.199534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl"
Aug 05 17:23:42.390084 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.390048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.491145 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.491048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.674521 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.674494    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zzmrz_a0835e42-bf73-4bf5-8dbb-7819bd0d508f/node-ca/0.log"
Aug 05 17:23:42.901688 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.901646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.937871 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:42.937828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-zm7dl"]
Aug 05 17:23:42.941113 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:23:42.941069    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d8e9e0_4808_4085_964a_32349f283592.slice/crio-e563765adf6bd03af13de9fa2cd95c514f978f40394b29ec4e6292ca92593764 WatchSource:0}: Error finding container e563765adf6bd03af13de9fa2cd95c514f978f40394b29ec4e6292ca92593764: Status 404 returned error can't find the container with id e563765adf6bd03af13de9fa2cd95c514f978f40394b29ec4e6292ca92593764
Aug 05 17:23:43.237495 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.237453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:43.237495 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.237498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:43.237699 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:43.237587    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:23:43.237699 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:43.237624    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:43.237699 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:43.237651    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:47.23763603 +0000 UTC m=+75.722559430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : configmap "kube-rbac-proxy" not found
Aug 05 17:23:43.237699 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:43.237667    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:47.237656828 +0000 UTC m=+75.722580225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:43.339199 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.339156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mx8jq" event={"ID":"cd5bf156-7684-48e1-8c4e-29e6a7553a65","Type":"ContainerStarted","Data":"7aa2e45b544e5ecac40013ea9e47983314ab879ababbfdf05be60a39db4d66d7"}
Aug 05 17:23:43.340402 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.340372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl" event={"ID":"59d8e9e0-4808-4085-964a-32349f283592","Type":"ContainerStarted","Data":"e563765adf6bd03af13de9fa2cd95c514f978f40394b29ec4e6292ca92593764"}
Aug 05 17:23:43.342018 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.341992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mqk4" event={"ID":"8f22e48d-62bc-40aa-8264-544d75594eb1","Type":"ContainerStarted","Data":"39c2ee58e2e253178866387191bf120a263a15476f32bdf5b601634f0d40aa95"}
Aug 05 17:23:43.342139 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.342063    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:23:43.355803 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.355753    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mx8jq" podStartSLOduration=66.754227999 podStartE2EDuration="1m11.355736053s" totalImagesPullingTime="4.601508054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:43.355035433 +0000 UTC m=+71.839958851" watchObservedRunningTime="2026-08-05 17:23:43.355736053 +0000 UTC m=+71.840659470"
Aug 05 17:23:43.371015 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.370962    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4mqk4" podStartSLOduration=66.79405782 podStartE2EDuration="1m11.37094087s" totalImagesPullingTime="4.57688305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:43.369995486 +0000 UTC m=+71.854918904" watchObservedRunningTime="2026-08-05 17:23:43.37094087 +0000 UTC m=+71.855864291"
Aug 05 17:23:43.474311 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:43.474286    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zgzk2_19e14f0f-27a2-429c-ad0a-79f7da761469/serve-healthcheck-canary/0.log"
Aug 05 17:23:45.349104 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:45.349066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl" event={"ID":"59d8e9e0-4808-4085-964a-32349f283592","Type":"ContainerStarted","Data":"ecc5410dd113fd8429a0d70fb05d174d1841b68e77335d6c7f834070956afb5b"}
Aug 05 17:23:45.367352 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:45.367308    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-zm7dl" podStartSLOduration=2.80850915 podStartE2EDuration="4.367289655s" totalImagesPullingTime="1.558780505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:45.36691655 +0000 UTC m=+73.851839968" watchObservedRunningTime="2026-08-05 17:23:45.367289655 +0000 UTC m=+73.852213072"
Aug 05 17:23:45.903435 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:45.903398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:46.129604 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:46.129568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:46.325823 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:46.325782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:46.424571 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:46.424541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:46.491521 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:46.491490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:46.574354 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:46.574316    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:47.246334 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:47.246287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:47.272321 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:47.272282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:47.272321 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:47.272324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:47.272550 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:47.272374    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:23:47.272550 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:47.272451    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:55.272431676 +0000 UTC m=+83.757355078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : configmap "kube-rbac-proxy" not found
Aug 05 17:23:47.272550 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:47.272484    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:47.272668 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:47.272557    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:23:55.272534557 +0000 UTC m=+83.757457974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:47.826729 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:47.826689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:48.029109 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:48.029071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:48.231177 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:48.231126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:48.635657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:48.635567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:49.232556 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.232523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:49.631505 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.631415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:49.688603 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.688579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:49.688744 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.688630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") pod \"image-registry-6995c87859-bq2ht\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") " pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:23:49.688801 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:49.688761    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:23:49.688801 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:49.688777    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6995c87859-bq2ht: secret "image-registry-tls" not found
Aug 05 17:23:49.688901 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:49.688873    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls podName:82156fa3-0a73-4c8c-a138-b5a00a0a95d4 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:05.688832092 +0000 UTC m=+94.173755503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls") pod "image-registry-6995c87859-bq2ht" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4") : secret "image-registry-tls" not found
Aug 05 17:23:49.691221 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.691183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe763e6c-e0cd-4595-9952-3db5b2478017-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-sc8tq\" (UID: \"fe763e6c-e0cd-4595-9952-3db5b2478017\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:49.842024 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.841993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"
Aug 05 17:23:49.926086 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.926053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:49.969178 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:49.969149    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq"]
Aug 05 17:23:50.027269 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:50.027230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:50.088915 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:50.088884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:50.248322 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:50.248292    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:50.369823 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:50.369787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq" event={"ID":"fe763e6c-e0cd-4595-9952-3db5b2478017","Type":"ContainerStarted","Data":"eeb13ded496f11a0ba99a4d36494c1e51c51d84e183190cd85d6d7ff36db36b2"}
Aug 05 17:23:50.627550 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:50.627465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:50.728019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:50.727982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:51.227609 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:51.227571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:51.825392 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:51.825359    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:52.022268 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.022241    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:52.227913 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.227875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:52.325478 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.325440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:52.377279 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.377250    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq" event={"ID":"fe763e6c-e0cd-4595-9952-3db5b2478017","Type":"ContainerStarted","Data":"2b224738e910523674d2a3af87da7957d26012510dd87dba5f27c92b4e348318"}
Aug 05 17:23:52.377461 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.377305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq" event={"ID":"fe763e6c-e0cd-4595-9952-3db5b2478017","Type":"ContainerStarted","Data":"96740e3a4535c754db096a84788cac0ab760451253e92daeab2de13684ee0d6b"}
Aug 05 17:23:52.394650 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.394606    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-sc8tq" podStartSLOduration=17.463008926 podStartE2EDuration="19.394591356s" totalImagesPullingTime="1.93158243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:52.393694889 +0000 UTC m=+80.878618303" watchObservedRunningTime="2026-08-05 17:23:52.394591356 +0000 UTC m=+80.879514775"
Aug 05 17:23:52.627785 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.627633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:52.788622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:52.788588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:53.223928 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:53.223875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:53.836436 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:53.836397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:54.025545 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:54.025512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:54.239195 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:54.239163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:54.430120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:54.430069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:55.267351 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:55.267313    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:55.336451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:55.336427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:55.336527 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:55.336456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:55.336573 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:55.336561    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:55.336620 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:23:55.336612    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls podName:ae1b1592-30ae-4c06-91b1-18ba9d3cb42b nodeName:}" failed. No retries permitted until 2026-08-05 17:24:11.336599641 +0000 UTC m=+99.821523038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gzxb" (UID: "ae1b1592-30ae-4c06-91b1-18ba9d3cb42b") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:23:55.336951 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:55.336934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:23:55.432371 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:55.432340    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:55.628330 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:55.628243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:56.033599 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:56.033560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:56.231024 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:56.230988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:56.425446 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:56.425416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:56.834483 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:23:56.834399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:01.385417 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:01.385382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:01.517106 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:01.517075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:02.658466 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.658432    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-546m7"]
Aug 05 17:24:02.660936 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.660920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:02.663245 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.663225    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jfrwb\""
Aug 05 17:24:02.664098 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.664081    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 05 17:24:02.664098 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.664096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 05 17:24:02.670039 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.670020    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-546m7"]
Aug 05 17:24:02.677325 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.677306    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6995c87859-bq2ht"]
Aug 05 17:24:02.677507 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:24:02.677489    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6995c87859-bq2ht" podUID="82156fa3-0a73-4c8c-a138-b5a00a0a95d4"
Aug 05 17:24:02.710860 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.710806    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-744bd668c-zhghm"]
Aug 05 17:24:02.712718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.712702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.729474 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.727761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-744bd668c-zhghm"]
Aug 05 17:24:02.769797 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.769754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:02.789000 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.788964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b050aea2-69e0-4636-b5dd-728e4ef8fb66-image-registry-private-configuration\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b050aea2-69e0-4636-b5dd-728e4ef8fb66-installation-pull-secrets\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a89cb9f-1cbf-494b-9553-8141e7bce261-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-546m7\" (UID: \"0a89cb9f-1cbf-494b-9553-8141e7bce261\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:02.789184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-registry-tls\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b050aea2-69e0-4636-b5dd-728e4ef8fb66-ca-trust-extracted\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b050aea2-69e0-4636-b5dd-728e4ef8fb66-registry-certificates\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b050aea2-69e0-4636-b5dd-728e4ef8fb66-trusted-ca\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789453 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-bound-sa-token\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789453 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5m2z\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-kube-api-access-w5m2z\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.789453 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.789341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a89cb9f-1cbf-494b-9553-8141e7bce261-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-546m7\" (UID: \"0a89cb9f-1cbf-494b-9553-8141e7bce261\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:02.869284 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.869246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:02.890189 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b050aea2-69e0-4636-b5dd-728e4ef8fb66-image-registry-private-configuration\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890189 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b050aea2-69e0-4636-b5dd-728e4ef8fb66-installation-pull-secrets\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890436 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a89cb9f-1cbf-494b-9553-8141e7bce261-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-546m7\" (UID: \"0a89cb9f-1cbf-494b-9553-8141e7bce261\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:02.890436 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-registry-tls\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890436 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b050aea2-69e0-4636-b5dd-728e4ef8fb66-ca-trust-extracted\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890436 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b050aea2-69e0-4636-b5dd-728e4ef8fb66-registry-certificates\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890436 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b050aea2-69e0-4636-b5dd-728e4ef8fb66-trusted-ca\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890672 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-bound-sa-token\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890672 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5m2z\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-kube-api-access-w5m2z\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890672 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a89cb9f-1cbf-494b-9553-8141e7bce261-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-546m7\" (UID: \"0a89cb9f-1cbf-494b-9553-8141e7bce261\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:02.890812 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b050aea2-69e0-4636-b5dd-728e4ef8fb66-ca-trust-extracted\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.890981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.890954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a89cb9f-1cbf-494b-9553-8141e7bce261-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-546m7\" (UID: \"0a89cb9f-1cbf-494b-9553-8141e7bce261\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:02.891335 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.891308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b050aea2-69e0-4636-b5dd-728e4ef8fb66-registry-certificates\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.891743 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.891713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b050aea2-69e0-4636-b5dd-728e4ef8fb66-trusted-ca\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.893232 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.893211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a89cb9f-1cbf-494b-9553-8141e7bce261-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-546m7\" (UID: \"0a89cb9f-1cbf-494b-9553-8141e7bce261\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:02.893371 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.893353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-registry-tls\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.893416 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.893402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b050aea2-69e0-4636-b5dd-728e4ef8fb66-installation-pull-secrets\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.893574 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.893558    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b050aea2-69e0-4636-b5dd-728e4ef8fb66-image-registry-private-configuration\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.898622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.898602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-bound-sa-token\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.899284 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.899259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5m2z\" (UniqueName: \"kubernetes.io/projected/b050aea2-69e0-4636-b5dd-728e4ef8fb66-kube-api-access-w5m2z\") pod \"image-registry-744bd668c-zhghm\" (UID: \"b050aea2-69e0-4636-b5dd-728e4ef8fb66\") " pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:02.970041 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:02.970013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7"
Aug 05 17:24:03.021778 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.021595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:03.106640 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.106571    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-546m7"]
Aug 05 17:24:03.111502 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:03.111466    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a89cb9f_1cbf_494b_9553_8141e7bce261.slice/crio-b315e2052b1c46dfd857e8942e223b55ee04f8280e9ec09ca01c0973718da9db WatchSource:0}: Error finding container b315e2052b1c46dfd857e8942e223b55ee04f8280e9ec09ca01c0973718da9db: Status 404 returned error can't find the container with id b315e2052b1c46dfd857e8942e223b55ee04f8280e9ec09ca01c0973718da9db
Aug 05 17:24:03.162749 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.162718    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-744bd668c-zhghm"]
Aug 05 17:24:03.165716 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:03.165695    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb050aea2_69e0_4636_b5dd_728e4ef8fb66.slice/crio-e853f7cf1f02b0d1ffc41c5b9bf71525f37b8a86c6cf9d0040f05128b38d770c WatchSource:0}: Error finding container e853f7cf1f02b0d1ffc41c5b9bf71525f37b8a86c6cf9d0040f05128b38d770c: Status 404 returned error can't find the container with id e853f7cf1f02b0d1ffc41c5b9bf71525f37b8a86c6cf9d0040f05128b38d770c
Aug 05 17:24:03.412839 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.412759    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7" event={"ID":"0a89cb9f-1cbf-494b-9553-8141e7bce261","Type":"ContainerStarted","Data":"b315e2052b1c46dfd857e8942e223b55ee04f8280e9ec09ca01c0973718da9db"}
Aug 05 17:24:03.414251 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.414231    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:24:03.414251 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.414240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-744bd668c-zhghm" event={"ID":"b050aea2-69e0-4636-b5dd-728e4ef8fb66","Type":"ContainerStarted","Data":"506874cc714f491dc78367ca3aacbff6d056d21629732912212e2b744d54d53a"}
Aug 05 17:24:03.414423 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.414280    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-744bd668c-zhghm" event={"ID":"b050aea2-69e0-4636-b5dd-728e4ef8fb66","Type":"ContainerStarted","Data":"e853f7cf1f02b0d1ffc41c5b9bf71525f37b8a86c6cf9d0040f05128b38d770c"}
Aug 05 17:24:03.414423 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.414334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:03.419230 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.419212    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:24:03.450955 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.450905    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-744bd668c-zhghm" podStartSLOduration=1.4508885120000001 podStartE2EDuration="1.450888512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:03.449504453 +0000 UTC m=+91.934427872" watchObservedRunningTime="2026-08-05 17:24:03.450888512 +0000 UTC m=+91.935811930"
Aug 05 17:24:03.495986 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.495956    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-certificates\") pod \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") "
Aug 05 17:24:03.496191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496026    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-ca-trust-extracted\") pod \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") "
Aug 05 17:24:03.496191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496054    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-image-registry-private-configuration\") pod \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") "
Aug 05 17:24:03.496191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-bound-sa-token\") pod \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") "
Aug 05 17:24:03.496191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496116    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-trusted-ca\") pod \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") "
Aug 05 17:24:03.496386 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxjnn\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-kube-api-access-bxjnn\") pod \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") "
Aug 05 17:24:03.496386 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496303    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-installation-pull-secrets\") pod \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\" (UID: \"82156fa3-0a73-4c8c-a138-b5a00a0a95d4\") "
Aug 05 17:24:03.496386 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496361    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82156fa3-0a73-4c8c-a138-b5a00a0a95d4" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:24:03.496533 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496393    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82156fa3-0a73-4c8c-a138-b5a00a0a95d4" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:24:03.497405 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496697    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-ca-trust-extracted\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:03.497405 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496723    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-certificates\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:03.497405 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.496813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82156fa3-0a73-4c8c-a138-b5a00a0a95d4" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:24:03.498787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.498756    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-kube-api-access-bxjnn" (OuterVolumeSpecName: "kube-api-access-bxjnn") pod "82156fa3-0a73-4c8c-a138-b5a00a0a95d4" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4"). InnerVolumeSpecName "kube-api-access-bxjnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:24:03.498787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.498773    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82156fa3-0a73-4c8c-a138-b5a00a0a95d4" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:24:03.498947 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.498794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82156fa3-0a73-4c8c-a138-b5a00a0a95d4" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:24:03.498981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.498943    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82156fa3-0a73-4c8c-a138-b5a00a0a95d4" (UID: "82156fa3-0a73-4c8c-a138-b5a00a0a95d4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:24:03.597672 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.597639    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-image-registry-private-configuration\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:03.597672 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.597670    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-bound-sa-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:03.597872 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.597684    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-trusted-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:03.597872 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.597695    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxjnn\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-kube-api-access-bxjnn\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:03.597872 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:03.597708    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-installation-pull-secrets\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:04.419348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.419310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7" event={"ID":"0a89cb9f-1cbf-494b-9553-8141e7bce261","Type":"ContainerStarted","Data":"4b43d26f2a1c30ff82d772931c99bd3cb37699263ca2e1a50f80e5d22727cd30"}
Aug 05 17:24:04.419822 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.419324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6995c87859-bq2ht"
Aug 05 17:24:04.435130 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.435082    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-546m7" podStartSLOduration=1.247733768 podStartE2EDuration="2.435067299s" totalImagesPullingTime="1.187333531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:04.434083037 +0000 UTC m=+92.919006456" watchObservedRunningTime="2026-08-05 17:24:04.435067299 +0000 UTC m=+92.919990985"
Aug 05 17:24:04.459601 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.459575    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6995c87859-bq2ht"]
Aug 05 17:24:04.465749 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.465728    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6995c87859-bq2ht"]
Aug 05 17:24:04.560158 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.560071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:04.605247 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.605217    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82156fa3-0a73-4c8c-a138-b5a00a0a95d4-registry-tls\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:24:04.622385 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:04.622334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:06.057516 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:06.057471    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82156fa3-0a73-4c8c-a138-b5a00a0a95d4" path="/var/lib/kubelet/pods/82156fa3-0a73-4c8c-a138-b5a00a0a95d4/volumes"
Aug 05 17:24:08.616098 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:08.616066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:08.717535 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:08.717498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:08.783653 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:08.783618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:09.038051 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:09.038016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:11.254307 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.254254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:24:11.256750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.256729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81125c9f-7d7c-4f1a-833f-5d7c4e00f09e-metrics-tls\") pod \"dns-default-p6dvk\" (UID: \"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e\") " pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:24:11.275541 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.275511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hv8kx\""
Aug 05 17:24:11.282724 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.282704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:24:11.355340 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.355312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:24:11.357555 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.357528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae1b1592-30ae-4c06-91b1-18ba9d3cb42b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gzxb\" (UID: \"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b\") " pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:24:11.358475 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.358459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gzxb"
Aug 05 17:24:11.415863 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.415809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p6dvk"]
Aug 05 17:24:11.420417 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:11.420392    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81125c9f_7d7c_4f1a_833f_5d7c4e00f09e.slice/crio-f035cc094ac9586a780f30107322554e9bfc3e64e2c8f8907ca26b1f65bdc3fc WatchSource:0}: Error finding container f035cc094ac9586a780f30107322554e9bfc3e64e2c8f8907ca26b1f65bdc3fc: Status 404 returned error can't find the container with id f035cc094ac9586a780f30107322554e9bfc3e64e2c8f8907ca26b1f65bdc3fc
Aug 05 17:24:11.444520 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.444491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6dvk" event={"ID":"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e","Type":"ContainerStarted","Data":"f035cc094ac9586a780f30107322554e9bfc3e64e2c8f8907ca26b1f65bdc3fc"}
Aug 05 17:24:11.492962 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:11.492929    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gzxb"]
Aug 05 17:24:11.496268 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:11.496238    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1b1592_30ae_4c06_91b1_18ba9d3cb42b.slice/crio-37606a3d61ce8b361b65341bdee3568d80d70019319d7ca15bfbde767d8ad57f WatchSource:0}: Error finding container 37606a3d61ce8b361b65341bdee3568d80d70019319d7ca15bfbde767d8ad57f: Status 404 returned error can't find the container with id 37606a3d61ce8b361b65341bdee3568d80d70019319d7ca15bfbde767d8ad57f
Aug 05 17:24:12.451767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.451712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gzxb" event={"ID":"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b","Type":"ContainerStarted","Data":"34cc925dc163d10c866af3239ade20ee827249726d2d4bd22cf9b44918a5c6d9"}
Aug 05 17:24:12.452301 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.451800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gzxb" event={"ID":"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b","Type":"ContainerStarted","Data":"074c175c3117636038d26fe7af37b2bfa20af860df53d738d905b750e229ee60"}
Aug 05 17:24:12.452301 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.451832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gzxb" event={"ID":"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b","Type":"ContainerStarted","Data":"37606a3d61ce8b361b65341bdee3568d80d70019319d7ca15bfbde767d8ad57f"}
Aug 05 17:24:12.826830 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.826792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:12.853219 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.853184    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"]
Aug 05 17:24:12.871221 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.871182    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"]
Aug 05 17:24:12.871397 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.871310    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:12.874491 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.874431    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 17:24:12.874610 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.874538    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5zczn\""
Aug 05 17:24:12.875449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.875429    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 05 17:24:12.875571 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.875432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 05 17:24:12.875571 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.875486    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 17:24:12.875571 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.875492    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 17:24:12.929890 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.929833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:12.968947 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.968908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7g9h\" (UniqueName: \"kubernetes.io/projected/62ae55e4-5cb4-448a-8cd6-f05141553c84-kube-api-access-r7g9h\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:12.969146 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.968979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:12.969146 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.969017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ae55e4-5cb4-448a-8cd6-f05141553c84-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:12.969146 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:12.969067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.070218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.070182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7g9h\" (UniqueName: \"kubernetes.io/projected/62ae55e4-5cb4-448a-8cd6-f05141553c84-kube-api-access-r7g9h\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.070218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.070232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.070462 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.070252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ae55e4-5cb4-448a-8cd6-f05141553c84-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.070462 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.070299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.070462 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:24:13.070364    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 05 17:24:13.070462 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:24:13.070438    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-tls podName:62ae55e4-5cb4-448a-8cd6-f05141553c84 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:13.570417008 +0000 UTC m=+102.055340408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-mvf8w" (UID: "62ae55e4-5cb4-448a-8cd6-f05141553c84") : secret "prometheus-operator-tls" not found
Aug 05 17:24:13.070995 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.070973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62ae55e4-5cb4-448a-8cd6-f05141553c84-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.072822 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.072790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.079769 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.079715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7g9h\" (UniqueName: \"kubernetes.io/projected/62ae55e4-5cb4-448a-8cd6-f05141553c84-kube-api-access-r7g9h\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.492033 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.491999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:13.574590 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.574558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.577272 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.577247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62ae55e4-5cb4-448a-8cd6-f05141553c84-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-mvf8w\" (UID: \"62ae55e4-5cb4-448a-8cd6-f05141553c84\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.782069 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.782027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"
Aug 05 17:24:13.982107 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:13.981965    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-mvf8w"]
Aug 05 17:24:14.347579 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:14.347496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4mqk4"
Aug 05 17:24:14.406386 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:14.406355    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ae55e4_5cb4_448a_8cd6_f05141553c84.slice/crio-80ed88563b4666c1bb0d05ce71a9d3fe26146eade1d5e737a3751086c991c047 WatchSource:0}: Error finding container 80ed88563b4666c1bb0d05ce71a9d3fe26146eade1d5e737a3751086c991c047: Status 404 returned error can't find the container with id 80ed88563b4666c1bb0d05ce71a9d3fe26146eade1d5e737a3751086c991c047
Aug 05 17:24:14.469235 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:14.469201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6dvk" event={"ID":"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e","Type":"ContainerStarted","Data":"16dd13ea928d40b8c9e1f3178b9d449553ae5814f59933868f96c102ced935ce"}
Aug 05 17:24:14.469405 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:14.469274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6dvk" event={"ID":"81125c9f-7d7c-4f1a-833f-5d7c4e00f09e","Type":"ContainerStarted","Data":"26f3aef3d7eafbbaab7ed3ea5a83c810813ff2d26e3978a18813bc7b52ed149c"}
Aug 05 17:24:14.469405 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:14.469315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:24:14.470368 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:14.470347    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w" event={"ID":"62ae55e4-5cb4-448a-8cd6-f05141553c84","Type":"ContainerStarted","Data":"80ed88563b4666c1bb0d05ce71a9d3fe26146eade1d5e737a3751086c991c047"}
Aug 05 17:24:15.477407 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:15.477371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gzxb" event={"ID":"ae1b1592-30ae-4c06-91b1-18ba9d3cb42b","Type":"ContainerStarted","Data":"04312f43b715cea863519d3ee95fce315f59a7125e686cd7b00d1b971cecc3d0"}
Aug 05 17:24:15.504681 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:15.504626    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p6dvk" podStartSLOduration=66.501701027 podStartE2EDuration="1m8.504605236s" totalImagesPullingTime="2.002904209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:14.494645284 +0000 UTC m=+102.979568704" watchObservedRunningTime="2026-08-05 17:24:15.504605236 +0000 UTC m=+103.989528702"
Aug 05 17:24:15.504995 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:15.504951    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6gzxb" podStartSLOduration=33.378708787 podStartE2EDuration="36.504936447s" totalImagesPullingTime="3.12622766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:15.503711709 +0000 UTC m=+103.988635128" watchObservedRunningTime="2026-08-05 17:24:15.504936447 +0000 UTC m=+103.989859866"
Aug 05 17:24:16.320324 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:16.320230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:16.482497 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:16.482456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w" event={"ID":"62ae55e4-5cb4-448a-8cd6-f05141553c84","Type":"ContainerStarted","Data":"71da9abcf1f9ae9040b590aa355ee7ff148b81dfd55781e7ce6fd147e6e2cc20"}
Aug 05 17:24:16.482955 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:16.482514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w" event={"ID":"62ae55e4-5cb4-448a-8cd6-f05141553c84","Type":"ContainerStarted","Data":"6a5096d5ac658b6aa290be9e662feb6699b9736ca1730cb0ba05b48f55c6cd5a"}
Aug 05 17:24:17.812347 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.812296    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-mvf8w" podStartSLOduration=4.218674385 podStartE2EDuration="5.812278653s" totalImagesPullingTime="1.593604268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:16.501616414 +0000 UTC m=+104.986539832" watchObservedRunningTime="2026-08-05 17:24:17.812278653 +0000 UTC m=+106.297202072"
Aug 05 17:24:17.812728 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.812670    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-rdm9n"]
Aug 05 17:24:17.814824 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.814810    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-rdm9n"
Aug 05 17:24:17.817963 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.817944    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 05 17:24:17.818617 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.818603    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lmb7h\""
Aug 05 17:24:17.818698 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.818616    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 05 17:24:17.834915 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.834895    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-rdm9n"]
Aug 05 17:24:17.843778 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.843749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:17.910331 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.910294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxng\" (UniqueName: \"kubernetes.io/projected/4711b734-49cd-4230-a6d6-4e0a8392afa2-kube-api-access-klxng\") pod \"downloads-77c974ffcf-rdm9n\" (UID: \"4711b734-49cd-4230-a6d6-4e0a8392afa2\") " pod="openshift-console/downloads-77c974ffcf-rdm9n"
Aug 05 17:24:17.959607 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:17.959560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.011718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.011684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klxng\" (UniqueName: \"kubernetes.io/projected/4711b734-49cd-4230-a6d6-4e0a8392afa2-kube-api-access-klxng\") pod \"downloads-77c974ffcf-rdm9n\" (UID: \"4711b734-49cd-4230-a6d6-4e0a8392afa2\") " pod="openshift-console/downloads-77c974ffcf-rdm9n"
Aug 05 17:24:18.023773 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.023741    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxng\" (UniqueName: \"kubernetes.io/projected/4711b734-49cd-4230-a6d6-4e0a8392afa2-kube-api-access-klxng\") pod \"downloads-77c974ffcf-rdm9n\" (UID: \"4711b734-49cd-4230-a6d6-4e0a8392afa2\") " pod="openshift-console/downloads-77c974ffcf-rdm9n"
Aug 05 17:24:18.069134 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.069038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.123116 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.123082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-rdm9n"
Aug 05 17:24:18.192726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.192658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.285893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.284514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-rdm9n"]
Aug 05 17:24:18.292644 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.292614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.293781 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:18.293745    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4711b734_49cd_4230_a6d6_4e0a8392afa2.slice/crio-7fe7570dacadb0dbbaef136082eb44eafe922e3409a23a113a5146884a0fdb9e WatchSource:0}: Error finding container 7fe7570dacadb0dbbaef136082eb44eafe922e3409a23a113a5146884a0fdb9e: Status 404 returned error can't find the container with id 7fe7570dacadb0dbbaef136082eb44eafe922e3409a23a113a5146884a0fdb9e
Aug 05 17:24:18.453669 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.453634    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w6pmt"]
Aug 05 17:24:18.456922 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.456905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.459890 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.459872    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 17:24:18.460320 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.460299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 17:24:18.460408 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.460334    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dw7jg\""
Aug 05 17:24:18.460468 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.460424    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 17:24:18.465758 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.465736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.490709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.490670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-rdm9n" event={"ID":"4711b734-49cd-4230-a6d6-4e0a8392afa2","Type":"ContainerStarted","Data":"7fe7570dacadb0dbbaef136082eb44eafe922e3409a23a113a5146884a0fdb9e"}
Aug 05 17:24:18.613653 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.613616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.617585 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-tls\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.617740 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqq88\" (UniqueName: \"kubernetes.io/projected/eb0dd3de-5604-4b1a-ad04-c92457f29320-kube-api-access-xqq88\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.617740 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-root\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.617740 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-accelerators-collector-config\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.617740 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-wtmp\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.617917 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.617917 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb0dd3de-5604-4b1a-ad04-c92457f29320-metrics-client-ca\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.617917 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-textfile\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.618028 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.617969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-sys\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.697284 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.697248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.719285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-root\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-accelerators-collector-config\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-wtmp\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719327    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb0dd3de-5604-4b1a-ad04-c92457f29320-metrics-client-ca\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-root\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-textfile\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-sys\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-tls\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqq88\" (UniqueName: \"kubernetes.io/projected/eb0dd3de-5604-4b1a-ad04-c92457f29320-kube-api-access-xqq88\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-wtmp\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb0dd3de-5604-4b1a-ad04-c92457f29320-sys\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719992 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-textfile\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719992 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb0dd3de-5604-4b1a-ad04-c92457f29320-metrics-client-ca\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.719992 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.719958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-accelerators-collector-config\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.721962 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.721937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.722080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.722063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb0dd3de-5604-4b1a-ad04-c92457f29320-node-exporter-tls\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.737601 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.737573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqq88\" (UniqueName: \"kubernetes.io/projected/eb0dd3de-5604-4b1a-ad04-c92457f29320-kube-api-access-xqq88\") pod \"node-exporter-w6pmt\" (UID: \"eb0dd3de-5604-4b1a-ad04-c92457f29320\") " pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.769559 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.769529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w6pmt"
Aug 05 17:24:18.779405 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:18.779379    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0dd3de_5604_4b1a_ad04_c92457f29320.slice/crio-0c9e1d90804c0b8582e651f3c4b7b7fd55338a326940ede739e3a3c3937a0580 WatchSource:0}: Error finding container 0c9e1d90804c0b8582e651f3c4b7b7fd55338a326940ede739e3a3c3937a0580: Status 404 returned error can't find the container with id 0c9e1d90804c0b8582e651f3c4b7b7fd55338a326940ede739e3a3c3937a0580
Aug 05 17:24:18.815750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.815703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:18.915981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:18.915887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:19.015446 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:19.015364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:19.310372 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:19.310295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:19.407231 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:19.407196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:19.498148 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:19.498061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w6pmt" event={"ID":"eb0dd3de-5604-4b1a-ad04-c92457f29320","Type":"ContainerStarted","Data":"0c9e1d90804c0b8582e651f3c4b7b7fd55338a326940ede739e3a3c3937a0580"}
Aug 05 17:24:19.508926 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:19.508888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:19.632830 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:19.632696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:19.934875 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:19.932788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:20.035203 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:20.035161    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:20.487503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:20.487473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:20.503458 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:20.503424    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb0dd3de-5604-4b1a-ad04-c92457f29320" containerID="7ea7761f04bfc9de15a866b15e5e01344f476119a14ee99e6382d52b81047abe" exitCode=0
Aug 05 17:24:20.503641 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:20.503463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w6pmt" event={"ID":"eb0dd3de-5604-4b1a-ad04-c92457f29320","Type":"ContainerDied","Data":"7ea7761f04bfc9de15a866b15e5e01344f476119a14ee99e6382d52b81047abe"}
Aug 05 17:24:20.920742 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:20.920709    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:21.026929 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.026892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:21.348839 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.348744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:21.358419 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.358395    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d68667b75-vnqdw"]
Aug 05 17:24:21.361356 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.361334    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.366343 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.366319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-67b7au4occpfn\""
Aug 05 17:24:21.366478 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.366403    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 05 17:24:21.366556 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.366517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 05 17:24:21.366648 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.366635    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 05 17:24:21.366704 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.366661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-x7vng\""
Aug 05 17:24:21.366772 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.366759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 05 17:24:21.366873 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.366838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 05 17:24:21.377209 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.377181    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d68667b75-vnqdw"]
Aug 05 17:24:21.420336 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.420288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:21.511463 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.511427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w6pmt" event={"ID":"eb0dd3de-5604-4b1a-ad04-c92457f29320","Type":"ContainerStarted","Data":"01fda7613bbb04e3add9ffb8a572c400ce33af5256abd34f7f746c31dac54372"}
Aug 05 17:24:21.511650 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.511488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w6pmt" event={"ID":"eb0dd3de-5604-4b1a-ad04-c92457f29320","Type":"ContainerStarted","Data":"3daeb41be325e485ba2116cf290642876c6a6ed69c7d99c244bdb82721267b49"}
Aug 05 17:24:21.537890 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.537806    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w6pmt" podStartSLOduration=2.326495496 podStartE2EDuration="3.537785688s" totalImagesPullingTime="1.122286657s" totalInitContainerRuntime="89.003535ms" isStatefulPod=true podCreationTimestamp="2026-08-05 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:21.536262576 +0000 UTC m=+110.021185995" watchObservedRunningTime="2026-08-05 17:24:21.537785688 +0000 UTC m=+110.022709108"
Aug 05 17:24:21.544598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-grpc-tls\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.544750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87cdfa10-f5cf-4140-9bf7-2f42a233530b-metrics-client-ca\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.544750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9s4w\" (UniqueName: \"kubernetes.io/projected/87cdfa10-f5cf-4140-9bf7-2f42a233530b-kube-api-access-j9s4w\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.544750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.544750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.544948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-tls\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.544948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.544948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.544895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.614972 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.614887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:21.646351 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.646317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.646535 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.646370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-grpc-tls\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.647631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.646839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87cdfa10-f5cf-4140-9bf7-2f42a233530b-metrics-client-ca\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.647631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.646932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9s4w\" (UniqueName: \"kubernetes.io/projected/87cdfa10-f5cf-4140-9bf7-2f42a233530b-kube-api-access-j9s4w\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.647631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.647003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.647631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.647032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.647631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.647099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-tls\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.647631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.647321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.648052 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.647796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87cdfa10-f5cf-4140-9bf7-2f42a233530b-metrics-client-ca\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.650155 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.650132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.650911 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.650883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-grpc-tls\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.651041 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.651016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.651682 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.651659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-tls\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.652066 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.652044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.652530 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.652510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/87cdfa10-f5cf-4140-9bf7-2f42a233530b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.655622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.655603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9s4w\" (UniqueName: \"kubernetes.io/projected/87cdfa10-f5cf-4140-9bf7-2f42a233530b-kube-api-access-j9s4w\") pod \"thanos-querier-7d68667b75-vnqdw\" (UID: \"87cdfa10-f5cf-4140-9bf7-2f42a233530b\") " pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.673540 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.673509    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:21.851299 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:21.851264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d68667b75-vnqdw"]
Aug 05 17:24:21.854328 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:21.854292    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cdfa10_f5cf_4140_9bf7_2f42a233530b.slice/crio-a3e38eb18dd19ce7cde1265484787efc27c6248765200f74a7405740b5b860ff WatchSource:0}: Error finding container a3e38eb18dd19ce7cde1265484787efc27c6248765200f74a7405740b5b860ff: Status 404 returned error can't find the container with id a3e38eb18dd19ce7cde1265484787efc27c6248765200f74a7405740b5b860ff
Aug 05 17:24:22.034802 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:22.034766    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:22.518019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:22.517979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" event={"ID":"87cdfa10-f5cf-4140-9bf7-2f42a233530b","Type":"ContainerStarted","Data":"a3e38eb18dd19ce7cde1265484787efc27c6248765200f74a7405740b5b860ff"}
Aug 05 17:24:23.028638 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.028605    2560 patch_prober.go:28] interesting pod/image-registry-744bd668c-zhghm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 05 17:24:23.028832 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.028676    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-744bd668c-zhghm" podUID="b050aea2-69e0-4636-b5dd-728e4ef8fb66" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:24:23.039227 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.039184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:23.048305 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.048273    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"]
Aug 05 17:24:23.052441 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.052420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:23.054820 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.054799    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-64phh\""
Aug 05 17:24:23.055063 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.055048    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 05 17:24:23.058050 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.057802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:23.058050 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.057929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll5h9\" (UniqueName: \"kubernetes.io/projected/9af91e8e-172a-477e-87f7-a83dd2006549-kube-api-access-ll5h9\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:23.063545 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.062671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"]
Aug 05 17:24:23.130709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.130644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:23.158524 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.158490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll5h9\" (UniqueName: \"kubernetes.io/projected/9af91e8e-172a-477e-87f7-a83dd2006549-kube-api-access-ll5h9\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:23.158669 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.158594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:23.158729 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:24:23.158707    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Aug 05 17:24:23.158790 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:24:23.158769    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert podName:9af91e8e-172a-477e-87f7-a83dd2006549 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.658752093 +0000 UTC m=+112.143675494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-4rvqs" (UID: "9af91e8e-172a-477e-87f7-a83dd2006549") : secret "monitoring-plugin-cert" not found
Aug 05 17:24:23.168200 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.168167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll5h9\" (UniqueName: \"kubernetes.io/projected/9af91e8e-172a-477e-87f7-a83dd2006549-kube-api-access-ll5h9\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:23.522330 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.522298    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:23.593221 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.593190    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-788447659d-pbx4n"]
Aug 05 17:24:23.595909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.595886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.598414 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.598392    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 05 17:24:23.598750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.598714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 05 17:24:23.599010 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.598989    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 05 17:24:23.599209 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.599193    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tfllf\""
Aug 05 17:24:23.599513 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.599495    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 05 17:24:23.599714 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.599698    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 05 17:24:23.607637 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.606662    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-788447659d-pbx4n"]
Aug 05 17:24:23.607637 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.607221    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 05 17:24:23.662802 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.662764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:23.663876 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:24:23.663034    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Aug 05 17:24:23.663876 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:24:23.663103    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert podName:9af91e8e-172a-477e-87f7-a83dd2006549 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:24.663083903 +0000 UTC m=+113.148007311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-4rvqs" (UID: "9af91e8e-172a-477e-87f7-a83dd2006549") : secret "monitoring-plugin-cert" not found
Aug 05 17:24:23.763608 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-secret-telemeter-client\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.763608 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-federate-client-tls\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.763884 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.763884 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.763884 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-serving-certs-ca-bundle\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.764054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-metrics-client-ca\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.764054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-telemeter-client-tls\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.764054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.763987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6px2h\" (UniqueName: \"kubernetes.io/projected/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-kube-api-access-6px2h\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.864809 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.864720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-serving-certs-ca-bundle\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.864809 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.864777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-metrics-client-ca\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.864809 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.864809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-telemeter-client-tls\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.865099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.864868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6px2h\" (UniqueName: \"kubernetes.io/projected/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-kube-api-access-6px2h\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.865099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.864931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-secret-telemeter-client\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.865099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.864959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-federate-client-tls\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.865099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.864997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.865099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.865042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.865611 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.865585    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-serving-certs-ca-bundle\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.866062 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.866006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-metrics-client-ca\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.866062 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.866006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.868150 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.868099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-secret-telemeter-client\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.868674 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.868285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-telemeter-client-tls\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.868674 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.868637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.869420 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.869391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-federate-client-tls\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.876322 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.876297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6px2h\" (UniqueName: \"kubernetes.io/projected/23de5349-13d2-47d3-b5d9-e57aff2e4c1c-kube-api-access-6px2h\") pod \"telemeter-client-788447659d-pbx4n\" (UID: \"23de5349-13d2-47d3-b5d9-e57aff2e4c1c\") " pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:23.915054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:23.915024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-788447659d-pbx4n"
Aug 05 17:24:24.100643 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.100612    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-788447659d-pbx4n"]
Aug 05 17:24:24.108214 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:24.108180    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23de5349_13d2_47d3_b5d9_e57aff2e4c1c.slice/crio-8315a2a01d8f51deab99126f8b275f59c984b4b9965e23518516c75e70640b0e WatchSource:0}: Error finding container 8315a2a01d8f51deab99126f8b275f59c984b4b9965e23518516c75e70640b0e: Status 404 returned error can't find the container with id 8315a2a01d8f51deab99126f8b275f59c984b4b9965e23518516c75e70640b0e
Aug 05 17:24:24.137104 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.137022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:24.424705 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.424672    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-744bd668c-zhghm"
Aug 05 17:24:24.480308 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.480276    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p6dvk"
Aug 05 17:24:24.533990 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.533422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788447659d-pbx4n" event={"ID":"23de5349-13d2-47d3-b5d9-e57aff2e4c1c","Type":"ContainerStarted","Data":"8315a2a01d8f51deab99126f8b275f59c984b4b9965e23518516c75e70640b0e"}
Aug 05 17:24:24.535960 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.535930    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" event={"ID":"87cdfa10-f5cf-4140-9bf7-2f42a233530b","Type":"ContainerStarted","Data":"5494d239cf87ff31b22ebd0d2806fc323019b8892512dbe6dc327b3d4e109f88"}
Aug 05 17:24:24.536099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.536003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" event={"ID":"87cdfa10-f5cf-4140-9bf7-2f42a233530b","Type":"ContainerStarted","Data":"2ebbf2e6ca2085dbd5a94fcfeaa58ec3e04edd5e2746ce09490e3306f9bc7caa"}
Aug 05 17:24:24.536099 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.536048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" event={"ID":"87cdfa10-f5cf-4140-9bf7-2f42a233530b","Type":"ContainerStarted","Data":"97a922c77b040ce9d3d3966baffc3c573bf2a94cb32ff4d5eb685b0e044524b8"}
Aug 05 17:24:24.579413 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.579381    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:24.674674 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.674497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:24.676905 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.676712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:24.680523 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.680470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9af91e8e-172a-477e-87f7-a83dd2006549-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4rvqs\" (UID: \"9af91e8e-172a-477e-87f7-a83dd2006549\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:24.869474 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:24.869212    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:25.178010 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:25.173291    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"]
Aug 05 17:24:25.544546 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:25.544458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" event={"ID":"87cdfa10-f5cf-4140-9bf7-2f42a233530b","Type":"ContainerStarted","Data":"d63ceadffaa4bcc3b4dc6c974c2aa9cc70d85ee3f958e1ce9234798ff2a1d961"}
Aug 05 17:24:25.544716 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:25.544546    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" event={"ID":"87cdfa10-f5cf-4140-9bf7-2f42a233530b","Type":"ContainerStarted","Data":"8ee84c237e29703b1e2839652ad54a715261f3c5bbd36948e982f10dd1a074d1"}
Aug 05 17:24:25.544716 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:25.544589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" event={"ID":"87cdfa10-f5cf-4140-9bf7-2f42a233530b","Type":"ContainerStarted","Data":"afba82113b4789d412d1018ad45cb5b1e4f8f182e15c1cb2b7d11861e4f0351a"}
Aug 05 17:24:25.544891 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:25.544748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:25.546139 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:25.546111    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs" event={"ID":"9af91e8e-172a-477e-87f7-a83dd2006549","Type":"ContainerStarted","Data":"8d4c1837c3efd2c438a8449a4c9581e04938fea30936e624af9052f36a038eeb"}
Aug 05 17:24:25.568775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:25.568713    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw" podStartSLOduration=1.603428563 podStartE2EDuration="4.568695417s" totalImagesPullingTime="2.965266854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:25.566617666 +0000 UTC m=+114.051541085" watchObservedRunningTime="2026-08-05 17:24:25.568695417 +0000 UTC m=+114.053618880"
Aug 05 17:24:27.561024 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:27.558704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs" event={"ID":"9af91e8e-172a-477e-87f7-a83dd2006549","Type":"ContainerStarted","Data":"5c77ab51f62ffb3c68a6af06ddb518a2ae85ac850e24e06b23f43104589a50eb"}
Aug 05 17:24:27.561514 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:27.561488    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:27.563156 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:27.563133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788447659d-pbx4n" event={"ID":"23de5349-13d2-47d3-b5d9-e57aff2e4c1c","Type":"ContainerStarted","Data":"7c33f9400d9962bb07550db033f40bbd052c47ee8f7311862a6278586802ad91"}
Aug 05 17:24:27.566348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:27.566319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs"
Aug 05 17:24:27.576315 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:27.576261    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4rvqs" podStartSLOduration=3.139104027 podStartE2EDuration="4.576246214s" totalImagesPullingTime="1.437142187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:27.575302446 +0000 UTC m=+116.060225865" watchObservedRunningTime="2026-08-05 17:24:27.576246214 +0000 UTC m=+116.061169633"
Aug 05 17:24:28.479505 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.479472    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-578789cccf-bcdzv"]
Aug 05 17:24:28.481942 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.481918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.486718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.486024    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 05 17:24:28.486718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.486054    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 05 17:24:28.486718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.486070    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 05 17:24:28.486718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.486075    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 05 17:24:28.486718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.486304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kk2v6\""
Aug 05 17:24:28.486718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.486565    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 05 17:24:28.496534 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.496508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-578789cccf-bcdzv"]
Aug 05 17:24:28.518773 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.518737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-oauth-serving-cert\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.518963 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.518781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-service-ca\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.518963 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.518828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2kpl\" (UniqueName: \"kubernetes.io/projected/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-kube-api-access-n2kpl\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.518963 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.518922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-serving-cert\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.519102 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.519023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-config\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.519102 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.519067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-oauth-config\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.569999 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.569494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788447659d-pbx4n" event={"ID":"23de5349-13d2-47d3-b5d9-e57aff2e4c1c","Type":"ContainerStarted","Data":"bb53586cfca0316b3c03aa6eb03659d169767dca7d89c20ec1c6a16d6c2aea0f"}
Aug 05 17:24:28.569999 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.569558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-788447659d-pbx4n" event={"ID":"23de5349-13d2-47d3-b5d9-e57aff2e4c1c","Type":"ContainerStarted","Data":"5916ed7755db7f8a7dd6d35cfc09fd31ef28583aaebfc28a004ffc27ef6296be"}
Aug 05 17:24:28.593610 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.593527    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-788447659d-pbx4n" podStartSLOduration=2.132384001 podStartE2EDuration="5.593509301s" totalImagesPullingTime="3.4611253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:28.592113933 +0000 UTC m=+117.077037357" watchObservedRunningTime="2026-08-05 17:24:28.593509301 +0000 UTC m=+117.078432719"
Aug 05 17:24:28.620226 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.620191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-oauth-config\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.620415 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.620300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-oauth-serving-cert\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.620586 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.620555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-service-ca\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.620711 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.620633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2kpl\" (UniqueName: \"kubernetes.io/projected/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-kube-api-access-n2kpl\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.620915 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.620878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-serving-cert\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.621022 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.620977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-config\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.621412 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.621365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-oauth-serving-cert\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.621412 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.621396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-service-ca\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.621778 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.621759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-config\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.623060 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.623042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-oauth-config\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.623598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.623569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-serving-cert\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.628791 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.628764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2kpl\" (UniqueName: \"kubernetes.io/projected/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-kube-api-access-n2kpl\") pod \"console-578789cccf-bcdzv\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") " pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:28.793065 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:28.792788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:29.302352 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:29.302315    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:29.405128 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:29.405048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:31.560707 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:31.560675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d68667b75-vnqdw"
Aug 05 17:24:32.528189 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:32.528149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:32.630614 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:32.630579    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:33.643117 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:33.643078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:35.337676 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:35.337635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:35.402135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:35.402068    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:35.657874 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:35.657734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-578789cccf-bcdzv"]
Aug 05 17:24:35.660191 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:35.660169    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913bd0ee_f4a2_4cc2_80d8_3d90264f8bce.slice/crio-d529df7560e719fbb4f7eff06593212181c5f2104c0b33d1a9bcebfb51259deb WatchSource:0}: Error finding container d529df7560e719fbb4f7eff06593212181c5f2104c0b33d1a9bcebfb51259deb: Status 404 returned error can't find the container with id d529df7560e719fbb4f7eff06593212181c5f2104c0b33d1a9bcebfb51259deb
Aug 05 17:24:35.662162 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:35.662133    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:35.742398 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:35.742364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:36.314155 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.314112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:36.378675 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.378581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:36.613832 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.613655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-578789cccf-bcdzv" event={"ID":"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce","Type":"ContainerStarted","Data":"d529df7560e719fbb4f7eff06593212181c5f2104c0b33d1a9bcebfb51259deb"}
Aug 05 17:24:36.618966 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.616325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-rdm9n" event={"ID":"4711b734-49cd-4230-a6d6-4e0a8392afa2","Type":"ContainerStarted","Data":"406fe55e2d4a5879f81d25b627d7ccf322fb9dd6a2d2d0e95dbc5883981cde61"}
Aug 05 17:24:36.618966 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.617942    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-rdm9n"
Aug 05 17:24:36.623948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.623907    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-rdm9n"
Aug 05 17:24:36.655356 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.655297    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-rdm9n" podStartSLOduration=2.342659598 podStartE2EDuration="19.65527651s" totalImagesPullingTime="17.312616912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:36.636020171 +0000 UTC m=+125.120943591" watchObservedRunningTime="2026-08-05 17:24:36.65527651 +0000 UTC m=+125.140199928"
Aug 05 17:24:36.952830 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.951391    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-585889549-xj928"]
Aug 05 17:24:36.974207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.974176    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:36.977817 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.977777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585889549-xj928"]
Aug 05 17:24:36.986241 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:36.986210    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 05 17:24:37.107886 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.107434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-oauth-config\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.107886 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.107483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-oauth-serving-cert\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.107886 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.107531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-trusted-ca-bundle\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.107886 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.107568    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-service-ca\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.107886 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.107604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-config\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.107886 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.107627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvn7x\" (UniqueName: \"kubernetes.io/projected/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-kube-api-access-qvn7x\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.107886 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.107674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-serving-cert\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.208737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.208565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-oauth-config\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.208737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.208610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-oauth-serving-cert\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.208737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.208656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-trusted-ca-bundle\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.208737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.208691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-service-ca\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.208737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.208722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-config\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.209160 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.208747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvn7x\" (UniqueName: \"kubernetes.io/projected/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-kube-api-access-qvn7x\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.209160 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.208792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-serving-cert\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.210481 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.210452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-trusted-ca-bundle\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.211413 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.211389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-config\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.212073 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.212042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-oauth-serving-cert\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.214476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.214136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-service-ca\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.228537 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.225613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-serving-cert\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.230737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.228990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-oauth-config\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.233506 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.233474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvn7x\" (UniqueName: \"kubernetes.io/projected/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-kube-api-access-qvn7x\") pod \"console-585889549-xj928\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") " pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.290892 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.289167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:37.306914 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.306876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:37.375504 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.375369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:37.499678 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.499502    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585889549-xj928"]
Aug 05 17:24:37.503536 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:37.503494    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9a3d5a_6a4e_4aa7_8d1a_a01f833be166.slice/crio-079b9f2cb250ca199722f67bc349014712f31b11eddb58c29be6fef40ea1d235 WatchSource:0}: Error finding container 079b9f2cb250ca199722f67bc349014712f31b11eddb58c29be6fef40ea1d235: Status 404 returned error can't find the container with id 079b9f2cb250ca199722f67bc349014712f31b11eddb58c29be6fef40ea1d235
Aug 05 17:24:37.625442 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:37.625377    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585889549-xj928" event={"ID":"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166","Type":"ContainerStarted","Data":"079b9f2cb250ca199722f67bc349014712f31b11eddb58c29be6fef40ea1d235"}
Aug 05 17:24:40.639548 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:40.639479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585889549-xj928" event={"ID":"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166","Type":"ContainerStarted","Data":"fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183"}
Aug 05 17:24:40.641299 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:40.641264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-578789cccf-bcdzv" event={"ID":"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce","Type":"ContainerStarted","Data":"bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343"}
Aug 05 17:24:40.661832 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:40.661770    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-585889549-xj928" podStartSLOduration=2.384385954 podStartE2EDuration="4.661749847s" totalImagesPullingTime="2.277363893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:40.660069037 +0000 UTC m=+129.144992455" watchObservedRunningTime="2026-08-05 17:24:40.661749847 +0000 UTC m=+129.146673267"
Aug 05 17:24:40.687313 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:40.687255    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-578789cccf-bcdzv" podStartSLOduration=8.56702101 podStartE2EDuration="12.687235445s" totalImagesPullingTime="4.120214435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:40.685213031 +0000 UTC m=+129.170136450" watchObservedRunningTime="2026-08-05 17:24:40.687235445 +0000 UTC m=+129.172158937"
Aug 05 17:24:41.512602 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:41.512566    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:41.614496 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:41.614458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:41.855120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:41.855031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:24:41.857671 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:41.857643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac55c236-fd48-44d8-b275-1cda967ca5b2-metrics-certs\") pod \"network-metrics-daemon-l4hvb\" (UID: \"ac55c236-fd48-44d8-b275-1cda967ca5b2\") " pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:24:42.067431 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:42.067402    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l8xxn\""
Aug 05 17:24:42.075655 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:42.075631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4hvb"
Aug 05 17:24:42.281602 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:42.281567    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l4hvb"]
Aug 05 17:24:42.288008 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:24:42.287956    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac55c236_fd48_44d8_b275_1cda967ca5b2.slice/crio-facf7b7603805018fb8c61575f91fef1de6f9e539ec1bbff8012fb830e042427 WatchSource:0}: Error finding container facf7b7603805018fb8c61575f91fef1de6f9e539ec1bbff8012fb830e042427: Status 404 returned error can't find the container with id facf7b7603805018fb8c61575f91fef1de6f9e539ec1bbff8012fb830e042427
Aug 05 17:24:42.644968 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:42.644931    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:42.651622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:42.651590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l4hvb" event={"ID":"ac55c236-fd48-44d8-b275-1cda967ca5b2","Type":"ContainerStarted","Data":"facf7b7603805018fb8c61575f91fef1de6f9e539ec1bbff8012fb830e042427"}
Aug 05 17:24:42.747574 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:42.747529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:44.663590 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:44.663552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l4hvb" event={"ID":"ac55c236-fd48-44d8-b275-1cda967ca5b2","Type":"ContainerStarted","Data":"e2297d3f6675cdb3b0343df081ed80bc237f0eff90f30e0e1e4ebdf2ef8e54c2"}
Aug 05 17:24:44.663979 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:44.663613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l4hvb" event={"ID":"ac55c236-fd48-44d8-b275-1cda967ca5b2","Type":"ContainerStarted","Data":"4a5f8cb3d9da59bc9cfc8bd040cb604aab2698dd64554caa494b5b855bdbddf2"}
Aug 05 17:24:44.682361 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:44.682309    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l4hvb" podStartSLOduration=131.222095792 podStartE2EDuration="2m12.682293958s" totalImagesPullingTime="1.460198166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:44.680636075 +0000 UTC m=+133.165559497" watchObservedRunningTime="2026-08-05 17:24:44.682293958 +0000 UTC m=+133.167217375"
Aug 05 17:24:44.789667 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:44.789636    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:44.854481 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:44.854442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:44.985172 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:44.985140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:45.087936 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:45.087893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:46.370762 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:46.370710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:46.439470 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:46.439435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:47.289639 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:47.289606    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:47.289957 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:47.289675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:47.294553 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:47.294535    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:47.678258 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:47.678234    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585889549-xj928"
Aug 05 17:24:47.728200 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:47.728167    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-578789cccf-bcdzv"]
Aug 05 17:24:47.859746 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:47.859714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:47.960227 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:47.960147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:48.061078 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:48.061045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:48.161443 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:48.161407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:48.599557 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:48.599527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:48.700703 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:48.700676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:48.793526 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:48.793493    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:24:50.334468 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:50.334433    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zgzk2_19e14f0f-27a2-429c-ad0a-79f7da761469/serve-healthcheck-canary/0.log"
Aug 05 17:24:54.226507 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:54.226474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:54.326537 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:54.326507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:54.428016 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:24:54.427980    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:01.380945 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:01.380888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:01.512460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:01.512405    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:12.747827 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:12.747768    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-578789cccf-bcdzv" podUID="913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" containerName="console" containerID="cri-o://bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343" gracePeriod=15
Aug 05 17:25:13.028267 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.028205    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:25:13.120005 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.119976    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-serving-cert\") pod \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") "
Aug 05 17:25:13.120165 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120016    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2kpl\" (UniqueName: \"kubernetes.io/projected/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-kube-api-access-n2kpl\") pod \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") "
Aug 05 17:25:13.120165 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-config\") pod \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") "
Aug 05 17:25:13.120165 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120135    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-oauth-config\") pod \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") "
Aug 05 17:25:13.120290 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120196    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-service-ca\") pod \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") "
Aug 05 17:25:13.120290 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-oauth-serving-cert\") pod \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\" (UID: \"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce\") "
Aug 05 17:25:13.120588 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120540    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-config" (OuterVolumeSpecName: "console-config") pod "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" (UID: "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:25:13.120731 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120585    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-service-ca" (OuterVolumeSpecName: "service-ca") pod "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" (UID: "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:25:13.120731 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.120656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" (UID: "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:25:13.122448 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.122421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" (UID: "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:25:13.122448 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.122434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-kube-api-access-n2kpl" (OuterVolumeSpecName: "kube-api-access-n2kpl") pod "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" (UID: "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce"). InnerVolumeSpecName "kube-api-access-n2kpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:25:13.122582 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.122441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" (UID: "913bd0ee-f4a2-4cc2-80d8-3d90264f8bce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:25:13.221787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.221748    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-config\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:25:13.221787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.221778    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-oauth-config\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:25:13.221787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.221787    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:25:13.221787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.221796    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-oauth-serving-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:25:13.222067 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.221804    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-console-serving-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:25:13.222067 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.221813    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2kpl\" (UniqueName: \"kubernetes.io/projected/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce-kube-api-access-n2kpl\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:25:13.779834 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.779791    2560 generic.go:356] "Generic (PLEG): container finished" podID="913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" containerID="bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343" exitCode=0
Aug 05 17:25:13.780216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.779862    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-578789cccf-bcdzv"
Aug 05 17:25:13.780216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.779883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-578789cccf-bcdzv" event={"ID":"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce","Type":"ContainerDied","Data":"bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343"}
Aug 05 17:25:13.780216 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.779941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-578789cccf-bcdzv" event={"ID":"913bd0ee-f4a2-4cc2-80d8-3d90264f8bce","Type":"ContainerDied","Data":"d529df7560e719fbb4f7eff06593212181c5f2104c0b33d1a9bcebfb51259deb"}
Aug 05 17:25:13.796320 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.796301    2560 scope.go:117] "RemoveContainer" containerID="bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343"
Aug 05 17:25:13.799388 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.799364    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-578789cccf-bcdzv"]
Aug 05 17:25:13.803673 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.803650    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-578789cccf-bcdzv"]
Aug 05 17:25:13.805816 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.805801    2560 scope.go:117] "RemoveContainer" containerID="bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343"
Aug 05 17:25:13.806124 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:25:13.806103    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343\": container with ID starting with bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343 not found: ID does not exist" containerID="bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343"
Aug 05 17:25:13.806170 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:13.806133    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343"} err="failed to get container status \"bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343\": rpc error: code = NotFound desc = could not find container \"bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343\": container with ID starting with bdb853f310f2b14928bbd2c428ebb56e5d25d0da6767589e7faecffb81166343 not found: ID does not exist"
Aug 05 17:25:14.058772 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:14.058694    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" path="/var/lib/kubelet/pods/913bd0ee-f4a2-4cc2-80d8-3d90264f8bce/volumes"
Aug 05 17:25:34.524204 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:34.524166    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:34.625718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:34.625679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:38.314561 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.314525    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cd6cf6885-tr97k"]
Aug 05 17:25:38.315016 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.314923    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" containerName="console"
Aug 05 17:25:38.315016 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.314939    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" containerName="console"
Aug 05 17:25:38.315107 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.315043    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="913bd0ee-f4a2-4cc2-80d8-3d90264f8bce" containerName="console"
Aug 05 17:25:38.318007 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.317989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.329388 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.329365    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd6cf6885-tr97k"]
Aug 05 17:25:38.372825 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.372794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:38.437512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.437479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-oauth-serving-cert\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.437616 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.437519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-oauth-config\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.437616 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.437563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-serving-cert\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.437616 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.437585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-trusted-ca-bundle\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.437616 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.437607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-service-ca\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.437737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.437625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-config\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.437737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.437718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442lk\" (UniqueName: \"kubernetes.io/projected/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-kube-api-access-442lk\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.476113 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.476063    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:38.538726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.538693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-oauth-config\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.538832 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.538750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-serving-cert\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.538832 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.538774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-trusted-ca-bundle\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.538832 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.538800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-service-ca\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.538832 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.538817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-config\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.539043 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.538896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442lk\" (UniqueName: \"kubernetes.io/projected/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-kube-api-access-442lk\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.539043 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.538926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-oauth-serving-cert\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.539618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.539586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-config\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.539814 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.539792    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-oauth-serving-cert\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.539925 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.539904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-service-ca\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.539977 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.539962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-trusted-ca-bundle\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.541413 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.541392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-oauth-config\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.541513 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.541420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-serving-cert\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.547588 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.547555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-442lk\" (UniqueName: \"kubernetes.io/projected/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-kube-api-access-442lk\") pod \"console-5cd6cf6885-tr97k\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") " pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.627610 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.627521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:38.756256 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.756175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd6cf6885-tr97k"]
Aug 05 17:25:38.759064 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:25:38.759035    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373f0f86_821b_4aa5_8a85_517b2c7ce6a0.slice/crio-fbbcbad299f6e3657e5606dfa07d4142df11a927b4b3d75edf7dd3354b2ee13b WatchSource:0}: Error finding container fbbcbad299f6e3657e5606dfa07d4142df11a927b4b3d75edf7dd3354b2ee13b: Status 404 returned error can't find the container with id fbbcbad299f6e3657e5606dfa07d4142df11a927b4b3d75edf7dd3354b2ee13b
Aug 05 17:25:38.878257 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.878172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd6cf6885-tr97k" event={"ID":"373f0f86-821b-4aa5-8a85-517b2c7ce6a0","Type":"ContainerStarted","Data":"940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c"}
Aug 05 17:25:38.878257 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.878223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd6cf6885-tr97k" event={"ID":"373f0f86-821b-4aa5-8a85-517b2c7ce6a0","Type":"ContainerStarted","Data":"fbbcbad299f6e3657e5606dfa07d4142df11a927b4b3d75edf7dd3354b2ee13b"}
Aug 05 17:25:38.899447 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:38.899389    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cd6cf6885-tr97k" podStartSLOduration=0.899373266 podStartE2EDuration="899.373266ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:38.898329192 +0000 UTC m=+187.383252611" watchObservedRunningTime="2026-08-05 17:25:38.899373266 +0000 UTC m=+187.384296683"
Aug 05 17:25:40.884635 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.884597    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 17:25:40.887829 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.887803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.890191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890171    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 05 17:25:40.890300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890198    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 05 17:25:40.890521 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890503    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 05 17:25:40.890579 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890555    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 05 17:25:40.890638 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890622    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 05 17:25:40.890689 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890634    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 05 17:25:40.890689 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890637    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 05 17:25:40.890689 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890643    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x6vvb\""
Aug 05 17:25:40.890806 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.890739    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 05 17:25:40.894336 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.894319    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 05 17:25:40.901787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.901764    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 17:25:40.961322 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-config-volume\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961322 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f94fe3f8-45eb-4adf-831c-f41c13d60775-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-web-config\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6249\" (UniqueName: \"kubernetes.io/projected/f94fe3f8-45eb-4adf-831c-f41c13d60775-kube-api-access-t6249\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f94fe3f8-45eb-4adf-831c-f41c13d60775-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f94fe3f8-45eb-4adf-831c-f41c13d60775-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f94fe3f8-45eb-4adf-831c-f41c13d60775-config-out\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:40.961840 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:40.961700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f94fe3f8-45eb-4adf-831c-f41c13d60775-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f94fe3f8-45eb-4adf-831c-f41c13d60775-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062509 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-config-volume\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062641    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f94fe3f8-45eb-4adf-831c-f41c13d60775-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062732 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062781 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062781 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-web-config\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.062970 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.062925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f94fe3f8-45eb-4adf-831c-f41c13d60775-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.063100 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.063069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6249\" (UniqueName: \"kubernetes.io/projected/f94fe3f8-45eb-4adf-831c-f41c13d60775-kube-api-access-t6249\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.063233 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.063125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f94fe3f8-45eb-4adf-831c-f41c13d60775-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.063233 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.063182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f94fe3f8-45eb-4adf-831c-f41c13d60775-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.063233 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.063209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f94fe3f8-45eb-4adf-831c-f41c13d60775-config-out\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.063233 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.063231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.063555 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.063534    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f94fe3f8-45eb-4adf-831c-f41c13d60775-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066035 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.065937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066035 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.065937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-config-volume\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.066086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.066166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066291 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.066196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-web-config\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066374 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.066355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f94fe3f8-45eb-4adf-831c-f41c13d60775-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066415 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.066388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066569 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.066548    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f94fe3f8-45eb-4adf-831c-f41c13d60775-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.066709 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.066691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f94fe3f8-45eb-4adf-831c-f41c13d60775-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.068047 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.068027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f94fe3f8-45eb-4adf-831c-f41c13d60775-config-out\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.074813 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.074796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6249\" (UniqueName: \"kubernetes.io/projected/f94fe3f8-45eb-4adf-831c-f41c13d60775-kube-api-access-t6249\") pod \"alertmanager-main-0\" (UID: \"f94fe3f8-45eb-4adf-831c-f41c13d60775\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.198223 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.198190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 17:25:41.337677 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.337631    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 17:25:41.341273 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:25:41.341245    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94fe3f8_45eb_4adf_831c_f41c13d60775.slice/crio-2cf9dcad464b8eb7c355291c8e0445cd50da9744e0fca314cd40d78d9169e352 WatchSource:0}: Error finding container 2cf9dcad464b8eb7c355291c8e0445cd50da9744e0fca314cd40d78d9169e352: Status 404 returned error can't find the container with id 2cf9dcad464b8eb7c355291c8e0445cd50da9744e0fca314cd40d78d9169e352
Aug 05 17:25:41.891247 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.891206    2560 generic.go:356] "Generic (PLEG): container finished" podID="f94fe3f8-45eb-4adf-831c-f41c13d60775" containerID="60961a9e00a91b760e1b1322118cd32762f11c90de099c4aa4ee6245902638b8" exitCode=0
Aug 05 17:25:41.891616 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.891281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerDied","Data":"60961a9e00a91b760e1b1322118cd32762f11c90de099c4aa4ee6245902638b8"}
Aug 05 17:25:41.891616 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:41.891349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerStarted","Data":"2cf9dcad464b8eb7c355291c8e0445cd50da9744e0fca314cd40d78d9169e352"}
Aug 05 17:25:43.904057 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:43.904020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerStarted","Data":"9e0365e5fe6a19aff6ba87fe1ac94fe7e53209e8e6a8580029d4e984c9dca2b6"}
Aug 05 17:25:43.904476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:43.904085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerStarted","Data":"4bfd32c82e2e9c8bbf43e1d77b0e8278907235dc4d98c94930ec6cb4fcbeedb1"}
Aug 05 17:25:43.904476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:43.904111    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerStarted","Data":"387d12e72e8a43e2c773974cd104ac25bf31dc82f503ea802af917deb30c01d5"}
Aug 05 17:25:43.904476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:43.904135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerStarted","Data":"4f9beccf8805d05132487c65bc65ad4d59fc067b7a7f32d7d47c3556ccfe29a9"}
Aug 05 17:25:43.904476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:43.904165    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerStarted","Data":"83c2cc73a5e7b9fb79f6a4ff2bae149911f1fe1ceef3587aadad3f3f7018a75a"}
Aug 05 17:25:43.904476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:43.904187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f94fe3f8-45eb-4adf-831c-f41c13d60775","Type":"ContainerStarted","Data":"4b1d8d74546e3a67131821d1d3a9c01b6b0e7062f60b067e80a8ee3ef53997f5"}
Aug 05 17:25:43.937482 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:43.937434    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.297242076 podStartE2EDuration="3.937418087s" totalImagesPullingTime="1.620225988s" totalInitContainerRuntime="19.950023ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:43.935428581 +0000 UTC m=+192.420352009" watchObservedRunningTime="2026-08-05 17:25:43.937418087 +0000 UTC m=+192.422341505"
Aug 05 17:25:46.582993 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:46.582957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:46.667321 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:46.667275    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:46.872414 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:46.872334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:46.950828 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:46.950796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:48.627699 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:48.627664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:48.628128 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:48.627723    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:48.632274 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:48.632253    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:48.927278 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:48.927251    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:25:48.979756 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:48.979725    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585889549-xj928"]
Aug 05 17:25:49.091479 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:49.091440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:49.193236 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:49.193152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:49.264415 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:25:49.264383    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:01.379243 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:01.379208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:01.480334 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:01.480301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:13.999063 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:13.999027    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-585889549-xj928" podUID="9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" containerName="console" containerID="cri-o://fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183" gracePeriod=15
Aug 05 17:26:14.244932 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.244908    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585889549-xj928"
Aug 05 17:26:14.327067 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.326982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-trusted-ca-bundle\") pod \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") "
Aug 05 17:26:14.327067 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327024    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-config\") pod \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") "
Aug 05 17:26:14.327067 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327042    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvn7x\" (UniqueName: \"kubernetes.io/projected/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-kube-api-access-qvn7x\") pod \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") "
Aug 05 17:26:14.327311 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327086    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-service-ca\") pod \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") "
Aug 05 17:26:14.327311 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327134    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-oauth-config\") pod \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") "
Aug 05 17:26:14.327311 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327165    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-serving-cert\") pod \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") "
Aug 05 17:26:14.327311 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-oauth-serving-cert\") pod \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\" (UID: \"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166\") "
Aug 05 17:26:14.327539 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327504    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-config" (OuterVolumeSpecName: "console-config") pod "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" (UID: "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:26:14.327661 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327632    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" (UID: "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:26:14.327661 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327460    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" (UID: "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:26:14.327750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.327694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" (UID: "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:26:14.329333 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.329306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-kube-api-access-qvn7x" (OuterVolumeSpecName: "kube-api-access-qvn7x") pod "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" (UID: "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166"). InnerVolumeSpecName "kube-api-access-qvn7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:26:14.329493 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.329473    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" (UID: "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:26:14.329548 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.329525    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" (UID: "9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:26:14.435705 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.435670    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-trusted-ca-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:26:14.435705 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.435706    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-config\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:26:14.435957 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.435717    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvn7x\" (UniqueName: \"kubernetes.io/projected/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-kube-api-access-qvn7x\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:26:14.435957 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.435727    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:26:14.435957 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.435735    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-oauth-config\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:26:14.435957 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.435743    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-console-serving-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:26:14.435957 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:14.435751    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166-oauth-serving-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:26:15.028234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.028192    2560 generic.go:356] "Generic (PLEG): container finished" podID="9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" containerID="fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183" exitCode=0
Aug 05 17:26:15.028712 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.028262    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585889549-xj928"
Aug 05 17:26:15.028712 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.028266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585889549-xj928" event={"ID":"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166","Type":"ContainerDied","Data":"fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183"}
Aug 05 17:26:15.028712 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.028401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585889549-xj928" event={"ID":"9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166","Type":"ContainerDied","Data":"079b9f2cb250ca199722f67bc349014712f31b11eddb58c29be6fef40ea1d235"}
Aug 05 17:26:15.028712 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.028421    2560 scope.go:117] "RemoveContainer" containerID="fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183"
Aug 05 17:26:15.037019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.037001    2560 scope.go:117] "RemoveContainer" containerID="fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183"
Aug 05 17:26:15.037296 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:26:15.037277    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183\": container with ID starting with fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183 not found: ID does not exist" containerID="fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183"
Aug 05 17:26:15.037345 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.037308    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183"} err="failed to get container status \"fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183\": rpc error: code = NotFound desc = could not find container \"fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183\": container with ID starting with fd4f60f77b6fd3830d475723ae66f17dee6a9c2778440ff7d559294d0e5e2183 not found: ID does not exist"
Aug 05 17:26:15.048171 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.048147    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585889549-xj928"]
Aug 05 17:26:15.051979 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:15.051960    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-585889549-xj928"]
Aug 05 17:26:16.059702 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:16.059670    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" path="/var/lib/kubelet/pods/9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166/volumes"
Aug 05 17:26:20.458069 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:20.458038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:20.513217 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:26:20.513181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:27:21.474807 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:21.474763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:27:31.893892 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:31.893867    2560 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 17:27:44.646525 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:44.646488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:27:44.747337 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:44.747300    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:27:45.660080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.660044    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"]
Aug 05 17:27:45.660485 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.660369    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" containerName="console"
Aug 05 17:27:45.660485 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.660381    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" containerName="console"
Aug 05 17:27:45.660485 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.660434    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9a3d5a-6a4e-4aa7-8d1a-a01f833be166" containerName="console"
Aug 05 17:27:45.662485 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.662470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.665426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.665408    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:27:45.665426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.665418    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:27:45.666334 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.666318    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gxsp4\""
Aug 05 17:27:45.676504 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.676479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"]
Aug 05 17:27:45.712251 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.712209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljxqn\" (UniqueName: \"kubernetes.io/projected/fabc9b33-9926-4756-8665-429d52129752-kube-api-access-ljxqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.712422 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.712266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.712422 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.712332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.813193 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.813157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljxqn\" (UniqueName: \"kubernetes.io/projected/fabc9b33-9926-4756-8665-429d52129752-kube-api-access-ljxqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.813304 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.813230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.813304 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.813267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.813629 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.813608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.813668 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.813650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.822338 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.822307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljxqn\" (UniqueName: \"kubernetes.io/projected/fabc9b33-9926-4756-8665-429d52129752-kube-api-access-ljxqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:45.972154 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:45.972108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:27:46.108136 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:46.108096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"]
Aug 05 17:27:46.114306 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:27:46.114276    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabc9b33_9926_4756_8665_429d52129752.slice/crio-06251a05bfe994840bbb74ee99f44e2aa1d3dcd1f92af9c1e98d7bc122aff366 WatchSource:0}: Error finding container 06251a05bfe994840bbb74ee99f44e2aa1d3dcd1f92af9c1e98d7bc122aff366: Status 404 returned error can't find the container with id 06251a05bfe994840bbb74ee99f44e2aa1d3dcd1f92af9c1e98d7bc122aff366
Aug 05 17:27:46.116306 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:46.116289    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:27:46.374485 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:46.374396    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz" event={"ID":"fabc9b33-9926-4756-8665-429d52129752","Type":"ContainerStarted","Data":"06251a05bfe994840bbb74ee99f44e2aa1d3dcd1f92af9c1e98d7bc122aff366"}
Aug 05 17:27:52.402367 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:52.402328    2560 generic.go:356] "Generic (PLEG): container finished" podID="fabc9b33-9926-4756-8665-429d52129752" containerID="e5152f6cb637e325576d81803f3b91e318ac9c8b8326a5ba390a0ae1bedb469b" exitCode=0
Aug 05 17:27:52.402792 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:52.402415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz" event={"ID":"fabc9b33-9926-4756-8665-429d52129752","Type":"ContainerDied","Data":"e5152f6cb637e325576d81803f3b91e318ac9c8b8326a5ba390a0ae1bedb469b"}
Aug 05 17:27:55.416647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:55.416605    2560 generic.go:356] "Generic (PLEG): container finished" podID="fabc9b33-9926-4756-8665-429d52129752" containerID="3cdfd71421b98e9e2212e5ec0b04b25fb0e6a41cd5ea572697bd5a09596f6746" exitCode=0
Aug 05 17:27:55.417049 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:27:55.416680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz" event={"ID":"fabc9b33-9926-4756-8665-429d52129752","Type":"ContainerDied","Data":"3cdfd71421b98e9e2212e5ec0b04b25fb0e6a41cd5ea572697bd5a09596f6746"}
Aug 05 17:28:02.451549 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:02.451509    2560 generic.go:356] "Generic (PLEG): container finished" podID="fabc9b33-9926-4756-8665-429d52129752" containerID="a19f93f492d3cf7872a0a542eb034dbdd24206d843038ecdd6123ef8f13a60a1" exitCode=0
Aug 05 17:28:02.451977 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:02.451574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz" event={"ID":"fabc9b33-9926-4756-8665-429d52129752","Type":"ContainerDied","Data":"a19f93f492d3cf7872a0a542eb034dbdd24206d843038ecdd6123ef8f13a60a1"}
Aug 05 17:28:03.592185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.592163    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:28:03.677418 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.677377    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-bundle\") pod \"fabc9b33-9926-4756-8665-429d52129752\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") "
Aug 05 17:28:03.677613 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.677438    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-util\") pod \"fabc9b33-9926-4756-8665-429d52129752\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") "
Aug 05 17:28:03.677613 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.677468    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljxqn\" (UniqueName: \"kubernetes.io/projected/fabc9b33-9926-4756-8665-429d52129752-kube-api-access-ljxqn\") pod \"fabc9b33-9926-4756-8665-429d52129752\" (UID: \"fabc9b33-9926-4756-8665-429d52129752\") "
Aug 05 17:28:03.678253 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.678217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-bundle" (OuterVolumeSpecName: "bundle") pod "fabc9b33-9926-4756-8665-429d52129752" (UID: "fabc9b33-9926-4756-8665-429d52129752"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:28:03.679836 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.679815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabc9b33-9926-4756-8665-429d52129752-kube-api-access-ljxqn" (OuterVolumeSpecName: "kube-api-access-ljxqn") pod "fabc9b33-9926-4756-8665-429d52129752" (UID: "fabc9b33-9926-4756-8665-429d52129752"). InnerVolumeSpecName "kube-api-access-ljxqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:28:03.682058 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.682039    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-util" (OuterVolumeSpecName: "util") pod "fabc9b33-9926-4756-8665-429d52129752" (UID: "fabc9b33-9926-4756-8665-429d52129752"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:28:03.778948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.778839    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:03.778948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.778890    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fabc9b33-9926-4756-8665-429d52129752-util\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:03.778948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:03.778903    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljxqn\" (UniqueName: \"kubernetes.io/projected/fabc9b33-9926-4756-8665-429d52129752-kube-api-access-ljxqn\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:04.461730 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:04.461703    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz"
Aug 05 17:28:04.461730 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:04.461719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tz7lz" event={"ID":"fabc9b33-9926-4756-8665-429d52129752","Type":"ContainerDied","Data":"06251a05bfe994840bbb74ee99f44e2aa1d3dcd1f92af9c1e98d7bc122aff366"}
Aug 05 17:28:04.461957 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:04.461759    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06251a05bfe994840bbb74ee99f44e2aa1d3dcd1f92af9c1e98d7bc122aff366"
Aug 05 17:28:04.752110 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:04.752026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:06.161765 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:06.161732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:06.685780 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:06.685738    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:06.842071 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:06.842031    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:06.943989 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:06.943907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:07.665076 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:07.665037    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:08.723542 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723507    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"]
Aug 05 17:28:08.723958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723811    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabc9b33-9926-4756-8665-429d52129752" containerName="extract"
Aug 05 17:28:08.723958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723821    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabc9b33-9926-4756-8665-429d52129752" containerName="extract"
Aug 05 17:28:08.723958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723840    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabc9b33-9926-4756-8665-429d52129752" containerName="util"
Aug 05 17:28:08.723958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723874    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabc9b33-9926-4756-8665-429d52129752" containerName="util"
Aug 05 17:28:08.723958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723896    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabc9b33-9926-4756-8665-429d52129752" containerName="pull"
Aug 05 17:28:08.723958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723903    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabc9b33-9926-4756-8665-429d52129752" containerName="pull"
Aug 05 17:28:08.723958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.723952    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fabc9b33-9926-4756-8665-429d52129752" containerName="extract"
Aug 05 17:28:08.769424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.769381    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"]
Aug 05 17:28:08.769592 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.769476    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:08.771800 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.771775    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 05 17:28:08.771800 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.771780    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:28:08.772053 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.771804    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d8sql\""
Aug 05 17:28:08.877221 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.877186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:08.923335 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.923304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580e14c3-4c63-480c-8593-74ed26c58583-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hxm4j\" (UID: \"580e14c3-4c63-480c-8593-74ed26c58583\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:08.923484 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.923373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxnvg\" (UniqueName: \"kubernetes.io/projected/580e14c3-4c63-480c-8593-74ed26c58583-kube-api-access-cxnvg\") pod \"cert-manager-operator-controller-manager-55c444bf86-hxm4j\" (UID: \"580e14c3-4c63-480c-8593-74ed26c58583\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:08.979751 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:08.979662    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:09.024755 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:09.024729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580e14c3-4c63-480c-8593-74ed26c58583-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hxm4j\" (UID: \"580e14c3-4c63-480c-8593-74ed26c58583\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:09.024922 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:09.024784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxnvg\" (UniqueName: \"kubernetes.io/projected/580e14c3-4c63-480c-8593-74ed26c58583-kube-api-access-cxnvg\") pod \"cert-manager-operator-controller-manager-55c444bf86-hxm4j\" (UID: \"580e14c3-4c63-480c-8593-74ed26c58583\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:09.025137 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:09.025119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580e14c3-4c63-480c-8593-74ed26c58583-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hxm4j\" (UID: \"580e14c3-4c63-480c-8593-74ed26c58583\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:09.033483 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:09.033455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxnvg\" (UniqueName: \"kubernetes.io/projected/580e14c3-4c63-480c-8593-74ed26c58583-kube-api-access-cxnvg\") pod \"cert-manager-operator-controller-manager-55c444bf86-hxm4j\" (UID: \"580e14c3-4c63-480c-8593-74ed26c58583\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:09.079223 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:09.079184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"
Aug 05 17:28:09.241713 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:09.241684    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j"]
Aug 05 17:28:09.244301 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:28:09.244274    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580e14c3_4c63_480c_8593_74ed26c58583.slice/crio-287a23f42a47b7016e8e8f373cbc7de52a625a9512bf9386418ada1bc75e5eef WatchSource:0}: Error finding container 287a23f42a47b7016e8e8f373cbc7de52a625a9512bf9386418ada1bc75e5eef: Status 404 returned error can't find the container with id 287a23f42a47b7016e8e8f373cbc7de52a625a9512bf9386418ada1bc75e5eef
Aug 05 17:28:09.483553 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:09.483524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j" event={"ID":"580e14c3-4c63-480c-8593-74ed26c58583","Type":"ContainerStarted","Data":"287a23f42a47b7016e8e8f373cbc7de52a625a9512bf9386418ada1bc75e5eef"}
Aug 05 17:28:10.289068 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:10.289023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:10.393364 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:10.393323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:12.498618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:12.498577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j" event={"ID":"580e14c3-4c63-480c-8593-74ed26c58583","Type":"ContainerStarted","Data":"31d2b67fac6537a5e531c3ab1505f059a596b57640de3357b507342c7b586a9b"}
Aug 05 17:28:12.520826 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:12.520769    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hxm4j" podStartSLOduration=1.870602383 podStartE2EDuration="4.520748917s" totalImagesPullingTime="2.650146534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:12.519547954 +0000 UTC m=+341.004471384" watchObservedRunningTime="2026-08-05 17:28:12.520748917 +0000 UTC m=+341.005672338"
Aug 05 17:28:12.592362 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:12.592318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:12.683274 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:12.683213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:12.881390 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:12.881291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:12.995989 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:12.995957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:13.195057 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.195027    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"]
Aug 05 17:28:13.214467 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.214443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"]
Aug 05 17:28:13.214618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.214546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.217227 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.217204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:28:13.217362 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.217204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:28:13.217362 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.217268    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gxsp4\""
Aug 05 17:28:13.362066 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.362026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.362066 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.362071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rph98\" (UniqueName: \"kubernetes.io/projected/a4919263-1005-456e-8a53-a8a009fa3d4f-kube-api-access-rph98\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.362289 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.362160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.463621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.463528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.463621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.463584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.463621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.463619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rph98\" (UniqueName: \"kubernetes.io/projected/a4919263-1005-456e-8a53-a8a009fa3d4f-kube-api-access-rph98\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.464019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.463954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.464019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.463979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.472243 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.472211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rph98\" (UniqueName: \"kubernetes.io/projected/a4919263-1005-456e-8a53-a8a009fa3d4f-kube-api-access-rph98\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.525345 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.525311    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:13.559945 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.559904    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pkgnv"]
Aug 05 17:28:13.582618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.582587    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pkgnv"]
Aug 05 17:28:13.582788 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.582721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:13.585606 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.585577    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 05 17:28:13.585606 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.585594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 05 17:28:13.585801 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.585616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mxj9v\""
Aug 05 17:28:13.665395 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.665363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3450db9-78af-400f-8396-e4abdeaffda4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pkgnv\" (UID: \"c3450db9-78af-400f-8396-e4abdeaffda4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:13.665528 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.665502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8gc\" (UniqueName: \"kubernetes.io/projected/c3450db9-78af-400f-8396-e4abdeaffda4-kube-api-access-wv8gc\") pod \"cert-manager-webhook-6486ffd997-pkgnv\" (UID: \"c3450db9-78af-400f-8396-e4abdeaffda4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:13.682193 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.682138    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"]
Aug 05 17:28:13.684725 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:28:13.684693    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4919263_1005_456e_8a53_a8a009fa3d4f.slice/crio-7e6e2149e9b411067b8574b532f77c3162e83b9dd3b7a12102342d7974958872 WatchSource:0}: Error finding container 7e6e2149e9b411067b8574b532f77c3162e83b9dd3b7a12102342d7974958872: Status 404 returned error can't find the container with id 7e6e2149e9b411067b8574b532f77c3162e83b9dd3b7a12102342d7974958872
Aug 05 17:28:13.766759 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.766735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3450db9-78af-400f-8396-e4abdeaffda4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pkgnv\" (UID: \"c3450db9-78af-400f-8396-e4abdeaffda4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:13.766901 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.766798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8gc\" (UniqueName: \"kubernetes.io/projected/c3450db9-78af-400f-8396-e4abdeaffda4-kube-api-access-wv8gc\") pod \"cert-manager-webhook-6486ffd997-pkgnv\" (UID: \"c3450db9-78af-400f-8396-e4abdeaffda4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:13.776395 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.776375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3450db9-78af-400f-8396-e4abdeaffda4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pkgnv\" (UID: \"c3450db9-78af-400f-8396-e4abdeaffda4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:13.776490 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.776400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8gc\" (UniqueName: \"kubernetes.io/projected/c3450db9-78af-400f-8396-e4abdeaffda4-kube-api-access-wv8gc\") pod \"cert-manager-webhook-6486ffd997-pkgnv\" (UID: \"c3450db9-78af-400f-8396-e4abdeaffda4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:13.904304 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:13.904272    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:14.049859 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:14.049811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pkgnv"]
Aug 05 17:28:14.052976 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:28:14.052952    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3450db9_78af_400f_8396_e4abdeaffda4.slice/crio-be1c3bfc59e1415845b99fd6503af7d5c7039ccb5d33bf9f1cd67421b62c1628 WatchSource:0}: Error finding container be1c3bfc59e1415845b99fd6503af7d5c7039ccb5d33bf9f1cd67421b62c1628: Status 404 returned error can't find the container with id be1c3bfc59e1415845b99fd6503af7d5c7039ccb5d33bf9f1cd67421b62c1628
Aug 05 17:28:14.511348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:14.511314    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerID="a405a4c145c506374b39d68c7c1ed48753a4299784456b11d7e5217f144c8c9d" exitCode=0
Aug 05 17:28:14.511541 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:14.511409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw" event={"ID":"a4919263-1005-456e-8a53-a8a009fa3d4f","Type":"ContainerDied","Data":"a405a4c145c506374b39d68c7c1ed48753a4299784456b11d7e5217f144c8c9d"}
Aug 05 17:28:14.511541 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:14.511499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw" event={"ID":"a4919263-1005-456e-8a53-a8a009fa3d4f","Type":"ContainerStarted","Data":"7e6e2149e9b411067b8574b532f77c3162e83b9dd3b7a12102342d7974958872"}
Aug 05 17:28:14.512930 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:14.512873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv" event={"ID":"c3450db9-78af-400f-8396-e4abdeaffda4","Type":"ContainerStarted","Data":"be1c3bfc59e1415845b99fd6503af7d5c7039ccb5d33bf9f1cd67421b62c1628"}
Aug 05 17:28:14.582409 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:14.582379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:14.974155 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:14.974094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:17.489342 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:17.489302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:17.530447 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:17.530415    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerID="458fb5b6f34519beaa420b260ddcadc4ee43c8f1ab68572edc6be6c0f1c2fe8b" exitCode=0
Aug 05 17:28:17.530606 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:17.530509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw" event={"ID":"a4919263-1005-456e-8a53-a8a009fa3d4f","Type":"ContainerDied","Data":"458fb5b6f34519beaa420b260ddcadc4ee43c8f1ab68572edc6be6c0f1c2fe8b"}
Aug 05 17:28:17.532241 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:17.532221    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv" event={"ID":"c3450db9-78af-400f-8396-e4abdeaffda4","Type":"ContainerStarted","Data":"f4874d454281659d8815ba5dad9845b3f7ea422837dbd5d13926d06688413d88"}
Aug 05 17:28:17.532358 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:17.532343    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:17.551050 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:17.551018    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:17.564452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:17.564379    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv" podStartSLOduration=1.310716839 podStartE2EDuration="4.564367379s" totalImagesPullingTime="3.25365054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:17.563425885 +0000 UTC m=+346.048349328" watchObservedRunningTime="2026-08-05 17:28:17.564367379 +0000 UTC m=+346.049290797"
Aug 05 17:28:18.538486 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:18.538453    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerID="70e79a774a0bd7d0e232b936b850c2cc7c710e875ba62a8e95e831862e70b1c8" exitCode=0
Aug 05 17:28:18.538963 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:18.538538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw" event={"ID":"a4919263-1005-456e-8a53-a8a009fa3d4f","Type":"ContainerDied","Data":"70e79a774a0bd7d0e232b936b850c2cc7c710e875ba62a8e95e831862e70b1c8"}
Aug 05 17:28:19.262060 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.262031    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:19.324802 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.324762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:19.676043 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.676021    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:19.821566 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.821471    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rph98\" (UniqueName: \"kubernetes.io/projected/a4919263-1005-456e-8a53-a8a009fa3d4f-kube-api-access-rph98\") pod \"a4919263-1005-456e-8a53-a8a009fa3d4f\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") "
Aug 05 17:28:19.821566 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.821519    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-bundle\") pod \"a4919263-1005-456e-8a53-a8a009fa3d4f\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") "
Aug 05 17:28:19.821788 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.821642    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-util\") pod \"a4919263-1005-456e-8a53-a8a009fa3d4f\" (UID: \"a4919263-1005-456e-8a53-a8a009fa3d4f\") "
Aug 05 17:28:19.821983 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.821960    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-bundle" (OuterVolumeSpecName: "bundle") pod "a4919263-1005-456e-8a53-a8a009fa3d4f" (UID: "a4919263-1005-456e-8a53-a8a009fa3d4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:28:19.823811 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.823789    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4919263-1005-456e-8a53-a8a009fa3d4f-kube-api-access-rph98" (OuterVolumeSpecName: "kube-api-access-rph98") pod "a4919263-1005-456e-8a53-a8a009fa3d4f" (UID: "a4919263-1005-456e-8a53-a8a009fa3d4f"). InnerVolumeSpecName "kube-api-access-rph98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:28:19.825763 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.825740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-util" (OuterVolumeSpecName: "util") pod "a4919263-1005-456e-8a53-a8a009fa3d4f" (UID: "a4919263-1005-456e-8a53-a8a009fa3d4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:28:19.923174 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.923138    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-util\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:19.923174 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.923168    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rph98\" (UniqueName: \"kubernetes.io/projected/a4919263-1005-456e-8a53-a8a009fa3d4f-kube-api-access-rph98\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:19.923174 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:19.923179    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4919263-1005-456e-8a53-a8a009fa3d4f-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:20.549397 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:20.549365    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw"
Aug 05 17:28:20.549565 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:20.549399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq48tw" event={"ID":"a4919263-1005-456e-8a53-a8a009fa3d4f","Type":"ContainerDied","Data":"7e6e2149e9b411067b8574b532f77c3162e83b9dd3b7a12102342d7974958872"}
Aug 05 17:28:20.549565 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:20.549445    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e6e2149e9b411067b8574b532f77c3162e83b9dd3b7a12102342d7974958872"
Aug 05 17:28:23.392762 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:23.392668    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:23.541449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:23.541425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pkgnv"
Aug 05 17:28:28.889282 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:28.889242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:28.991153 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:28.991114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:30.955391 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955359    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"]
Aug 05 17:28:30.955768 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955665    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerName="util"
Aug 05 17:28:30.955768 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955676    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerName="util"
Aug 05 17:28:30.955768 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955693    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerName="extract"
Aug 05 17:28:30.955768 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955699    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerName="extract"
Aug 05 17:28:30.955768 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955712    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerName="pull"
Aug 05 17:28:30.955768 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955719    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerName="pull"
Aug 05 17:28:30.955985 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.955775    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4919263-1005-456e-8a53-a8a009fa3d4f" containerName="extract"
Aug 05 17:28:30.957837 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.957823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:30.960238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.960213    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 05 17:28:30.960238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.960237    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wkgkf\""
Aug 05 17:28:30.960492 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.960282    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:28:30.967585 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:30.967564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"]
Aug 05 17:28:31.017699 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.017668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87dcfad8-d5e0-4ffa-9e65-905070a0caed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s86kv\" (UID: \"87dcfad8-d5e0-4ffa-9e65-905070a0caed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:31.017877 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.017720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84w8s\" (UniqueName: \"kubernetes.io/projected/87dcfad8-d5e0-4ffa-9e65-905070a0caed-kube-api-access-84w8s\") pod \"openshift-lws-operator-fd8ccff4c-s86kv\" (UID: \"87dcfad8-d5e0-4ffa-9e65-905070a0caed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:31.119149 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.119110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87dcfad8-d5e0-4ffa-9e65-905070a0caed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s86kv\" (UID: \"87dcfad8-d5e0-4ffa-9e65-905070a0caed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:31.119364 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.119345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84w8s\" (UniqueName: \"kubernetes.io/projected/87dcfad8-d5e0-4ffa-9e65-905070a0caed-kube-api-access-84w8s\") pod \"openshift-lws-operator-fd8ccff4c-s86kv\" (UID: \"87dcfad8-d5e0-4ffa-9e65-905070a0caed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:31.119540 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.119517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87dcfad8-d5e0-4ffa-9e65-905070a0caed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s86kv\" (UID: \"87dcfad8-d5e0-4ffa-9e65-905070a0caed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:31.128176 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.128147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84w8s\" (UniqueName: \"kubernetes.io/projected/87dcfad8-d5e0-4ffa-9e65-905070a0caed-kube-api-access-84w8s\") pod \"openshift-lws-operator-fd8ccff4c-s86kv\" (UID: \"87dcfad8-d5e0-4ffa-9e65-905070a0caed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:31.267588 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.267499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"
Aug 05 17:28:31.401417 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.401391    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv"]
Aug 05 17:28:31.403314 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:28:31.403286    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87dcfad8_d5e0_4ffa_9e65_905070a0caed.slice/crio-b8e16c35ff5bdc641c9a9a8d8730d6e8b40a24b4c261f7fa1a276d4dea1e19e8 WatchSource:0}: Error finding container b8e16c35ff5bdc641c9a9a8d8730d6e8b40a24b4c261f7fa1a276d4dea1e19e8: Status 404 returned error can't find the container with id b8e16c35ff5bdc641c9a9a8d8730d6e8b40a24b4c261f7fa1a276d4dea1e19e8
Aug 05 17:28:31.601778 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:31.601695    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv" event={"ID":"87dcfad8-d5e0-4ffa-9e65-905070a0caed","Type":"ContainerStarted","Data":"b8e16c35ff5bdc641c9a9a8d8730d6e8b40a24b4c261f7fa1a276d4dea1e19e8"}
Aug 05 17:28:33.614454 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:33.614360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv" event={"ID":"87dcfad8-d5e0-4ffa-9e65-905070a0caed","Type":"ContainerStarted","Data":"477993d903d0d102952190c749b257e93715eb25582acb9c0f9a7dee42cc51bd"}
Aug 05 17:28:33.631546 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:33.631493    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s86kv" podStartSLOduration=1.733625989 podStartE2EDuration="3.631476919s" totalImagesPullingTime="1.89785093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:33.630020864 +0000 UTC m=+362.114944285" watchObservedRunningTime="2026-08-05 17:28:33.631476919 +0000 UTC m=+362.116400339"
Aug 05 17:28:34.239710 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:34.239674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:34.341382 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:34.341341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:35.789675 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.789645    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"]
Aug 05 17:28:35.792525 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.792510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.795273 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.795248    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:28:35.796394 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.796369    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:28:35.796525 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.796369    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gxsp4\""
Aug 05 17:28:35.801908 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.801884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"]
Aug 05 17:28:35.850982 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.850944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.850982 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.850986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd74z\" (UniqueName: \"kubernetes.io/projected/6dfd1d5d-4751-421f-805e-43f8cb38e124-kube-api-access-hd74z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.851204 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.851013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.951558 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.951517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.951558 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.951564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd74z\" (UniqueName: \"kubernetes.io/projected/6dfd1d5d-4751-421f-805e-43f8cb38e124-kube-api-access-hd74z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.951785 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.951593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.951984 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.951965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.952032 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.952006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:35.960551 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:35.960524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd74z\" (UniqueName: \"kubernetes.io/projected/6dfd1d5d-4751-421f-805e-43f8cb38e124-kube-api-access-hd74z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:36.102593 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:36.102503    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:36.256633 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:36.256584    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"]
Aug 05 17:28:36.259384 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:28:36.259355    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfd1d5d_4751_421f_805e_43f8cb38e124.slice/crio-8a10fcddc16d5a55fdc9f1ea5a5ac48686bc67446a0dd7d8501b5cf12701cba7 WatchSource:0}: Error finding container 8a10fcddc16d5a55fdc9f1ea5a5ac48686bc67446a0dd7d8501b5cf12701cba7: Status 404 returned error can't find the container with id 8a10fcddc16d5a55fdc9f1ea5a5ac48686bc67446a0dd7d8501b5cf12701cba7
Aug 05 17:28:36.272740 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:36.272708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:36.631255 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:36.631173    2560 generic.go:356] "Generic (PLEG): container finished" podID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerID="074f475a53ba9dc6cffa141092585374c19ebd3d711580bfd6f0affc82a228de" exitCode=0
Aug 05 17:28:36.631255 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:36.631228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4" event={"ID":"6dfd1d5d-4751-421f-805e-43f8cb38e124","Type":"ContainerDied","Data":"074f475a53ba9dc6cffa141092585374c19ebd3d711580bfd6f0affc82a228de"}
Aug 05 17:28:36.631432 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:36.631277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4" event={"ID":"6dfd1d5d-4751-421f-805e-43f8cb38e124","Type":"ContainerStarted","Data":"8a10fcddc16d5a55fdc9f1ea5a5ac48686bc67446a0dd7d8501b5cf12701cba7"}
Aug 05 17:28:37.637747 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:37.637710    2560 generic.go:356] "Generic (PLEG): container finished" podID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerID="5b3858cfe7298381b0f5679f9ad8748f0bb38610dea5ab782405073c5e47ee7b" exitCode=0
Aug 05 17:28:37.637747 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:37.637752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4" event={"ID":"6dfd1d5d-4751-421f-805e-43f8cb38e124","Type":"ContainerDied","Data":"5b3858cfe7298381b0f5679f9ad8748f0bb38610dea5ab782405073c5e47ee7b"}
Aug 05 17:28:38.644566 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:38.644533    2560 generic.go:356] "Generic (PLEG): container finished" podID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerID="ebd098c84f40e2104cc7f1fa88e582ccd913094687bb5a82dd2c0637add0ba85" exitCode=0
Aug 05 17:28:38.644969 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:38.644619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4" event={"ID":"6dfd1d5d-4751-421f-805e-43f8cb38e124","Type":"ContainerDied","Data":"ebd098c84f40e2104cc7f1fa88e582ccd913094687bb5a82dd2c0637add0ba85"}
Aug 05 17:28:39.775760 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.775729    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:39.792408 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.792382    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-util\") pod \"6dfd1d5d-4751-421f-805e-43f8cb38e124\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") "
Aug 05 17:28:39.792603 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.792441    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd74z\" (UniqueName: \"kubernetes.io/projected/6dfd1d5d-4751-421f-805e-43f8cb38e124-kube-api-access-hd74z\") pod \"6dfd1d5d-4751-421f-805e-43f8cb38e124\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") "
Aug 05 17:28:39.792603 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.792489    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-bundle\") pod \"6dfd1d5d-4751-421f-805e-43f8cb38e124\" (UID: \"6dfd1d5d-4751-421f-805e-43f8cb38e124\") "
Aug 05 17:28:39.793707 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.793678    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-bundle" (OuterVolumeSpecName: "bundle") pod "6dfd1d5d-4751-421f-805e-43f8cb38e124" (UID: "6dfd1d5d-4751-421f-805e-43f8cb38e124"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:28:39.795549 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.795510    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dfd1d5d-4751-421f-805e-43f8cb38e124-kube-api-access-hd74z" (OuterVolumeSpecName: "kube-api-access-hd74z") pod "6dfd1d5d-4751-421f-805e-43f8cb38e124" (UID: "6dfd1d5d-4751-421f-805e-43f8cb38e124"). InnerVolumeSpecName "kube-api-access-hd74z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:28:39.801353 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.801327    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-util" (OuterVolumeSpecName: "util") pod "6dfd1d5d-4751-421f-805e-43f8cb38e124" (UID: "6dfd1d5d-4751-421f-805e-43f8cb38e124"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:28:39.893109 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.893073    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-util\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:39.893109 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.893103    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd74z\" (UniqueName: \"kubernetes.io/projected/6dfd1d5d-4751-421f-805e-43f8cb38e124-kube-api-access-hd74z\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:39.893109 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:39.893112    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dfd1d5d-4751-421f-805e-43f8cb38e124-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:28:40.654631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:40.654596    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4"
Aug 05 17:28:40.654631 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:40.654613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm7rz4" event={"ID":"6dfd1d5d-4751-421f-805e-43f8cb38e124","Type":"ContainerDied","Data":"8a10fcddc16d5a55fdc9f1ea5a5ac48686bc67446a0dd7d8501b5cf12701cba7"}
Aug 05 17:28:40.654833 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:40.654665    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a10fcddc16d5a55fdc9f1ea5a5ac48686bc67446a0dd7d8501b5cf12701cba7"
Aug 05 17:28:49.116282 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:49.116243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:49.209628 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:49.209593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:49.719510 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:49.719467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:49.965723 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:49.965689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.044982 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.044901    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"]
Aug 05 17:28:50.045256 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.045244    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerName="util"
Aug 05 17:28:50.045300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.045258    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerName="util"
Aug 05 17:28:50.045300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.045266    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerName="pull"
Aug 05 17:28:50.045300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.045271    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerName="pull"
Aug 05 17:28:50.045300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.045283    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerName="extract"
Aug 05 17:28:50.045300 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.045288    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerName="extract"
Aug 05 17:28:50.045450 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.045340    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dfd1d5d-4751-421f-805e-43f8cb38e124" containerName="extract"
Aug 05 17:28:50.052288 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.052262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.054904 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.054876    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 17:28:50.055035 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.054911    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 17:28:50.055260 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.055241    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 17:28:50.055344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.055280    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6px7q\""
Aug 05 17:28:50.055389 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.055281    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 17:28:50.064471 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.064445    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"]
Aug 05 17:28:50.064707 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.064679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.081507 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.081459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/496e5b22-194a-49b5-a471-9985c35d0faf-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.081683 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.081532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/496e5b22-194a-49b5-a471-9985c35d0faf-manifests\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.081683 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.081588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/496e5b22-194a-49b5-a471-9985c35d0faf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.081683 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.081659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rngzv\" (UniqueName: \"kubernetes.io/projected/496e5b22-194a-49b5-a471-9985c35d0faf-kube-api-access-rngzv\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.081683 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.081682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496e5b22-194a-49b5-a471-9985c35d0faf-tmp\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.182990 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.182960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/496e5b22-194a-49b5-a471-9985c35d0faf-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.183440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.183001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/496e5b22-194a-49b5-a471-9985c35d0faf-manifests\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.183440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.183030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/496e5b22-194a-49b5-a471-9985c35d0faf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.183440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.183081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rngzv\" (UniqueName: \"kubernetes.io/projected/496e5b22-194a-49b5-a471-9985c35d0faf-kube-api-access-rngzv\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.183440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.183105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496e5b22-194a-49b5-a471-9985c35d0faf-tmp\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.183440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.183428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/496e5b22-194a-49b5-a471-9985c35d0faf-manifests\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.185531 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.185498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496e5b22-194a-49b5-a471-9985c35d0faf-tmp\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.185681 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.185661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/496e5b22-194a-49b5-a471-9985c35d0faf-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.185762 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.185746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/496e5b22-194a-49b5-a471-9985c35d0faf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.215910 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.215874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rngzv\" (UniqueName: \"kubernetes.io/projected/496e5b22-194a-49b5-a471-9985c35d0faf-kube-api-access-rngzv\") pod \"opendatahub-operator-controller-manager-7cc69f54b9-9f9v2\" (UID: \"496e5b22-194a-49b5-a471-9985c35d0faf\") " pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.240250 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.240217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.347648 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.347564    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.363565 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.363540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:50.441753 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.441717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.508361 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.508330    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"]
Aug 05 17:28:50.512032 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:28:50.512007    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496e5b22_194a_49b5_a471_9985c35d0faf.slice/crio-82df1913c554148071cac78f625b8d83721fdf6236648a1acde70472118ac2fa WatchSource:0}: Error finding container 82df1913c554148071cac78f625b8d83721fdf6236648a1acde70472118ac2fa: Status 404 returned error can't find the container with id 82df1913c554148071cac78f625b8d83721fdf6236648a1acde70472118ac2fa
Aug 05 17:28:50.539064 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.539003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.624527 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.624434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.704424 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.704388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2" event={"ID":"496e5b22-194a-49b5-a471-9985c35d0faf","Type":"ContainerStarted","Data":"82df1913c554148071cac78f625b8d83721fdf6236648a1acde70472118ac2fa"}
Aug 05 17:28:50.717254 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.717211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:50.818594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:50.818549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:52.625789 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:52.625753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:52.730748 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:52.730715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:53.723766 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:53.723731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2" event={"ID":"496e5b22-194a-49b5-a471-9985c35d0faf","Type":"ContainerStarted","Data":"eb1bf386cb04225fa8ffbbbfbbbdb8b86d6047eff95d93cba59227b96c7d6c77"}
Aug 05 17:28:54.730457 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:54.730426    2560 generic.go:356] "Generic (PLEG): container finished" podID="496e5b22-194a-49b5-a471-9985c35d0faf" containerID="eb1bf386cb04225fa8ffbbbfbbbdb8b86d6047eff95d93cba59227b96c7d6c77" exitCode=0
Aug 05 17:28:54.730868 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:54.730535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2" event={"ID":"496e5b22-194a-49b5-a471-9985c35d0faf","Type":"ContainerDied","Data":"eb1bf386cb04225fa8ffbbbfbbbdb8b86d6047eff95d93cba59227b96c7d6c77"}
Aug 05 17:28:55.736586 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:55.736555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2" event={"ID":"496e5b22-194a-49b5-a471-9985c35d0faf","Type":"ContainerStarted","Data":"ce3e1484e73efead96dc8ed2bc92b7c20484575a6e3c89e0f54efe9411a25d83"}
Aug 05 17:28:55.737006 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:55.736679    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:28:55.760236 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:55.760182    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2" podStartSLOduration=1.306456072 podStartE2EDuration="5.760165851s" totalImagesPullingTime="3.437653637s" totalInitContainerRuntime="1.016056142s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:55.758407414 +0000 UTC m=+384.243330843" watchObservedRunningTime="2026-08-05 17:28:55.760165851 +0000 UTC m=+384.245089270"
Aug 05 17:28:57.756726 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:28:57.756678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:06.744656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:06.744622    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cc69f54b9-9f9v2"
Aug 05 17:29:09.134017 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.133984    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"]
Aug 05 17:29:09.144160 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.144137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.148684 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.148665    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 05 17:29:09.151087 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.150804    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 05 17:29:09.151548 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.151529    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jj7gz\""
Aug 05 17:29:09.152326 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.152309    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 05 17:29:09.170072 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.170039    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"]
Aug 05 17:29:09.253708 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.253677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a4623e-c177-464f-90b8-b484df975e5a-cert\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.253889 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.253715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2a4623e-c177-464f-90b8-b484df975e5a-metrics-cert\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.253889 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.253771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2a4623e-c177-464f-90b8-b484df975e5a-manager-config\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.254026 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.253913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx7fk\" (UniqueName: \"kubernetes.io/projected/f2a4623e-c177-464f-90b8-b484df975e5a-kube-api-access-vx7fk\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.285363 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.285330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:09.355033 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.354997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a4623e-c177-464f-90b8-b484df975e5a-cert\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.355033 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.355036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2a4623e-c177-464f-90b8-b484df975e5a-metrics-cert\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.355254 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.355061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2a4623e-c177-464f-90b8-b484df975e5a-manager-config\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.355254 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.355111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx7fk\" (UniqueName: \"kubernetes.io/projected/f2a4623e-c177-464f-90b8-b484df975e5a-kube-api-access-vx7fk\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.355937 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.355912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2a4623e-c177-464f-90b8-b484df975e5a-manager-config\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.358612 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.358586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2a4623e-c177-464f-90b8-b484df975e5a-metrics-cert\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.358720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.358642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a4623e-c177-464f-90b8-b484df975e5a-cert\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.365572 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.365541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx7fk\" (UniqueName: \"kubernetes.io/projected/f2a4623e-c177-464f-90b8-b484df975e5a-kube-api-access-vx7fk\") pod \"lws-controller-manager-57fd6d5d59-zn598\" (UID: \"f2a4623e-c177-464f-90b8-b484df975e5a\") " pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.389427 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.389324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:09.454633 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.454591    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:09.611473 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.611450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"]
Aug 05 17:29:09.614362 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:29:09.614322    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a4623e_c177_464f_90b8_b484df975e5a.slice/crio-2ba12f601d0dc9615e62687b01e77dc241f96223b729e34821eb6939d33e0def WatchSource:0}: Error finding container 2ba12f601d0dc9615e62687b01e77dc241f96223b729e34821eb6939d33e0def: Status 404 returned error can't find the container with id 2ba12f601d0dc9615e62687b01e77dc241f96223b729e34821eb6939d33e0def
Aug 05 17:29:09.806896 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.806837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598" event={"ID":"f2a4623e-c177-464f-90b8-b484df975e5a","Type":"ContainerStarted","Data":"2ba12f601d0dc9615e62687b01e77dc241f96223b729e34821eb6939d33e0def"}
Aug 05 17:29:09.935431 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:09.935398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:10.108663 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:10.108580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:10.210701 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:10.210664    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:10.312351 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:10.312313    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:10.568108 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:10.568067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:10.938629 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:10.938578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:11.213065 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:11.212926    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:11.310666 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:11.310617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:11.413715 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:11.413680    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:11.818443 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:11.818329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598" event={"ID":"f2a4623e-c177-464f-90b8-b484df975e5a","Type":"ContainerStarted","Data":"fb0e19b85902b210647650a635af542709c9f45800bd0c7f7f630a3d2fe009ec"}
Aug 05 17:29:11.818443 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:11.818391    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:11.836434 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:11.836382    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598" podStartSLOduration=0.93056161 podStartE2EDuration="2.836364515s" totalImagesPullingTime="1.905802905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:29:11.834485831 +0000 UTC m=+400.319409251" watchObservedRunningTime="2026-08-05 17:29:11.836364515 +0000 UTC m=+400.321287934"
Aug 05 17:29:12.276312 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:12.276269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:18.042494 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.042455    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"]
Aug 05 17:29:18.046907 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.046884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.074273 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.074246    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 05 17:29:18.074492 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.074450    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 17:29:18.074564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.074513    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kxsv8\""
Aug 05 17:29:18.077366 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.077347    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 17:29:18.077477 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.077368    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 05 17:29:18.082536 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.082507    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"]
Aug 05 17:29:18.082818 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.082800    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 17:29:18.091881 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.091830    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 05 17:29:18.133664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.133623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:18.220008 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.219958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:18.236220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.236186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.236357 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.236236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.236357 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.236261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf6sd\" (UniqueName: \"kubernetes.io/projected/20c06c53-8211-4061-88dd-91ca84d54ce5-kube-api-access-rf6sd\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.236357 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.236338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c06c53-8211-4061-88dd-91ca84d54ce5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.236519 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.236400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.236519 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.236453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.236598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.236522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.337949 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.337797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.337949 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.337915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.337949 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.337948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.338246 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.337975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf6sd\" (UniqueName: \"kubernetes.io/projected/20c06c53-8211-4061-88dd-91ca84d54ce5-kube-api-access-rf6sd\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.338246 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.338012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c06c53-8211-4061-88dd-91ca84d54ce5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.338246 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.338053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.338246 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.338078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.338677 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.338647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.340571 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.340544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.340659 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.340641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.340995 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.340964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c06c53-8211-4061-88dd-91ca84d54ce5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.341119 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.341100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.357360 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.357321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20c06c53-8211-4061-88dd-91ca84d54ce5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.357716 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.357698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf6sd\" (UniqueName: \"kubernetes.io/projected/20c06c53-8211-4061-88dd-91ca84d54ce5-kube-api-access-rf6sd\") pod \"istiod-openshift-gateway-5677ccb49b-s85mq\" (UID: \"20c06c53-8211-4061-88dd-91ca84d54ce5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.657393 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.657292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:18.832924 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:29:18.832887    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c06c53_8211_4061_88dd_91ca84d54ce5.slice/crio-afde8bb19eaf46959725a8d5561d29dbb708b4a6ddad1b0936ef13299a23f1e5 WatchSource:0}: Error finding container afde8bb19eaf46959725a8d5561d29dbb708b4a6ddad1b0936ef13299a23f1e5: Status 404 returned error can't find the container with id afde8bb19eaf46959725a8d5561d29dbb708b4a6ddad1b0936ef13299a23f1e5
Aug 05 17:29:18.833545 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.833521    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"]
Aug 05 17:29:18.855731 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:18.855698    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq" event={"ID":"20c06c53-8211-4061-88dd-91ca84d54ce5","Type":"ContainerStarted","Data":"afde8bb19eaf46959725a8d5561d29dbb708b4a6ddad1b0936ef13299a23f1e5"}
Aug 05 17:29:19.002516 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:19.002469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:19.251700 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:19.251670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:19.443161 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:19.443100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:21.124415 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.124375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:21.234438 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.234390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:21.330464 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.330412    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:29:21.330609 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.330512    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:29:21.441377 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.441339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:21.680338 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.680295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:21.876976 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.876941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq" event={"ID":"20c06c53-8211-4061-88dd-91ca84d54ce5","Type":"ContainerStarted","Data":"dc7ba5a500770f84156c9de46e2df36e27f3a7dbe3288f3b872c5a7ff3f5fab2"}
Aug 05 17:29:21.877189 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.877063    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:21.901368 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:21.901314    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq" podStartSLOduration=1.406592869 podStartE2EDuration="3.901295779s" totalImagesPullingTime="2.49470291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:29:21.898721736 +0000 UTC m=+410.383645156" watchObservedRunningTime="2026-08-05 17:29:21.901295779 +0000 UTC m=+410.386219197"
Aug 05 17:29:22.401552 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:22.401507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:22.501327 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:22.501291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:22.827297 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:22.827266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57fd6d5d59-zn598"
Aug 05 17:29:22.884578 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:22.884545    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s85mq"
Aug 05 17:29:41.212248 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:29:41.212205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:10.829569 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:10.829531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:10.927639 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:10.927598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:14.437932 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.437893    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"]
Aug 05 17:30:14.445193 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.445169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.448031 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.447989    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:30:14.448190 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.448002    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:30:14.448496 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.448438    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gxsp4\""
Aug 05 17:30:14.450305 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.450283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"]
Aug 05 17:30:14.530590 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.530554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bbgw\" (UniqueName: \"kubernetes.io/projected/868bb1b8-1263-42f8-897a-adfb6859abdd-kube-api-access-6bbgw\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.530784 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.530622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.530784 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.530660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.549938 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.549902    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"]
Aug 05 17:30:14.557144 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.557111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.558571 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.558548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"]
Aug 05 17:30:14.631441 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.631441 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.631689 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.631689 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bbgw\" (UniqueName: \"kubernetes.io/projected/868bb1b8-1263-42f8-897a-adfb6859abdd-kube-api-access-6bbgw\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.631689 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.631689 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkhbb\" (UniqueName: \"kubernetes.io/projected/31c91b14-337d-4987-839c-a46767b0a05a-kube-api-access-zkhbb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.631973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.631973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.631924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.636604 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.636580    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"]
Aug 05 17:30:14.639705 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.639684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bbgw\" (UniqueName: \"kubernetes.io/projected/868bb1b8-1263-42f8-897a-adfb6859abdd-kube-api-access-6bbgw\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.640456 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.640440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.648224 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.648204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"]
Aug 05 17:30:14.732187 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.732187 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkhbb\" (UniqueName: \"kubernetes.io/projected/31c91b14-337d-4987-839c-a46767b0a05a-kube-api-access-zkhbb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.732187 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.732512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.732512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx5ml\" (UniqueName: \"kubernetes.io/projected/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-kube-api-access-tx5ml\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.732512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.732512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.732758 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.732583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.742978 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.742949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkhbb\" (UniqueName: \"kubernetes.io/projected/31c91b14-337d-4987-839c-a46767b0a05a-kube-api-access-zkhbb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.746281 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.746253    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"]
Aug 05 17:30:14.750825 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.750805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.757078 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.757056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:14.757178 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.757082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"]
Aug 05 17:30:14.833298 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.833269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.833476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.833311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.833476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.833350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s79b2\" (UniqueName: \"kubernetes.io/projected/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-kube-api-access-s79b2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.833476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.833392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.833476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.833428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx5ml\" (UniqueName: \"kubernetes.io/projected/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-kube-api-access-tx5ml\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.833476 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.833459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.834001 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.833980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.834124 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.834041    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.842072 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.842044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx5ml\" (UniqueName: \"kubernetes.io/projected/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-kube-api-access-tx5ml\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:14.871249 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.870908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:14.908528 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.908498    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"]
Aug 05 17:30:14.910257 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:30:14.910234    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868bb1b8_1263_42f8_897a_adfb6859abdd.slice/crio-360c11407c4612e77d0b901d81f68c689dd29f0c030cfe88f66967729f6dec0b WatchSource:0}: Error finding container 360c11407c4612e77d0b901d81f68c689dd29f0c030cfe88f66967729f6dec0b: Status 404 returned error can't find the container with id 360c11407c4612e77d0b901d81f68c689dd29f0c030cfe88f66967729f6dec0b
Aug 05 17:30:14.934243 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.934218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.934349 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.934283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s79b2\" (UniqueName: \"kubernetes.io/projected/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-kube-api-access-s79b2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.934349 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.934331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.934649 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.934622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.934716 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.934636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.943771 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.943746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s79b2\" (UniqueName: \"kubernetes.io/projected/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-kube-api-access-s79b2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:14.956839 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:14.956806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:15.029312 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.029276    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"]
Aug 05 17:30:15.036315 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:30:15.035596    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c91b14_337d_4987_839c_a46767b0a05a.slice/crio-cff6494dab65664f96c9368e445423a08675664a8d8f443878e8a9b55d10164a WatchSource:0}: Error finding container cff6494dab65664f96c9368e445423a08675664a8d8f443878e8a9b55d10164a: Status 404 returned error can't find the container with id cff6494dab65664f96c9368e445423a08675664a8d8f443878e8a9b55d10164a
Aug 05 17:30:15.063158 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.063135    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:15.121541 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.121416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"]
Aug 05 17:30:15.126079 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:30:15.126046    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cedec73_76ee_42e7_a5b6_6c902d5d7c93.slice/crio-0b1cf5327bc29d26a5358e5bde70fffdc31a9520edde28bebaba4cd0c60d60dc WatchSource:0}: Error finding container 0b1cf5327bc29d26a5358e5bde70fffdc31a9520edde28bebaba4cd0c60d60dc: Status 404 returned error can't find the container with id 0b1cf5327bc29d26a5358e5bde70fffdc31a9520edde28bebaba4cd0c60d60dc
Aug 05 17:30:15.147092 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.147048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr" event={"ID":"31c91b14-337d-4987-839c-a46767b0a05a","Type":"ContainerStarted","Data":"a1784bcc623435261bf17a4f8691a0950ff485598f100ed3766da30abb6a55bd"}
Aug 05 17:30:15.147262 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.147120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr" event={"ID":"31c91b14-337d-4987-839c-a46767b0a05a","Type":"ContainerStarted","Data":"cff6494dab65664f96c9368e445423a08675664a8d8f443878e8a9b55d10164a"}
Aug 05 17:30:15.148955 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.148825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8" event={"ID":"4cedec73-76ee-42e7-a5b6-6c902d5d7c93","Type":"ContainerStarted","Data":"0b1cf5327bc29d26a5358e5bde70fffdc31a9520edde28bebaba4cd0c60d60dc"}
Aug 05 17:30:15.150711 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.150631    2560 generic.go:356] "Generic (PLEG): container finished" podID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerID="4bafcf474068f464877091d62d02d773ff63af45db2f21b6ceb1d006aee39994" exitCode=0
Aug 05 17:30:15.150830 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.150721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv" event={"ID":"868bb1b8-1263-42f8-897a-adfb6859abdd","Type":"ContainerDied","Data":"4bafcf474068f464877091d62d02d773ff63af45db2f21b6ceb1d006aee39994"}
Aug 05 17:30:15.150830 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.150781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv" event={"ID":"868bb1b8-1263-42f8-897a-adfb6859abdd","Type":"ContainerStarted","Data":"360c11407c4612e77d0b901d81f68c689dd29f0c030cfe88f66967729f6dec0b"}
Aug 05 17:30:15.227533 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:15.227508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"]
Aug 05 17:30:15.229369 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:30:15.229339    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1c707e_a81d_4d52_b3da_7f9bedfdf2d3.slice/crio-3541dd270dd9d6a772875e581ecf0a0a769abc139ca78b0f7b4f643e9fbb432f WatchSource:0}: Error finding container 3541dd270dd9d6a772875e581ecf0a0a769abc139ca78b0f7b4f643e9fbb432f: Status 404 returned error can't find the container with id 3541dd270dd9d6a772875e581ecf0a0a769abc139ca78b0f7b4f643e9fbb432f
Aug 05 17:30:16.157715 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.157681    2560 generic.go:356] "Generic (PLEG): container finished" podID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerID="85e4950d54c08959bd428da1441f7dee6af99b5bd50623f2e2369f0a9ac89f71" exitCode=0
Aug 05 17:30:16.158171 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.157782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8" event={"ID":"4cedec73-76ee-42e7-a5b6-6c902d5d7c93","Type":"ContainerDied","Data":"85e4950d54c08959bd428da1441f7dee6af99b5bd50623f2e2369f0a9ac89f71"}
Aug 05 17:30:16.159770 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.159744    2560 generic.go:356] "Generic (PLEG): container finished" podID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerID="43918fd3d1ccdbb48b8afced5c9efab724bd32e0a0c5b813eceff34c88fd1193" exitCode=0
Aug 05 17:30:16.159918 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.159867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv" event={"ID":"868bb1b8-1263-42f8-897a-adfb6859abdd","Type":"ContainerDied","Data":"43918fd3d1ccdbb48b8afced5c9efab724bd32e0a0c5b813eceff34c88fd1193"}
Aug 05 17:30:16.161520 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.161489    2560 generic.go:356] "Generic (PLEG): container finished" podID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerID="11f9e77867a1a7a2c034c785eef5c40e5a0633c61e5e2ae8450dc5872e509f41" exitCode=0
Aug 05 17:30:16.161609 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.161574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds" event={"ID":"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3","Type":"ContainerDied","Data":"11f9e77867a1a7a2c034c785eef5c40e5a0633c61e5e2ae8450dc5872e509f41"}
Aug 05 17:30:16.161672 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.161622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds" event={"ID":"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3","Type":"ContainerStarted","Data":"3541dd270dd9d6a772875e581ecf0a0a769abc139ca78b0f7b4f643e9fbb432f"}
Aug 05 17:30:16.163219 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.163201    2560 generic.go:356] "Generic (PLEG): container finished" podID="31c91b14-337d-4987-839c-a46767b0a05a" containerID="a1784bcc623435261bf17a4f8691a0950ff485598f100ed3766da30abb6a55bd" exitCode=0
Aug 05 17:30:16.163297 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:16.163227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr" event={"ID":"31c91b14-337d-4987-839c-a46767b0a05a","Type":"ContainerDied","Data":"a1784bcc623435261bf17a4f8691a0950ff485598f100ed3766da30abb6a55bd"}
Aug 05 17:30:17.171720 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:17.171689    2560 generic.go:356] "Generic (PLEG): container finished" podID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerID="93de26f29be9695a263323f0034f7e9a7ee6b33819634c133f5fabd89b618b01" exitCode=0
Aug 05 17:30:17.172225 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:17.171774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv" event={"ID":"868bb1b8-1263-42f8-897a-adfb6859abdd","Type":"ContainerDied","Data":"93de26f29be9695a263323f0034f7e9a7ee6b33819634c133f5fabd89b618b01"}
Aug 05 17:30:17.173690 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:17.173666    2560 generic.go:356] "Generic (PLEG): container finished" podID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerID="33ff41eaf32eff134e8440c7e5e606b6b31fcfcba41d68c798c6db9aaebe05b9" exitCode=0
Aug 05 17:30:17.173805 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:17.173744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds" event={"ID":"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3","Type":"ContainerDied","Data":"33ff41eaf32eff134e8440c7e5e606b6b31fcfcba41d68c798c6db9aaebe05b9"}
Aug 05 17:30:18.181372 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.181338    2560 generic.go:356] "Generic (PLEG): container finished" podID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerID="9bbf45de9736c74cd47707b3b1f99baee19fd81a392f3dc618f3bad2ca795e0f" exitCode=0
Aug 05 17:30:18.181799 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.181425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds" event={"ID":"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3","Type":"ContainerDied","Data":"9bbf45de9736c74cd47707b3b1f99baee19fd81a392f3dc618f3bad2ca795e0f"}
Aug 05 17:30:18.313899 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.313876    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:18.368285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.368249    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-util\") pod \"868bb1b8-1263-42f8-897a-adfb6859abdd\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") "
Aug 05 17:30:18.368285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.368294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-bundle\") pod \"868bb1b8-1263-42f8-897a-adfb6859abdd\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") "
Aug 05 17:30:18.368499 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.368337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bbgw\" (UniqueName: \"kubernetes.io/projected/868bb1b8-1263-42f8-897a-adfb6859abdd-kube-api-access-6bbgw\") pod \"868bb1b8-1263-42f8-897a-adfb6859abdd\" (UID: \"868bb1b8-1263-42f8-897a-adfb6859abdd\") "
Aug 05 17:30:18.368867 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.368814    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-bundle" (OuterVolumeSpecName: "bundle") pod "868bb1b8-1263-42f8-897a-adfb6859abdd" (UID: "868bb1b8-1263-42f8-897a-adfb6859abdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:18.370619 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.370598    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/868bb1b8-1263-42f8-897a-adfb6859abdd-kube-api-access-6bbgw" (OuterVolumeSpecName: "kube-api-access-6bbgw") pod "868bb1b8-1263-42f8-897a-adfb6859abdd" (UID: "868bb1b8-1263-42f8-897a-adfb6859abdd"). InnerVolumeSpecName "kube-api-access-6bbgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:30:18.373673 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.373639    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-util" (OuterVolumeSpecName: "util") pod "868bb1b8-1263-42f8-897a-adfb6859abdd" (UID: "868bb1b8-1263-42f8-897a-adfb6859abdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:18.469257 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.469173    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-util\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:18.469257 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.469202    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868bb1b8-1263-42f8-897a-adfb6859abdd-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:18.469257 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:18.469212    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bbgw\" (UniqueName: \"kubernetes.io/projected/868bb1b8-1263-42f8-897a-adfb6859abdd-kube-api-access-6bbgw\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:19.189193 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.189154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv" event={"ID":"868bb1b8-1263-42f8-897a-adfb6859abdd","Type":"ContainerDied","Data":"360c11407c4612e77d0b901d81f68c689dd29f0c030cfe88f66967729f6dec0b"}
Aug 05 17:30:19.189193 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.189188    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbrn9bv"
Aug 05 17:30:19.189635 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.189207    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="360c11407c4612e77d0b901d81f68c689dd29f0c030cfe88f66967729f6dec0b"
Aug 05 17:30:19.324417 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.324394    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:19.377209 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.377176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s79b2\" (UniqueName: \"kubernetes.io/projected/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-kube-api-access-s79b2\") pod \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") "
Aug 05 17:30:19.377375 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.377304    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-bundle\") pod \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") "
Aug 05 17:30:19.377375 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.377335    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-util\") pod \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\" (UID: \"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3\") "
Aug 05 17:30:19.377912 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.377881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-bundle" (OuterVolumeSpecName: "bundle") pod "6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" (UID: "6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:19.379331 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.379304    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-kube-api-access-s79b2" (OuterVolumeSpecName: "kube-api-access-s79b2") pod "6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" (UID: "6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3"). InnerVolumeSpecName "kube-api-access-s79b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:30:19.382921 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.382901    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-util" (OuterVolumeSpecName: "util") pod "6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" (UID: "6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:19.478487 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.478389    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s79b2\" (UniqueName: \"kubernetes.io/projected/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-kube-api-access-s79b2\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:19.478487 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.478431    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:19.478487 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:19.478442    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3-util\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:20.196281 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:20.196251    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds"
Aug 05 17:30:20.196281 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:20.196269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch9cds" event={"ID":"6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3","Type":"ContainerDied","Data":"3541dd270dd9d6a772875e581ecf0a0a769abc139ca78b0f7b4f643e9fbb432f"}
Aug 05 17:30:20.196684 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:20.196313    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3541dd270dd9d6a772875e581ecf0a0a769abc139ca78b0f7b4f643e9fbb432f"
Aug 05 17:30:23.213463 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:23.213427    2560 generic.go:356] "Generic (PLEG): container finished" podID="31c91b14-337d-4987-839c-a46767b0a05a" containerID="cea768c3bcbf6a3ecfe83899c4d77605bfbe85a8c4ff0a59c581f1db195b2cbb" exitCode=0
Aug 05 17:30:23.213929 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:23.213525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr" event={"ID":"31c91b14-337d-4987-839c-a46767b0a05a","Type":"ContainerDied","Data":"cea768c3bcbf6a3ecfe83899c4d77605bfbe85a8c4ff0a59c581f1db195b2cbb"}
Aug 05 17:30:23.215351 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:23.215330    2560 generic.go:356] "Generic (PLEG): container finished" podID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerID="be574eb1881b1c9e7826eced37a8ca2b937d7690bf60f23c7fe4ea60086c0a32" exitCode=0
Aug 05 17:30:23.215451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:23.215378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8" event={"ID":"4cedec73-76ee-42e7-a5b6-6c902d5d7c93","Type":"ContainerDied","Data":"be574eb1881b1c9e7826eced37a8ca2b937d7690bf60f23c7fe4ea60086c0a32"}
Aug 05 17:30:24.223246 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:24.223212    2560 generic.go:356] "Generic (PLEG): container finished" podID="31c91b14-337d-4987-839c-a46767b0a05a" containerID="faa39ec033eb688b90b68339e1e2a8f3cf800ee0809752297f5daa0c986ad3fa" exitCode=0
Aug 05 17:30:24.223676 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:24.223295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr" event={"ID":"31c91b14-337d-4987-839c-a46767b0a05a","Type":"ContainerDied","Data":"faa39ec033eb688b90b68339e1e2a8f3cf800ee0809752297f5daa0c986ad3fa"}
Aug 05 17:30:24.225305 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:24.225276    2560 generic.go:356] "Generic (PLEG): container finished" podID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerID="a6e9f0fd605d0ef8fc738f635262087ea9a8cb38eee0e194a370d4477a676930" exitCode=0
Aug 05 17:30:24.225418 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:24.225348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8" event={"ID":"4cedec73-76ee-42e7-a5b6-6c902d5d7c93","Type":"ContainerDied","Data":"a6e9f0fd605d0ef8fc738f635262087ea9a8cb38eee0e194a370d4477a676930"}
Aug 05 17:30:25.380047 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.380019    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:25.413567 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.413542    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:25.433343 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.433315    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-bundle\") pod \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") "
Aug 05 17:30:25.433515 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.433378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx5ml\" (UniqueName: \"kubernetes.io/projected/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-kube-api-access-tx5ml\") pod \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") "
Aug 05 17:30:25.433515 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.433500    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-util\") pod \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\" (UID: \"4cedec73-76ee-42e7-a5b6-6c902d5d7c93\") "
Aug 05 17:30:25.434038 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.434013    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-bundle" (OuterVolumeSpecName: "bundle") pod "4cedec73-76ee-42e7-a5b6-6c902d5d7c93" (UID: "4cedec73-76ee-42e7-a5b6-6c902d5d7c93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:25.436219 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.436195    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-kube-api-access-tx5ml" (OuterVolumeSpecName: "kube-api-access-tx5ml") pod "4cedec73-76ee-42e7-a5b6-6c902d5d7c93" (UID: "4cedec73-76ee-42e7-a5b6-6c902d5d7c93"). InnerVolumeSpecName "kube-api-access-tx5ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:30:25.440175 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.440146    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-util" (OuterVolumeSpecName: "util") pod "4cedec73-76ee-42e7-a5b6-6c902d5d7c93" (UID: "4cedec73-76ee-42e7-a5b6-6c902d5d7c93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:25.534285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.534176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkhbb\" (UniqueName: \"kubernetes.io/projected/31c91b14-337d-4987-839c-a46767b0a05a-kube-api-access-zkhbb\") pod \"31c91b14-337d-4987-839c-a46767b0a05a\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") "
Aug 05 17:30:25.534285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.534287    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-bundle\") pod \"31c91b14-337d-4987-839c-a46767b0a05a\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") "
Aug 05 17:30:25.534534 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.534352    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-util\") pod \"31c91b14-337d-4987-839c-a46767b0a05a\" (UID: \"31c91b14-337d-4987-839c-a46767b0a05a\") "
Aug 05 17:30:25.534621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.534599    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-util\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:25.534680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.534624    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:25.534680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.534638    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx5ml\" (UniqueName: \"kubernetes.io/projected/4cedec73-76ee-42e7-a5b6-6c902d5d7c93-kube-api-access-tx5ml\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:25.535062 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.535037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-bundle" (OuterVolumeSpecName: "bundle") pod "31c91b14-337d-4987-839c-a46767b0a05a" (UID: "31c91b14-337d-4987-839c-a46767b0a05a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:25.536524 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.536500    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c91b14-337d-4987-839c-a46767b0a05a-kube-api-access-zkhbb" (OuterVolumeSpecName: "kube-api-access-zkhbb") pod "31c91b14-337d-4987-839c-a46767b0a05a" (UID: "31c91b14-337d-4987-839c-a46767b0a05a"). InnerVolumeSpecName "kube-api-access-zkhbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:30:25.538869 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.538822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-util" (OuterVolumeSpecName: "util") pod "31c91b14-337d-4987-839c-a46767b0a05a" (UID: "31c91b14-337d-4987-839c-a46767b0a05a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:25.635736 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.635695    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkhbb\" (UniqueName: \"kubernetes.io/projected/31c91b14-337d-4987-839c-a46767b0a05a-kube-api-access-zkhbb\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:25.635736 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.635729    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:25.635992 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:25.635753    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31c91b14-337d-4987-839c-a46767b0a05a-util\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:30:26.237440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:26.237407    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr"
Aug 05 17:30:26.237440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:26.237426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053nmkbr" event={"ID":"31c91b14-337d-4987-839c-a46767b0a05a","Type":"ContainerDied","Data":"cff6494dab65664f96c9368e445423a08675664a8d8f443878e8a9b55d10164a"}
Aug 05 17:30:26.237672 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:26.237472    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cff6494dab65664f96c9368e445423a08675664a8d8f443878e8a9b55d10164a"
Aug 05 17:30:26.239446 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:26.239420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8" event={"ID":"4cedec73-76ee-42e7-a5b6-6c902d5d7c93","Type":"ContainerDied","Data":"0b1cf5327bc29d26a5358e5bde70fffdc31a9520edde28bebaba4cd0c60d60dc"}
Aug 05 17:30:26.239618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:26.239598    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b1cf5327bc29d26a5358e5bde70fffdc31a9520edde28bebaba4cd0c60d60dc"
Aug 05 17:30:26.239618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:26.239463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bwzc8"
Aug 05 17:30:30.068151 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:30.068115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:30.884966 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:30.884937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:31.670191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:31.670150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:33.738275 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:33.738238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:33.837905 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:33.837867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:35.074411 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:35.074376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:36.662735 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:36.662700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:37.008182 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:37.008147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:37.106562 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:37.106524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:39.122239 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:39.122205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:39.226341 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:39.226297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:39.911376 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:39.911343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:40.498302 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:40.498265    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:41.637472 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.637435    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"]
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.637951    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerName="util"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.637970    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerName="util"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.637985    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c91b14-337d-4987-839c-a46767b0a05a" containerName="pull"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.637993    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c91b14-337d-4987-839c-a46767b0a05a" containerName="pull"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638007    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c91b14-337d-4987-839c-a46767b0a05a" containerName="util"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638017    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c91b14-337d-4987-839c-a46767b0a05a" containerName="util"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638027    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerName="pull"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638035    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerName="pull"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638050    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerName="util"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638058    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerName="util"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638068    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerName="pull"
Aug 05 17:30:41.638074 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638076    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerName="pull"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638093    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerName="util"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638100    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerName="util"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638108    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638116    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638130    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerName="pull"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638138    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerName="pull"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638153    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c91b14-337d-4987-839c-a46767b0a05a" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638160    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c91b14-337d-4987-839c-a46767b0a05a" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638169    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638177    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638197    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638205    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638290    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1c707e-a81d-4d52-b3da-7f9bedfdf2d3" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638307    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="868bb1b8-1263-42f8-897a-adfb6859abdd" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638316    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cedec73-76ee-42e7-a5b6-6c902d5d7c93" containerName="extract"
Aug 05 17:30:41.638647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.638325    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c91b14-337d-4987-839c-a46767b0a05a" containerName="extract"
Aug 05 17:30:41.643066 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.643045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"
Aug 05 17:30:41.646315 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.646294    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qctdj\""
Aug 05 17:30:41.646618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.646601    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 17:30:41.646666 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.646602    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 17:30:41.647337 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.647321    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 05 17:30:41.659511 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.659487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"]
Aug 05 17:30:41.782448 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.782409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mszh\" (UniqueName: \"kubernetes.io/projected/82a7c0ff-3e85-4e92-941e-8c45ddba60d1-kube-api-access-7mszh\") pod \"dns-operator-controller-manager-5985564776-bvfwx\" (UID: \"82a7c0ff-3e85-4e92-941e-8c45ddba60d1\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"
Aug 05 17:30:41.883229 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.883191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mszh\" (UniqueName: \"kubernetes.io/projected/82a7c0ff-3e85-4e92-941e-8c45ddba60d1-kube-api-access-7mszh\") pod \"dns-operator-controller-manager-5985564776-bvfwx\" (UID: \"82a7c0ff-3e85-4e92-941e-8c45ddba60d1\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"
Aug 05 17:30:41.896592 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.896533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mszh\" (UniqueName: \"kubernetes.io/projected/82a7c0ff-3e85-4e92-941e-8c45ddba60d1-kube-api-access-7mszh\") pod \"dns-operator-controller-manager-5985564776-bvfwx\" (UID: \"82a7c0ff-3e85-4e92-941e-8c45ddba60d1\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"
Aug 05 17:30:41.954059 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:41.954019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"
Aug 05 17:30:42.111999 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:42.111968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"]
Aug 05 17:30:42.113668 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:30:42.113644    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a7c0ff_3e85_4e92_941e_8c45ddba60d1.slice/crio-b65b1e4e2a944f51b9cea043942ff18fc4082a187bf120b853041fab6b6b4f25 WatchSource:0}: Error finding container b65b1e4e2a944f51b9cea043942ff18fc4082a187bf120b853041fab6b6b4f25: Status 404 returned error can't find the container with id b65b1e4e2a944f51b9cea043942ff18fc4082a187bf120b853041fab6b6b4f25
Aug 05 17:30:42.230040 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:42.230001    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:42.322682 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:42.322648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx" event={"ID":"82a7c0ff-3e85-4e92-941e-8c45ddba60d1","Type":"ContainerStarted","Data":"b65b1e4e2a944f51b9cea043942ff18fc4082a187bf120b853041fab6b6b4f25"}
Aug 05 17:30:42.377267 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:42.377233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:44.867528 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:44.867493    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:44.944128 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:44.944087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:45.301907 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:45.301869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:45.401538 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:45.401499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:45.670543 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:45.670512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:45.744373 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:45.744338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:46.352929 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:46.352820    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx" event={"ID":"82a7c0ff-3e85-4e92-941e-8c45ddba60d1","Type":"ContainerStarted","Data":"b495b51fa40b11da55893c45171c0e4fcae487a691c4a4a717512861c19f8f36"}
Aug 05 17:30:46.353364 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:46.352967    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"
Aug 05 17:30:46.372345 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:46.372297    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx" podStartSLOduration=1.433628982 podStartE2EDuration="5.372280032s" totalImagesPullingTime="3.93865105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:46.370569629 +0000 UTC m=+494.855493050" watchObservedRunningTime="2026-08-05 17:30:46.372280032 +0000 UTC m=+494.857203452"
Aug 05 17:30:50.456971 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:50.456932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:51.968348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:51.968310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:52.072145 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:52.072114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:53.784175 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.784142    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"]
Aug 05 17:30:53.787759 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.787738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:53.790468 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.790454    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tq282\""
Aug 05 17:30:53.801534 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.801511    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"]
Aug 05 17:30:53.897971 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.897932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-lvvfz\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:53.898151 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.897993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk7sm\" (UniqueName: \"kubernetes.io/projected/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-kube-api-access-pk7sm\") pod \"kuadrant-operator-controller-manager-68cf589589-lvvfz\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:53.998477 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.998438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-lvvfz\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:53.998652 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.998504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk7sm\" (UniqueName: \"kubernetes.io/projected/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-kube-api-access-pk7sm\") pod \"kuadrant-operator-controller-manager-68cf589589-lvvfz\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:53.998798 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:53.998778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-lvvfz\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:54.009828 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:54.009794    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk7sm\" (UniqueName: \"kubernetes.io/projected/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-kube-api-access-pk7sm\") pod \"kuadrant-operator-controller-manager-68cf589589-lvvfz\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:54.097560 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:54.097473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:30:54.237819 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:54.237794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"]
Aug 05 17:30:54.239703 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:30:54.239669    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18ec1ec_fe80_454f_869b_c2623ddf1d1d.slice/crio-e9d1c1b57d7bf1a777c57d41d61fb4eb644f67508cc661f77f6ac32b6f0455fa WatchSource:0}: Error finding container e9d1c1b57d7bf1a777c57d41d61fb4eb644f67508cc661f77f6ac32b6f0455fa: Status 404 returned error can't find the container with id e9d1c1b57d7bf1a777c57d41d61fb4eb644f67508cc661f77f6ac32b6f0455fa
Aug 05 17:30:54.395219 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:54.395137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz" event={"ID":"a18ec1ec-fe80-454f-869b-c2623ddf1d1d","Type":"ContainerStarted","Data":"e9d1c1b57d7bf1a777c57d41d61fb4eb644f67508cc661f77f6ac32b6f0455fa"}
Aug 05 17:30:56.683722 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:56.683687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:56.783493 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:56.783453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:57.361354 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:57.361324    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bvfwx"
Aug 05 17:30:59.185743 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:59.185705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:59.260140 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:30:59.260097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:00.433858 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:00.433822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz" event={"ID":"a18ec1ec-fe80-454f-869b-c2623ddf1d1d","Type":"ContainerStarted","Data":"f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d"}
Aug 05 17:31:00.434266 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:00.433908    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:31:00.457126 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:00.457075    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz" podStartSLOduration=1.770713283 podStartE2EDuration="7.457061009s" totalImagesPullingTime="5.686347726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:31:00.456108341 +0000 UTC m=+508.941031763" watchObservedRunningTime="2026-08-05 17:31:00.457061009 +0000 UTC m=+508.941984428"
Aug 05 17:31:06.088342 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:06.088305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:06.188159 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:06.188121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:06.487802 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:06.487768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:06.549780 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:06.549743    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:06.684815 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:06.684773    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:06.751445 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:06.751353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:11.442156 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:11.442119    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:31:13.697671 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:13.697638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:13.797319 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:13.797281    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:17.803342 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:17.803309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:17.905233 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:17.905201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:18.527053 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:18.527018    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:18.624320 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:18.624285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:20.949250 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:20.949219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:21.029748 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:21.029715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:27.778815 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:27.778713    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:28.309834 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:28.309788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:30.040420 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:30.040382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:30.186414 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:30.186375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:30.287063 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:30.287030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:31.023828 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:31.023792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:31.141830 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:31.141784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:46.184246 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:46.184211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:46.295548 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:46.295517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:46.709786 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:46.709748    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:59.574751 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:59.574704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:59.775120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:31:59.775085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:07.207315 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:07.207267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:07.318520 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:07.318483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:07.426220 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:07.426190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:10.472740 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:10.472683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:10.554402 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:10.554318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:11.237081 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:11.237019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:42.179231 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:42.179185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:42.279916 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:42.279875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:43.838387 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:43.838338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:44.265022 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.264990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:44.405592 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.405554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:44.505136 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.505078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:44.612474 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.612388    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"]
Aug 05 17:32:44.615759 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.615734    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:44.618208 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.618181    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nz8mx\""
Aug 05 17:32:44.618392 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.618374    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 05 17:32:44.628783 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.628759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"]
Aug 05 17:32:44.667756 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.667730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lsc5\" (UniqueName: \"kubernetes.io/projected/bab73008-0329-4e5b-8bf0-d65c1d107822-kube-api-access-7lsc5\") pod \"payload-pre-processing-687dbb6cf6-sbnj2\" (UID: \"bab73008-0329-4e5b-8bf0-d65c1d107822\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:44.670326 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.667888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab73008-0329-4e5b-8bf0-d65c1d107822-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sbnj2\" (UID: \"bab73008-0329-4e5b-8bf0-d65c1d107822\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:44.769095 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.769062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab73008-0329-4e5b-8bf0-d65c1d107822-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sbnj2\" (UID: \"bab73008-0329-4e5b-8bf0-d65c1d107822\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:44.769269 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.769111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lsc5\" (UniqueName: \"kubernetes.io/projected/bab73008-0329-4e5b-8bf0-d65c1d107822-kube-api-access-7lsc5\") pod \"payload-pre-processing-687dbb6cf6-sbnj2\" (UID: \"bab73008-0329-4e5b-8bf0-d65c1d107822\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:44.769743 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.769723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bab73008-0329-4e5b-8bf0-d65c1d107822-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sbnj2\" (UID: \"bab73008-0329-4e5b-8bf0-d65c1d107822\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:44.778068 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.778044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lsc5\" (UniqueName: \"kubernetes.io/projected/bab73008-0329-4e5b-8bf0-d65c1d107822-kube-api-access-7lsc5\") pod \"payload-pre-processing-687dbb6cf6-sbnj2\" (UID: \"bab73008-0329-4e5b-8bf0-d65c1d107822\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:44.926484 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:44.926450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:45.072795 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:45.072768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"]
Aug 05 17:32:45.074329 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:32:45.074307    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab73008_0329_4e5b_8bf0_d65c1d107822.slice/crio-05c22465d46ed789c9b1d86183925f93424221e8897f42bbb187f60576a00e7f WatchSource:0}: Error finding container 05c22465d46ed789c9b1d86183925f93424221e8897f42bbb187f60576a00e7f: Status 404 returned error can't find the container with id 05c22465d46ed789c9b1d86183925f93424221e8897f42bbb187f60576a00e7f
Aug 05 17:32:46.005150 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:46.005112    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2" event={"ID":"bab73008-0329-4e5b-8bf0-d65c1d107822","Type":"ContainerStarted","Data":"05c22465d46ed789c9b1d86183925f93424221e8897f42bbb187f60576a00e7f"}
Aug 05 17:32:47.012498 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:47.012459    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2" event={"ID":"bab73008-0329-4e5b-8bf0-d65c1d107822","Type":"ContainerStarted","Data":"960e8de31362bdc733bd5d8b79cf59f429da8c99dffcb09cfb81a6d0c019e883"}
Aug 05 17:32:47.013005 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:47.012543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:47.040103 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:47.040049    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2" podStartSLOduration=1.579571742 podStartE2EDuration="3.040030229s" totalImagesPullingTime="1.460458487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:47.037715168 +0000 UTC m=+615.522638588" watchObservedRunningTime="2026-08-05 17:32:47.040030229 +0000 UTC m=+615.524953648"
Aug 05 17:32:54.519517 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:54.519427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:54.617313 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:54.617279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:58.020444 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:58.020411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbnj2"
Aug 05 17:32:59.060270 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:32:59.060234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:33:02.819950 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:02.819903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:33:31.381803 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.381761    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"]
Aug 05 17:33:31.384906 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.384887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.388633 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.388610    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 05 17:33:31.388771 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.388636    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 17:33:31.388771 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.388693    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 17:33:31.388771 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.388710    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6zzxp\""
Aug 05 17:33:31.396545 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.396523    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"]
Aug 05 17:33:31.406840 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.406809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:33:31.482465 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.482433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.482654 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.482472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.482654 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.482538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.482654 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.482586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqdhb\" (UniqueName: \"kubernetes.io/projected/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-kube-api-access-tqdhb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.482654 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.482609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.482837 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.482721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.583563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.583533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.583767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.583576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.583767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.583604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.583767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.583649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.583767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.583709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqdhb\" (UniqueName: \"kubernetes.io/projected/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-kube-api-access-tqdhb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.583767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.583742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.584377 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.584346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.584512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.584403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.584512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.584426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.586718 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.586694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.586880 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.586862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.592114 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.592096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqdhb\" (UniqueName: \"kubernetes.io/projected/a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b-kube-api-access-tqdhb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ksk7q\" (UID: \"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.697290 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.697251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:31.841495 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.841470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"]
Aug 05 17:33:31.843462 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:33:31.843436    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda507d0b8_b5bb_44f7_bc32_c7932fd1dc0b.slice/crio-4060dc8fd7b151942823291c52a6fe66e0c3cec93a977c5f2c5721a48e7c4d8b WatchSource:0}: Error finding container 4060dc8fd7b151942823291c52a6fe66e0c3cec93a977c5f2c5721a48e7c4d8b: Status 404 returned error can't find the container with id 4060dc8fd7b151942823291c52a6fe66e0c3cec93a977c5f2c5721a48e7c4d8b
Aug 05 17:33:31.844952 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:31.844933    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:33:32.258899 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:32.258825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q" event={"ID":"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b","Type":"ContainerStarted","Data":"4060dc8fd7b151942823291c52a6fe66e0c3cec93a977c5f2c5721a48e7c4d8b"}
Aug 05 17:33:33.266418 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:33.266384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q" event={"ID":"a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b","Type":"ContainerStarted","Data":"7f0e60633b8b1b0921d31d922747b4186cea177c60f0883e3de2a1f39d20b537"}
Aug 05 17:33:33.285429 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:33.285379    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q" podStartSLOduration=1.340373971 podStartE2EDuration="2.28536303s" totalImagesPullingTime="944.989059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:33.284191675 +0000 UTC m=+661.769115106" watchObservedRunningTime="2026-08-05 17:33:33.28536303 +0000 UTC m=+661.770286493"
Aug 05 17:33:41.698299 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:41.698266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:41.698899 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:41.698425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:41.710591 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:41.710560    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:42.324469 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:42.324444    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ksk7q"
Aug 05 17:33:47.801315 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:47.801276    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:33:53.996681 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:33:53.996649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:01.208203 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:01.208168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:05.779175 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:05.779131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:45.696384 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:45.696345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:51.069504 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.069459    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9d5679b6-k4r7g"]
Aug 05 17:34:51.072474 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.072449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.085038 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.085011    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9d5679b6-k4r7g"]
Aug 05 17:34:51.128524 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.128486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:51.205715 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.205682    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:51.207771 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.207747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-serving-cert\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.207875 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.207783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwnjs\" (UniqueName: \"kubernetes.io/projected/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-kube-api-access-pwnjs\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.207875 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.207819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-service-ca\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.207875 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.207866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-config\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.208006 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.207905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-oauth-config\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.208006 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.207959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-trusted-ca-bundle\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.208070 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.208002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-oauth-serving-cert\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.276317 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.276282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:51.309044 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-oauth-serving-cert\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.309201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-serving-cert\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.309201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwnjs\" (UniqueName: \"kubernetes.io/projected/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-kube-api-access-pwnjs\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.309201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-service-ca\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.309201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-config\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.309428 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-oauth-config\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.309428 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-trusted-ca-bundle\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.309973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-service-ca\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.310085 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.309995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-oauth-serving-cert\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.310173 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.310150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-trusted-ca-bundle\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.310227 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.310174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-config\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.311777 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.311756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-oauth-config\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.311896 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.311814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-console-serving-cert\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.317912 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.317891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwnjs\" (UniqueName: \"kubernetes.io/projected/c77959df-33b8-426c-b0ff-ee8cc6e54b5c-kube-api-access-pwnjs\") pod \"console-6b9d5679b6-k4r7g\" (UID: \"c77959df-33b8-426c-b0ff-ee8cc6e54b5c\") " pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.344129 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.344036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:51.383757 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.383723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:34:51.523078 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.523052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9d5679b6-k4r7g"]
Aug 05 17:34:51.525412 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:34:51.525382    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77959df_33b8_426c_b0ff_ee8cc6e54b5c.slice/crio-68377eb9b477341fee87d7522f412f33c293534484b8cf0187d45ecbba3c22c1 WatchSource:0}: Error finding container 68377eb9b477341fee87d7522f412f33c293534484b8cf0187d45ecbba3c22c1: Status 404 returned error can't find the container with id 68377eb9b477341fee87d7522f412f33c293534484b8cf0187d45ecbba3c22c1
Aug 05 17:34:51.697879 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.697811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d5679b6-k4r7g" event={"ID":"c77959df-33b8-426c-b0ff-ee8cc6e54b5c","Type":"ContainerStarted","Data":"29cf0a9591c26a148d547e6fbd6d4a492fed57c0f959962b018c153d952639fb"}
Aug 05 17:34:51.697879 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.697878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9d5679b6-k4r7g" event={"ID":"c77959df-33b8-426c-b0ff-ee8cc6e54b5c","Type":"ContainerStarted","Data":"68377eb9b477341fee87d7522f412f33c293534484b8cf0187d45ecbba3c22c1"}
Aug 05 17:34:51.874166 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:34:51.874130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:01.384433 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:01.384396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:35:01.384911 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:01.384738    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:35:01.389405 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:01.389385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:35:01.410534 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:01.410479    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9d5679b6-k4r7g" podStartSLOduration=10.410462853 podStartE2EDuration="10.410462853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:51.718527256 +0000 UTC m=+740.203450666" watchObservedRunningTime="2026-08-05 17:35:01.410462853 +0000 UTC m=+749.895386272"
Aug 05 17:35:01.756895 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:01.756869    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9d5679b6-k4r7g"
Aug 05 17:35:01.805858 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:01.805813    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd6cf6885-tr97k"]
Aug 05 17:35:01.918711 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:01.918678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:02.052970 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:02.052877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:02.114452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:02.114412    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:04.640184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:04.640150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:04.745656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:04.745616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:05.752225 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:05.752192    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:05.851293 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:05.851264    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:25.635578 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:25.635536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:25.702518 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:25.702486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:26.826163 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:26.826122    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cd6cf6885-tr97k" podUID="373f0f86-821b-4aa5-8a85-517b2c7ce6a0" containerName="console" containerID="cri-o://940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c" gracePeriod=15
Aug 05 17:35:27.068959 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.068935    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:35:27.134120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134043    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-serving-cert\") pod \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") "
Aug 05 17:35:27.134120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134082    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-service-ca\") pod \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") "
Aug 05 17:35:27.134120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134116    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-442lk\" (UniqueName: \"kubernetes.io/projected/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-kube-api-access-442lk\") pod \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") "
Aug 05 17:35:27.134426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134159    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-config\") pod \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") "
Aug 05 17:35:27.134426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134209    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-oauth-serving-cert\") pod \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") "
Aug 05 17:35:27.134426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134263    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-oauth-config\") pod \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") "
Aug 05 17:35:27.134426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134304    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-trusted-ca-bundle\") pod \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\" (UID: \"373f0f86-821b-4aa5-8a85-517b2c7ce6a0\") "
Aug 05 17:35:27.134621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134569    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "373f0f86-821b-4aa5-8a85-517b2c7ce6a0" (UID: "373f0f86-821b-4aa5-8a85-517b2c7ce6a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:35:27.134621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134580    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-config" (OuterVolumeSpecName: "console-config") pod "373f0f86-821b-4aa5-8a85-517b2c7ce6a0" (UID: "373f0f86-821b-4aa5-8a85-517b2c7ce6a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:35:27.134729 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.134613    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "373f0f86-821b-4aa5-8a85-517b2c7ce6a0" (UID: "373f0f86-821b-4aa5-8a85-517b2c7ce6a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:35:27.135164 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.135057    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "373f0f86-821b-4aa5-8a85-517b2c7ce6a0" (UID: "373f0f86-821b-4aa5-8a85-517b2c7ce6a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:35:27.135289 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.135230    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-oauth-serving-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:35:27.135289 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.135250    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-trusted-ca-bundle\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:35:27.135289 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.135263    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:35:27.135289 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.135277    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-config\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:35:27.136493 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.136472    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "373f0f86-821b-4aa5-8a85-517b2c7ce6a0" (UID: "373f0f86-821b-4aa5-8a85-517b2c7ce6a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:35:27.137026 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.136999    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "373f0f86-821b-4aa5-8a85-517b2c7ce6a0" (UID: "373f0f86-821b-4aa5-8a85-517b2c7ce6a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:35:27.137026 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.137006    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-kube-api-access-442lk" (OuterVolumeSpecName: "kube-api-access-442lk") pod "373f0f86-821b-4aa5-8a85-517b2c7ce6a0" (UID: "373f0f86-821b-4aa5-8a85-517b2c7ce6a0"). InnerVolumeSpecName "kube-api-access-442lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:35:27.236298 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.236263    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-oauth-config\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:35:27.236298 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.236291    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-console-serving-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:35:27.236298 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.236301    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-442lk\" (UniqueName: \"kubernetes.io/projected/373f0f86-821b-4aa5-8a85-517b2c7ce6a0-kube-api-access-442lk\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:35:27.895075 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.895037    2560 generic.go:356] "Generic (PLEG): container finished" podID="373f0f86-821b-4aa5-8a85-517b2c7ce6a0" containerID="940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c" exitCode=0
Aug 05 17:35:27.895564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.895096    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd6cf6885-tr97k"
Aug 05 17:35:27.895564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.895124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd6cf6885-tr97k" event={"ID":"373f0f86-821b-4aa5-8a85-517b2c7ce6a0","Type":"ContainerDied","Data":"940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c"}
Aug 05 17:35:27.895564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.895214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd6cf6885-tr97k" event={"ID":"373f0f86-821b-4aa5-8a85-517b2c7ce6a0","Type":"ContainerDied","Data":"fbbcbad299f6e3657e5606dfa07d4142df11a927b4b3d75edf7dd3354b2ee13b"}
Aug 05 17:35:27.895564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.895245    2560 scope.go:117] "RemoveContainer" containerID="940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c"
Aug 05 17:35:27.904863 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.904831    2560 scope.go:117] "RemoveContainer" containerID="940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c"
Aug 05 17:35:27.905143 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:35:27.905124    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c\": container with ID starting with 940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c not found: ID does not exist" containerID="940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c"
Aug 05 17:35:27.905199 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.905153    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c"} err="failed to get container status \"940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c\": rpc error: code = NotFound desc = could not find container \"940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c\": container with ID starting with 940064346f32a4ac6f41d6828c878aff7850cf9c1b2738187a66de93fc0f293c not found: ID does not exist"
Aug 05 17:35:27.917986 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.917951    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd6cf6885-tr97k"]
Aug 05 17:35:27.921894 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:27.921868    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cd6cf6885-tr97k"]
Aug 05 17:35:28.060526 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:28.060491    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="373f0f86-821b-4aa5-8a85-517b2c7ce6a0" path="/var/lib/kubelet/pods/373f0f86-821b-4aa5-8a85-517b2c7ce6a0/volumes"
Aug 05 17:35:57.059374 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:35:57.059292    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:15.160285 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:36:15.160244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:15.265350 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:36:15.265311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:17.174664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:37:17.174629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:18.557908 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:37:18.557870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:35.590305 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:37:35.590268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:35.660218 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:37:35.660179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:20.887393 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:20.887353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:20.992908 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:20.992839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:21.122817 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:21.122788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:27.205968 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:27.205928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:27.311834 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:27.311789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:27.421066 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:27.421030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:27.582602 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:27.582520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:33.879309 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:33.879272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:35.342876 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:38:35.342810    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:00.484708 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:39:00.484629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:18.529633 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:39:18.529596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:18.600224 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:39:18.600190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:41:52.170535 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:41:52.170501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:43:48.407225 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.407187    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"]
Aug 05 17:43:48.409681 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.407435    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz" podUID="a18ec1ec-fe80-454f-869b-c2623ddf1d1d" containerName="manager" containerID="cri-o://f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d" gracePeriod=10
Aug 05 17:43:48.664457 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.664393    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:43:48.678618 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.678590    2560 generic.go:356] "Generic (PLEG): container finished" podID="a18ec1ec-fe80-454f-869b-c2623ddf1d1d" containerID="f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d" exitCode=0
Aug 05 17:43:48.678774 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.678637    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"
Aug 05 17:43:48.678774 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.678655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz" event={"ID":"a18ec1ec-fe80-454f-869b-c2623ddf1d1d","Type":"ContainerDied","Data":"f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d"}
Aug 05 17:43:48.678774 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.678696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz" event={"ID":"a18ec1ec-fe80-454f-869b-c2623ddf1d1d","Type":"ContainerDied","Data":"e9d1c1b57d7bf1a777c57d41d61fb4eb644f67508cc661f77f6ac32b6f0455fa"}
Aug 05 17:43:48.678774 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.678716    2560 scope.go:117] "RemoveContainer" containerID="f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d"
Aug 05 17:43:48.688890 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.688867    2560 scope.go:117] "RemoveContainer" containerID="f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d"
Aug 05 17:43:48.689175 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:43:48.689155    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d\": container with ID starting with f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d not found: ID does not exist" containerID="f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d"
Aug 05 17:43:48.689259 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.689186    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d"} err="failed to get container status \"f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d\": rpc error: code = NotFound desc = could not find container \"f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d\": container with ID starting with f5783b04c47cc04284587f76e9914b52c038e75ba735103d89ebcabe7bc1c88d not found: ID does not exist"
Aug 05 17:43:48.793781 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.793747    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-extensions-socket-volume\") pod \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") "
Aug 05 17:43:48.793999 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.793802    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk7sm\" (UniqueName: \"kubernetes.io/projected/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-kube-api-access-pk7sm\") pod \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\" (UID: \"a18ec1ec-fe80-454f-869b-c2623ddf1d1d\") "
Aug 05 17:43:48.794112 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.794089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a18ec1ec-fe80-454f-869b-c2623ddf1d1d" (UID: "a18ec1ec-fe80-454f-869b-c2623ddf1d1d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:43:48.794184 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.794169    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-extensions-socket-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:43:48.796080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.796059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-kube-api-access-pk7sm" (OuterVolumeSpecName: "kube-api-access-pk7sm") pod "a18ec1ec-fe80-454f-869b-c2623ddf1d1d" (UID: "a18ec1ec-fe80-454f-869b-c2623ddf1d1d"). InnerVolumeSpecName "kube-api-access-pk7sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:43:48.895274 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:48.895235    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk7sm\" (UniqueName: \"kubernetes.io/projected/a18ec1ec-fe80-454f-869b-c2623ddf1d1d-kube-api-access-pk7sm\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:43:49.002221 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:49.002185    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"]
Aug 05 17:43:49.007409 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:49.007379    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-lvvfz"]
Aug 05 17:43:50.060920 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:43:50.060888    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18ec1ec-fe80-454f-869b-c2623ddf1d1d" path="/var/lib/kubelet/pods/a18ec1ec-fe80-454f-869b-c2623ddf1d1d/volumes"
Aug 05 17:44:32.936790 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:32.936751    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:44:34.236440 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:34.236402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:44:36.338540 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:36.338499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:44:49.094548 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.094512    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"]
Aug 05 17:44:49.094981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.094922    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373f0f86-821b-4aa5-8a85-517b2c7ce6a0" containerName="console"
Aug 05 17:44:49.094981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.094938    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="373f0f86-821b-4aa5-8a85-517b2c7ce6a0" containerName="console"
Aug 05 17:44:49.094981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.094963    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18ec1ec-fe80-454f-869b-c2623ddf1d1d" containerName="manager"
Aug 05 17:44:49.094981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.094968    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18ec1ec-fe80-454f-869b-c2623ddf1d1d" containerName="manager"
Aug 05 17:44:49.095113 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.095027    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18ec1ec-fe80-454f-869b-c2623ddf1d1d" containerName="manager"
Aug 05 17:44:49.095113 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.095039    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="373f0f86-821b-4aa5-8a85-517b2c7ce6a0" containerName="console"
Aug 05 17:44:49.099318 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.099300    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.106319 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.106294    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tq282\""
Aug 05 17:44:49.117787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.117759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"]
Aug 05 17:44:49.251317 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.251288    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/961be2bc-c0e8-4a73-9323-29fda15905f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-6q72v\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.251495 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.251344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrl4\" (UniqueName: \"kubernetes.io/projected/961be2bc-c0e8-4a73-9323-29fda15905f5-kube-api-access-bhrl4\") pod \"kuadrant-operator-controller-manager-68cf589589-6q72v\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.352326 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.352237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrl4\" (UniqueName: \"kubernetes.io/projected/961be2bc-c0e8-4a73-9323-29fda15905f5-kube-api-access-bhrl4\") pod \"kuadrant-operator-controller-manager-68cf589589-6q72v\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.352326 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.352323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/961be2bc-c0e8-4a73-9323-29fda15905f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-6q72v\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.352662 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.352645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/961be2bc-c0e8-4a73-9323-29fda15905f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-6q72v\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.360601 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.360577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrl4\" (UniqueName: \"kubernetes.io/projected/961be2bc-c0e8-4a73-9323-29fda15905f5-kube-api-access-bhrl4\") pod \"kuadrant-operator-controller-manager-68cf589589-6q72v\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.416737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.416696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:49.572254 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:49.572229    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"]
Aug 05 17:44:49.573950 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:44:49.573923    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961be2bc_c0e8_4a73_9323_29fda15905f5.slice/crio-0ad65199796f7f68c91c130fcc31e074e6616f66743f2b3629f00e18fef85439 WatchSource:0}: Error finding container 0ad65199796f7f68c91c130fcc31e074e6616f66743f2b3629f00e18fef85439: Status 404 returned error can't find the container with id 0ad65199796f7f68c91c130fcc31e074e6616f66743f2b3629f00e18fef85439
Aug 05 17:44:50.021009 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:50.020973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v" event={"ID":"961be2bc-c0e8-4a73-9323-29fda15905f5","Type":"ContainerStarted","Data":"dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8"}
Aug 05 17:44:50.021207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:50.021034    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v" event={"ID":"961be2bc-c0e8-4a73-9323-29fda15905f5","Type":"ContainerStarted","Data":"0ad65199796f7f68c91c130fcc31e074e6616f66743f2b3629f00e18fef85439"}
Aug 05 17:44:50.021207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:50.021146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:44:50.042818 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:44:50.042767    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v" podStartSLOduration=1.042750997 podStartE2EDuration="1.042750997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:44:50.042269879 +0000 UTC m=+1338.527193302" watchObservedRunningTime="2026-08-05 17:44:50.042750997 +0000 UTC m=+1338.527674415"
Aug 05 17:45:00.168780 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:00.168740    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7"]
Aug 05 17:45:00.172136 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:00.172119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7"
Aug 05 17:45:00.175039 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:00.175008    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 17:45:00.182947 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:00.182923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7"]
Aug 05 17:45:00.183142 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:00.183123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7"
Aug 05 17:45:00.335751 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:00.335721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7"]
Aug 05 17:45:00.338017 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:45:00.337976    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674183c4_1172_4272_8316_9158582b7300.slice/crio-143d34202c624cb527f59ed00112741bcbdfe66d1465af12c0a5ecbf4f638703 WatchSource:0}: Error finding container 143d34202c624cb527f59ed00112741bcbdfe66d1465af12c0a5ecbf4f638703: Status 404 returned error can't find the container with id 143d34202c624cb527f59ed00112741bcbdfe66d1465af12c0a5ecbf4f638703
Aug 05 17:45:00.340018 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:00.339998    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:45:01.029179 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:01.029150    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:45:01.083986 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:01.083946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7" event={"ID":"674183c4-1172-4272-8316-9158582b7300","Type":"ContainerStarted","Data":"143d34202c624cb527f59ed00112741bcbdfe66d1465af12c0a5ecbf4f638703"}
Aug 05 17:45:05.107058 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:05.107014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7" event={"ID":"674183c4-1172-4272-8316-9158582b7300","Type":"ContainerStarted","Data":"2fb817d9056d69a0ed196ce435fb59609763df9cff5e2cfc4fa49569993d33a8"}
Aug 05 17:45:05.124201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:05.124150    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7" podStartSLOduration=0.8357845 podStartE2EDuration="5.124135224s" totalImagesPullingTime="4.288350724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:45:05.121949195 +0000 UTC m=+1353.606872614" watchObservedRunningTime="2026-08-05 17:45:05.124135224 +0000 UTC m=+1353.609058642"
Aug 05 17:45:06.113707 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:06.113674    2560 generic.go:356] "Generic (PLEG): container finished" podID="674183c4-1172-4272-8316-9158582b7300" containerID="2fb817d9056d69a0ed196ce435fb59609763df9cff5e2cfc4fa49569993d33a8" exitCode=0
Aug 05 17:45:06.114179 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:06.113746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7" event={"ID":"674183c4-1172-4272-8316-9158582b7300","Type":"ContainerDied","Data":"2fb817d9056d69a0ed196ce435fb59609763df9cff5e2cfc4fa49569993d33a8"}
Aug 05 17:45:07.254987 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:07.254962    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7"
Aug 05 17:45:08.126332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:08.126302    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7"
Aug 05 17:45:08.126332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:08.126309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765865-xpbb7" event={"ID":"674183c4-1172-4272-8316-9158582b7300","Type":"ContainerDied","Data":"143d34202c624cb527f59ed00112741bcbdfe66d1465af12c0a5ecbf4f638703"}
Aug 05 17:45:08.126527 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:45:08.126361    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="143d34202c624cb527f59ed00112741bcbdfe66d1465af12c0a5ecbf4f638703"
Aug 05 17:47:45.063348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:47:45.063313    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:47:58.337622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:47:58.337530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:48:06.008244 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:48:06.008211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:48:13.995428 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:48:13.995392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:48:50.343810 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:48:50.343777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:48:51.030376 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:48:51.030341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:49:48.276295 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:49:48.276260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:49:49.597488 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:49:49.597455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:52:24.558477 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:52:24.558386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:52:50.374398 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:52:50.374352    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:52:53.442113 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:52:53.442070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:52:53.543492 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:52:53.543449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:52:53.931207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:52:53.931146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:00.115006 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:00.114964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:00.223893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:00.223834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:00.346227 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:00.346182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:00.817366 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:00.817332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:00.973194 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:00.973163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:03.409964 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:03.409918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:03.506633 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:03.506595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:04.584913 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:04.584874    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:04.923379 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:04.923342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:05.324291 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.324195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:05.434572 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.434532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:05.530061 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.530027    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"]
Aug 05 17:53:05.530408 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.530397    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674183c4-1172-4272-8316-9158582b7300" containerName="cleanup"
Aug 05 17:53:05.530454 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.530410    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="674183c4-1172-4272-8316-9158582b7300" containerName="cleanup"
Aug 05 17:53:05.530488 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.530483    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="674183c4-1172-4272-8316-9158582b7300" containerName="cleanup"
Aug 05 17:53:05.533572 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.533545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.539876 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.539834    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b570cb7c\""
Aug 05 17:53:05.590563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.590473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6v9\" (UniqueName: \"kubernetes.io/projected/a8be9c53-8274-449e-869e-c8ed5f554cf1-kube-api-access-nm6v9\") pod \"payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.590563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.590515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8be9c53-8274-449e-869e-c8ed5f554cf1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.611486 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.611455    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"]
Aug 05 17:53:05.615255 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.615237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:05.624979 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.624957    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b570cb7c-dockercfg-jxc4c\""
Aug 05 17:53:05.627924 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.627901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"]
Aug 05 17:53:05.637246 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.637221    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"]
Aug 05 17:53:05.691366 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.691328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de748662-fbbf-43d1-b9c7-4e2529f74208-plugins-config-volume\") pod \"payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") " pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:05.691563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.691395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6v9\" (UniqueName: \"kubernetes.io/projected/a8be9c53-8274-449e-869e-c8ed5f554cf1-kube-api-access-nm6v9\") pod \"payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.691563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.691416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8be9c53-8274-449e-869e-c8ed5f554cf1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.691563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.691441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg8m\" (UniqueName: \"kubernetes.io/projected/de748662-fbbf-43d1-b9c7-4e2529f74208-kube-api-access-6pg8m\") pod \"payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") " pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:05.692157 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.692138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8be9c53-8274-449e-869e-c8ed5f554cf1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.701310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.701279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6v9\" (UniqueName: \"kubernetes.io/projected/a8be9c53-8274-449e-869e-c8ed5f554cf1-kube-api-access-nm6v9\") pod \"payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.792576 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.792542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de748662-fbbf-43d1-b9c7-4e2529f74208-plugins-config-volume\") pod \"payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") " pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:05.792737 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.792603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg8m\" (UniqueName: \"kubernetes.io/projected/de748662-fbbf-43d1-b9c7-4e2529f74208-kube-api-access-6pg8m\") pod \"payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") " pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:05.793266 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.793248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de748662-fbbf-43d1-b9c7-4e2529f74208-plugins-config-volume\") pod \"payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") " pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:05.802418 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.802391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg8m\" (UniqueName: \"kubernetes.io/projected/de748662-fbbf-43d1-b9c7-4e2529f74208-kube-api-access-6pg8m\") pod \"payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") " pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:05.846912 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.846818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:05.925334 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:05.925304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:06.003880 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.003834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"]
Aug 05 17:53:06.006824 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:53:06.006792    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8be9c53_8274_449e_869e_c8ed5f554cf1.slice/crio-d0b5f2bb4bb4cc0b98a48bc27a289897c8c848c9959672899e9092da47aaff2e WatchSource:0}: Error finding container d0b5f2bb4bb4cc0b98a48bc27a289897c8c848c9959672899e9092da47aaff2e: Status 404 returned error can't find the container with id d0b5f2bb4bb4cc0b98a48bc27a289897c8c848c9959672899e9092da47aaff2e
Aug 05 17:53:06.093443 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.093413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"]
Aug 05 17:53:06.095168 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:53:06.095140    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde748662_fbbf_43d1_b9c7_4e2529f74208.slice/crio-81c899b8990721ead48d2f508baaf0e6d256f4f91c34e7787030aa54cb1bb9ce WatchSource:0}: Error finding container 81c899b8990721ead48d2f508baaf0e6d256f4f91c34e7787030aa54cb1bb9ce: Status 404 returned error can't find the container with id 81c899b8990721ead48d2f508baaf0e6d256f4f91c34e7787030aa54cb1bb9ce
Aug 05 17:53:06.766399 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.766361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5" event={"ID":"de748662-fbbf-43d1-b9c7-4e2529f74208","Type":"ContainerStarted","Data":"b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716"}
Aug 05 17:53:06.766889 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.766429    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:06.766889 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.766458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5" event={"ID":"de748662-fbbf-43d1-b9c7-4e2529f74208","Type":"ContainerStarted","Data":"81c899b8990721ead48d2f508baaf0e6d256f4f91c34e7787030aa54cb1bb9ce"}
Aug 05 17:53:06.767999 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.767975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw" event={"ID":"a8be9c53-8274-449e-869e-c8ed5f554cf1","Type":"ContainerStarted","Data":"90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310"}
Aug 05 17:53:06.768123 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.768025    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:06.768123 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.768042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw" event={"ID":"a8be9c53-8274-449e-869e-c8ed5f554cf1","Type":"ContainerStarted","Data":"d0b5f2bb4bb4cc0b98a48bc27a289897c8c848c9959672899e9092da47aaff2e"}
Aug 05 17:53:06.788601 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.788542    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5" podStartSLOduration=1.7885281819999999 podStartE2EDuration="1.788528182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:53:06.78821857 +0000 UTC m=+1835.273141988" watchObservedRunningTime="2026-08-05 17:53:06.788528182 +0000 UTC m=+1835.273451601"
Aug 05 17:53:06.816030 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:06.815980    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw" podStartSLOduration=1.815964271 podStartE2EDuration="1.815964271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:53:06.813590314 +0000 UTC m=+1835.298513734" watchObservedRunningTime="2026-08-05 17:53:06.815964271 +0000 UTC m=+1835.300887690"
Aug 05 17:53:17.776051 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:17.776017    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:17.776587 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:17.776228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:28.971151 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:28.971112    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"]
Aug 05 17:53:28.976087 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:28.976067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"
Aug 05 17:53:28.979767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:28.979745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:53:28.979916 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:28.979790    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 17:53:28.991577 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:28.991552    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"]
Aug 05 17:53:29.107302 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.107266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d3c4b-4478-4923-97d1-50ff1687286f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8\" (UID: \"7e1d3c4b-4478-4923-97d1-50ff1687286f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"
Aug 05 17:53:29.207917 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.207879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d3c4b-4478-4923-97d1-50ff1687286f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8\" (UID: \"7e1d3c4b-4478-4923-97d1-50ff1687286f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"
Aug 05 17:53:29.208593 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.208560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d3c4b-4478-4923-97d1-50ff1687286f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8\" (UID: \"7e1d3c4b-4478-4923-97d1-50ff1687286f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"
Aug 05 17:53:29.286181 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.286101    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"
Aug 05 17:53:29.430674 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.430649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"]
Aug 05 17:53:29.432594 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:53:29.432568    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1d3c4b_4478_4923_97d1_50ff1687286f.slice/crio-b722ad9fa6e638dfb1ad244c538d4e0b3daab16ecdb70cac18c76b7dac0ab602 WatchSource:0}: Error finding container b722ad9fa6e638dfb1ad244c538d4e0b3daab16ecdb70cac18c76b7dac0ab602: Status 404 returned error can't find the container with id b722ad9fa6e638dfb1ad244c538d4e0b3daab16ecdb70cac18c76b7dac0ab602
Aug 05 17:53:29.899621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.899585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8" event={"ID":"7e1d3c4b-4478-4923-97d1-50ff1687286f","Type":"ContainerStarted","Data":"722be1ff9976e340513ebcdd76e88239bfb57f2c21dee6a255a33f5a12927c4e"}
Aug 05 17:53:29.899806 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.899644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8" event={"ID":"7e1d3c4b-4478-4923-97d1-50ff1687286f","Type":"ContainerStarted","Data":"b722ad9fa6e638dfb1ad244c538d4e0b3daab16ecdb70cac18c76b7dac0ab602"}
Aug 05 17:53:29.925926 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:29.925876    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8" podStartSLOduration=1.9258410110000002 podStartE2EDuration="1.925841011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:53:29.925304888 +0000 UTC m=+1858.410228307" watchObservedRunningTime="2026-08-05 17:53:29.925841011 +0000 UTC m=+1858.410764464"
Aug 05 17:53:30.906773 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:30.906736    2560 generic.go:356] "Generic (PLEG): container finished" podID="7e1d3c4b-4478-4923-97d1-50ff1687286f" containerID="722be1ff9976e340513ebcdd76e88239bfb57f2c21dee6a255a33f5a12927c4e" exitCode=0
Aug 05 17:53:30.907274 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:30.906824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8" event={"ID":"7e1d3c4b-4478-4923-97d1-50ff1687286f","Type":"ContainerDied","Data":"722be1ff9976e340513ebcdd76e88239bfb57f2c21dee6a255a33f5a12927c4e"}
Aug 05 17:53:32.045238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:32.045213    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"
Aug 05 17:53:32.134696 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:32.134667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d3c4b-4478-4923-97d1-50ff1687286f-maas-api-service-ca\") pod \"7e1d3c4b-4478-4923-97d1-50ff1687286f\" (UID: \"7e1d3c4b-4478-4923-97d1-50ff1687286f\") "
Aug 05 17:53:32.135078 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:32.135047    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e1d3c4b-4478-4923-97d1-50ff1687286f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e1d3c4b-4478-4923-97d1-50ff1687286f" (UID: "7e1d3c4b-4478-4923-97d1-50ff1687286f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:53:32.236319 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:32.236281    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d3c4b-4478-4923-97d1-50ff1687286f-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:53:32.918982 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:32.918936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8" event={"ID":"7e1d3c4b-4478-4923-97d1-50ff1687286f","Type":"ContainerDied","Data":"b722ad9fa6e638dfb1ad244c538d4e0b3daab16ecdb70cac18c76b7dac0ab602"}
Aug 05 17:53:32.919161 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:32.919001    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b722ad9fa6e638dfb1ad244c538d4e0b3daab16ecdb70cac18c76b7dac0ab602"
Aug 05 17:53:32.919161 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:32.918949    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"
Aug 05 17:53:35.254838 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.254775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:35.294620 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.294583    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"]
Aug 05 17:53:35.294802 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.294782    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5" podUID="de748662-fbbf-43d1-b9c7-4e2529f74208" containerName="payload-processing" containerID="cri-o://b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716" gracePeriod=30
Aug 05 17:53:35.305459 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.305431    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"]
Aug 05 17:53:35.305645 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.305625    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw" podUID="a8be9c53-8274-449e-869e-c8ed5f554cf1" containerName="payload-pre-processing" containerID="cri-o://90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310" gracePeriod=30
Aug 05 17:53:35.349365 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.349332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:35.420695 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.420659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:35.466104 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.466073    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"]
Aug 05 17:53:35.472211 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.470613    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b570cb7c-jnbm8"]
Aug 05 17:53:35.498815 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.498775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:35.560744 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.560715    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:35.596512 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.596485    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:35.667914 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.667881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:35.668789 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.668764    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pg8m\" (UniqueName: \"kubernetes.io/projected/de748662-fbbf-43d1-b9c7-4e2529f74208-kube-api-access-6pg8m\") pod \"de748662-fbbf-43d1-b9c7-4e2529f74208\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") "
Aug 05 17:53:35.668940 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.668905    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de748662-fbbf-43d1-b9c7-4e2529f74208-plugins-config-volume\") pod \"de748662-fbbf-43d1-b9c7-4e2529f74208\" (UID: \"de748662-fbbf-43d1-b9c7-4e2529f74208\") "
Aug 05 17:53:35.669262 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.669236    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de748662-fbbf-43d1-b9c7-4e2529f74208-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de748662-fbbf-43d1-b9c7-4e2529f74208" (UID: "de748662-fbbf-43d1-b9c7-4e2529f74208"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:53:35.671031 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.671011    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de748662-fbbf-43d1-b9c7-4e2529f74208-kube-api-access-6pg8m" (OuterVolumeSpecName: "kube-api-access-6pg8m") pod "de748662-fbbf-43d1-b9c7-4e2529f74208" (UID: "de748662-fbbf-43d1-b9c7-4e2529f74208"). InnerVolumeSpecName "kube-api-access-6pg8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:53:35.769461 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.769370    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8be9c53-8274-449e-869e-c8ed5f554cf1-plugins-config-volume\") pod \"a8be9c53-8274-449e-869e-c8ed5f554cf1\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") "
Aug 05 17:53:35.769623 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.769494    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm6v9\" (UniqueName: \"kubernetes.io/projected/a8be9c53-8274-449e-869e-c8ed5f554cf1-kube-api-access-nm6v9\") pod \"a8be9c53-8274-449e-869e-c8ed5f554cf1\" (UID: \"a8be9c53-8274-449e-869e-c8ed5f554cf1\") "
Aug 05 17:53:35.769678 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.769632    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de748662-fbbf-43d1-b9c7-4e2529f74208-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:53:35.769678 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.769642    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pg8m\" (UniqueName: \"kubernetes.io/projected/de748662-fbbf-43d1-b9c7-4e2529f74208-kube-api-access-6pg8m\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:53:35.769762 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.769740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8be9c53-8274-449e-869e-c8ed5f554cf1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8be9c53-8274-449e-869e-c8ed5f554cf1" (UID: "a8be9c53-8274-449e-869e-c8ed5f554cf1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:53:35.771645 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.771619    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8be9c53-8274-449e-869e-c8ed5f554cf1-kube-api-access-nm6v9" (OuterVolumeSpecName: "kube-api-access-nm6v9") pod "a8be9c53-8274-449e-869e-c8ed5f554cf1" (UID: "a8be9c53-8274-449e-869e-c8ed5f554cf1"). InnerVolumeSpecName "kube-api-access-nm6v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:53:35.858442 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.858386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:35.870264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.870233    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm6v9\" (UniqueName: \"kubernetes.io/projected/a8be9c53-8274-449e-869e-c8ed5f554cf1-kube-api-access-nm6v9\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:53:35.870264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.870257    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8be9c53-8274-449e-869e-c8ed5f554cf1-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:53:35.939941 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.939907    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8be9c53-8274-449e-869e-c8ed5f554cf1" containerID="90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310" exitCode=0
Aug 05 17:53:35.940120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.939958    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"
Aug 05 17:53:35.940120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.939996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw" event={"ID":"a8be9c53-8274-449e-869e-c8ed5f554cf1","Type":"ContainerDied","Data":"90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310"}
Aug 05 17:53:35.940120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.940059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw" event={"ID":"a8be9c53-8274-449e-869e-c8ed5f554cf1","Type":"ContainerDied","Data":"d0b5f2bb4bb4cc0b98a48bc27a289897c8c848c9959672899e9092da47aaff2e"}
Aug 05 17:53:35.940120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.940087    2560 scope.go:117] "RemoveContainer" containerID="90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310"
Aug 05 17:53:35.941469 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.941448    2560 generic.go:356] "Generic (PLEG): container finished" podID="de748662-fbbf-43d1-b9c7-4e2529f74208" containerID="b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716" exitCode=0
Aug 05 17:53:35.941577 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.941483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5" event={"ID":"de748662-fbbf-43d1-b9c7-4e2529f74208","Type":"ContainerDied","Data":"b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716"}
Aug 05 17:53:35.941577 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.941489    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"
Aug 05 17:53:35.941577 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.941523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5" event={"ID":"de748662-fbbf-43d1-b9c7-4e2529f74208","Type":"ContainerDied","Data":"81c899b8990721ead48d2f508baaf0e6d256f4f91c34e7787030aa54cb1bb9ce"}
Aug 05 17:53:35.950912 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.950894    2560 scope.go:117] "RemoveContainer" containerID="90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310"
Aug 05 17:53:35.951219 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:53:35.951196    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310\": container with ID starting with 90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310 not found: ID does not exist" containerID="90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310"
Aug 05 17:53:35.951358 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.951232    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310"} err="failed to get container status \"90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310\": rpc error: code = NotFound desc = could not find container \"90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310\": container with ID starting with 90f1213429480f4d7c6f796d6539efb9c121e0282360c11beb5d3767a4305310 not found: ID does not exist"
Aug 05 17:53:35.951358 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.951256    2560 scope.go:117] "RemoveContainer" containerID="b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716"
Aug 05 17:53:35.960211 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.960192    2560 scope.go:117] "RemoveContainer" containerID="b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716"
Aug 05 17:53:35.960469 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:53:35.960446    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716\": container with ID starting with b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716 not found: ID does not exist" containerID="b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716"
Aug 05 17:53:35.960534 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.960477    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716"} err="failed to get container status \"b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716\": rpc error: code = NotFound desc = could not find container \"b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716\": container with ID starting with b3def18570de11063411ecc92975590a773f9343a5f6b79106d9bc7080bec716 not found: ID does not exist"
Aug 05 17:53:35.970882 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.970832    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"]
Aug 05 17:53:35.973376 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.973350    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b570cb7c-744fc5c4c4-4jwx5"]
Aug 05 17:53:35.985729 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.985705    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"]
Aug 05 17:53:35.991776 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:35.991752    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b570cb7c-557cbd7dbd-mj9cw"]
Aug 05 17:53:36.062317 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.062238    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1d3c4b-4478-4923-97d1-50ff1687286f" path="/var/lib/kubelet/pods/7e1d3c4b-4478-4923-97d1-50ff1687286f/volumes"
Aug 05 17:53:36.062596 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.062583    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8be9c53-8274-449e-869e-c8ed5f554cf1" path="/var/lib/kubelet/pods/a8be9c53-8274-449e-869e-c8ed5f554cf1/volumes"
Aug 05 17:53:36.062906 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.062894    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de748662-fbbf-43d1-b9c7-4e2529f74208" path="/var/lib/kubelet/pods/de748662-fbbf-43d1-b9c7-4e2529f74208/volumes"
Aug 05 17:53:36.088996 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.088957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:36.184166 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.184122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:36.344503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.344403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:36.613481 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613394    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"]
Aug 05 17:53:36.613792 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613779    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8be9c53-8274-449e-869e-c8ed5f554cf1" containerName="payload-pre-processing"
Aug 05 17:53:36.613835 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613794    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8be9c53-8274-449e-869e-c8ed5f554cf1" containerName="payload-pre-processing"
Aug 05 17:53:36.613835 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613805    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1d3c4b-4478-4923-97d1-50ff1687286f" containerName="revoke-keys"
Aug 05 17:53:36.613835 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613811    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1d3c4b-4478-4923-97d1-50ff1687286f" containerName="revoke-keys"
Aug 05 17:53:36.613835 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613824    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de748662-fbbf-43d1-b9c7-4e2529f74208" containerName="payload-processing"
Aug 05 17:53:36.613835 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613830    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de748662-fbbf-43d1-b9c7-4e2529f74208" containerName="payload-processing"
Aug 05 17:53:36.614021 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613913    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8be9c53-8274-449e-869e-c8ed5f554cf1" containerName="payload-pre-processing"
Aug 05 17:53:36.614021 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613921    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1d3c4b-4478-4923-97d1-50ff1687286f" containerName="revoke-keys"
Aug 05 17:53:36.614021 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.613929    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de748662-fbbf-43d1-b9c7-4e2529f74208" containerName="payload-processing"
Aug 05 17:53:36.618680 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.618659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.621467 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.621447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d993b9ed-gw-openshift-default-dockercfg-4xth8\""
Aug 05 17:53:36.631135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.631113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"]
Aug 05 17:53:36.651533 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.651477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:36.776920 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.776888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-certs\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.776920 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.776925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a915393-da14-4b63-bf4d-eacca2291cff-istio-podinfo\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.777201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.776969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-credential-socket\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.777201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.777044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-socket\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.777201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.777090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-data\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.777201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.777163    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a915393-da14-4b63-bf4d-eacca2291cff-istiod-ca-cert\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.777418 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.777233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-istio-token\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.777418 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.777259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klrw9\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-kube-api-access-klrw9\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.777418 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.777299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-envoy\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878169 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-istio-token\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878169 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klrw9\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-kube-api-access-klrw9\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878169 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-envoy\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-certs\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a915393-da14-4b63-bf4d-eacca2291cff-istio-podinfo\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-credential-socket\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878451 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-socket\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878681 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-data\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878681 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a915393-da14-4b63-bf4d-eacca2291cff-istiod-ca-cert\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-certs\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878787 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-credential-socket\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.878927 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.878804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-socket\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.879182 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.879159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-data\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.879278 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.879251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a915393-da14-4b63-bf4d-eacca2291cff-istiod-ca-cert\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.880702 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.880683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-envoy\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.880952 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.880936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a915393-da14-4b63-bf4d-eacca2291cff-istio-podinfo\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.887538 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.887511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-istio-token\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.887652 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.887616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klrw9\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-kube-api-access-klrw9\") pod \"e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") " pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:36.931000 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:36.930960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:37.032685 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:37.032646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:37.081589 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:37.081567    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"]
Aug 05 17:53:37.083187 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:53:37.083162    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a915393_da14_4b63_bf4d_eacca2291cff.slice/crio-af2b1ca596d216978ac57046e4f7df6c9e77d19df9d3d0b875646166c1135956 WatchSource:0}: Error finding container af2b1ca596d216978ac57046e4f7df6c9e77d19df9d3d0b875646166c1135956: Status 404 returned error can't find the container with id af2b1ca596d216978ac57046e4f7df6c9e77d19df9d3d0b875646166c1135956
Aug 05 17:53:37.085173 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:37.085153    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:53:37.958563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:37.958525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" event={"ID":"4a915393-da14-4b63-bf4d-eacca2291cff","Type":"ContainerStarted","Data":"af2b1ca596d216978ac57046e4f7df6c9e77d19df9d3d0b875646166c1135956"}
Aug 05 17:53:41.913281 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:41.913239    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:53:41.913583 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:41.913317    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:53:41.913583 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:41.913348    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:53:41.985234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:41.985201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" event={"ID":"4a915393-da14-4b63-bf4d-eacca2291cff","Type":"ContainerStarted","Data":"b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961"}
Aug 05 17:53:42.013265 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:42.013214    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podStartSLOduration=1.185626082 podStartE2EDuration="6.013196797s" totalImagesPullingTime="4.827570715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:53:42.009190694 +0000 UTC m=+1870.494114119" watchObservedRunningTime="2026-08-05 17:53:42.013196797 +0000 UTC m=+1870.498120216"
Aug 05 17:53:42.931375 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:42.931335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:42.936103 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:42.936081    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:42.991019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:42.990986    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:42.992094 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:42.992075    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:43.499224 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:43.499191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:43.776380 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:43.776284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:44.213297 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.213261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:44.309147 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.309111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:44.382276 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.382239    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"]
Aug 05 17:53:44.385972 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.385956    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.389130 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.389107    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d993b9ed\""
Aug 05 17:53:44.389260 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.389107    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d993b9ed-dockercfg-z8s45\""
Aug 05 17:53:44.402328 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.402309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"]
Aug 05 17:53:44.435891 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.435828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:53:44.454951 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.454916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.455130 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.455060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh4ht\" (UniqueName: \"kubernetes.io/projected/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-kube-api-access-kh4ht\") pod \"payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.556328 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.556231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.556504 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.556330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh4ht\" (UniqueName: \"kubernetes.io/projected/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-kube-api-access-kh4ht\") pod \"payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.557232 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.557205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.568191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.568155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh4ht\" (UniqueName: \"kubernetes.io/projected/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-kube-api-access-kh4ht\") pod \"payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.696337 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.696303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:44.841956 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:44.841930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"]
Aug 05 17:53:44.844324 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:53:44.844295    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d734303_3fdd_47f8_992b_8c3c5dcd33dc.slice/crio-2420e00e28930efa1f0b1bbe536aeb1fddd90d3763776ebe3d06732058c6be2b WatchSource:0}: Error finding container 2420e00e28930efa1f0b1bbe536aeb1fddd90d3763776ebe3d06732058c6be2b: Status 404 returned error can't find the container with id 2420e00e28930efa1f0b1bbe536aeb1fddd90d3763776ebe3d06732058c6be2b
Aug 05 17:53:45.003237 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:45.003198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c" event={"ID":"1d734303-3fdd-47f8-992b-8c3c5dcd33dc","Type":"ContainerStarted","Data":"e4e93652b16b89c57745dde3f534d36c58da3adfa46cc23d49095915cf4a5461"}
Aug 05 17:53:45.003435 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:45.003265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c" event={"ID":"1d734303-3fdd-47f8-992b-8c3c5dcd33dc","Type":"ContainerStarted","Data":"2420e00e28930efa1f0b1bbe536aeb1fddd90d3763776ebe3d06732058c6be2b"}
Aug 05 17:53:45.003518 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:45.003502    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:45.039929 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:45.039873    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c" podStartSLOduration=1.039840511 podStartE2EDuration="1.039840511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:53:45.036065557 +0000 UTC m=+1873.520988978" watchObservedRunningTime="2026-08-05 17:53:45.039840511 +0000 UTC m=+1873.524763971"
Aug 05 17:53:56.011973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:56.011894    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:53:56.072119 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:56.072036    2560 generic.go:356] "Generic (PLEG): container finished" podID="4a915393-da14-4b63-bf4d-eacca2291cff" containerID="b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961" exitCode=0
Aug 05 17:53:56.072119 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:56.072104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" event={"ID":"4a915393-da14-4b63-bf4d-eacca2291cff","Type":"ContainerDied","Data":"b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961"}
Aug 05 17:53:56.072508 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:56.072493    2560 scope.go:117] "RemoveContainer" containerID="b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961"
Aug 05 17:53:56.074553 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:56.074521    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:53:56.074652 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:56.074599    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:53:56.074652 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:56.074632    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:53:57.080169 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:57.080136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" event={"ID":"4a915393-da14-4b63-bf4d-eacca2291cff","Type":"ContainerStarted","Data":"03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc"}
Aug 05 17:53:57.931435 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:57.931395    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:57.932647 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:57.932618    2560 patch_prober.go:28] interesting pod/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 05 17:53:57.932786 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:57.932668    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 05 17:53:57.991401 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:57.991365    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:53:58.931413 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:58.931382    2560 patch_prober.go:28] interesting pod/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 05 17:53:58.931927 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:58.931440    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 05 17:53:59.931699 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:59.931662    2560 patch_prober.go:28] interesting pod/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 05 17:53:59.932168 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:53:59.931718    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 05 17:54:00.931948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:00.931907    2560 patch_prober.go:28] interesting pod/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 05 17:54:00.932410 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:00.931978    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 05 17:54:01.931960 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:01.931921    2560 patch_prober.go:28] interesting pod/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 05 17:54:01.932448 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:01.931983    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 05 17:54:02.935893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:02.935863    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:54:02.936865 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:02.936831    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:54:08.457249 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.457204    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"]
Aug 05 17:54:08.460114 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.460080    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"
Aug 05 17:54:08.462400 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.462378    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 17:54:08.462776 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.462760    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:54:08.468022 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.468000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"]
Aug 05 17:54:08.501427 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.501393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:08.583991 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.583957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0a3b75-130e-4fe3-99e6-4217bee01235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk\" (UID: \"2f0a3b75-130e-4fe3-99e6-4217bee01235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"
Aug 05 17:54:08.684696 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.684663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0a3b75-130e-4fe3-99e6-4217bee01235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk\" (UID: \"2f0a3b75-130e-4fe3-99e6-4217bee01235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"
Aug 05 17:54:08.685324 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.685303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0a3b75-130e-4fe3-99e6-4217bee01235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk\" (UID: \"2f0a3b75-130e-4fe3-99e6-4217bee01235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"
Aug 05 17:54:08.772337 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:08.772259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"
Aug 05 17:54:09.117042 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:09.117013    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"]
Aug 05 17:54:09.119214 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:54:09.119184    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0a3b75_130e_4fe3_99e6_4217bee01235.slice/crio-5d60791c65df6262e6aecac4ad3d66613be9d12474572358c4a6a2a8d84a3f19 WatchSource:0}: Error finding container 5d60791c65df6262e6aecac4ad3d66613be9d12474572358c4a6a2a8d84a3f19: Status 404 returned error can't find the container with id 5d60791c65df6262e6aecac4ad3d66613be9d12474572358c4a6a2a8d84a3f19
Aug 05 17:54:09.150906 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:09.150873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk" event={"ID":"2f0a3b75-130e-4fe3-99e6-4217bee01235","Type":"ContainerStarted","Data":"5d60791c65df6262e6aecac4ad3d66613be9d12474572358c4a6a2a8d84a3f19"}
Aug 05 17:54:10.159475 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:10.159381    2560 generic.go:356] "Generic (PLEG): container finished" podID="2f0a3b75-130e-4fe3-99e6-4217bee01235" containerID="f35dfea74a11e11bcfc6d2279363a905dd0eb3f6ada1c4a34973f580b6d1b88b" exitCode=0
Aug 05 17:54:10.159866 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:10.159469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk" event={"ID":"2f0a3b75-130e-4fe3-99e6-4217bee01235","Type":"ContainerDied","Data":"f35dfea74a11e11bcfc6d2279363a905dd0eb3f6ada1c4a34973f580b6d1b88b"}
Aug 05 17:54:11.304814 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:11.304787    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"
Aug 05 17:54:11.410188 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:11.410157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0a3b75-130e-4fe3-99e6-4217bee01235-maas-api-service-ca\") pod \"2f0a3b75-130e-4fe3-99e6-4217bee01235\" (UID: \"2f0a3b75-130e-4fe3-99e6-4217bee01235\") "
Aug 05 17:54:11.410522 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:11.410498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0a3b75-130e-4fe3-99e6-4217bee01235-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f0a3b75-130e-4fe3-99e6-4217bee01235" (UID: "2f0a3b75-130e-4fe3-99e6-4217bee01235"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:54:11.511658 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:11.511626    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0a3b75-130e-4fe3-99e6-4217bee01235-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:12.171870 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:12.171811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk" event={"ID":"2f0a3b75-130e-4fe3-99e6-4217bee01235","Type":"ContainerDied","Data":"5d60791c65df6262e6aecac4ad3d66613be9d12474572358c4a6a2a8d84a3f19"}
Aug 05 17:54:12.172049 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:12.171902    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d60791c65df6262e6aecac4ad3d66613be9d12474572358c4a6a2a8d84a3f19"
Aug 05 17:54:12.172049 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:12.171824    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"
Aug 05 17:54:14.989627 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:14.989591    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:15.035870 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.035711    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"]
Aug 05 17:54:15.039882 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.036014    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c" podUID="1d734303-3fdd-47f8-992b-8c3c5dcd33dc" containerName="payload-pre-processing" containerID="cri-o://e4e93652b16b89c57745dde3f534d36c58da3adfa46cc23d49095915cf4a5461" gracePeriod=30
Aug 05 17:54:15.090399 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.090364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:15.168935 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.168889    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"]
Aug 05 17:54:15.170158 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.170107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:15.171995 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.171970    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d993b9ed-xlzrk"]
Aug 05 17:54:15.192572 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.192220    2560 generic.go:356] "Generic (PLEG): container finished" podID="1d734303-3fdd-47f8-992b-8c3c5dcd33dc" containerID="e4e93652b16b89c57745dde3f534d36c58da3adfa46cc23d49095915cf4a5461" exitCode=0
Aug 05 17:54:15.192572 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.192397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c" event={"ID":"1d734303-3fdd-47f8-992b-8c3c5dcd33dc","Type":"ContainerDied","Data":"e4e93652b16b89c57745dde3f534d36c58da3adfa46cc23d49095915cf4a5461"}
Aug 05 17:54:15.281171 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.281079    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:15.301723 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.301291    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"]
Aug 05 17:54:15.301945 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.301914    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy" containerID="cri-o://03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc" gracePeriod=30
Aug 05 17:54:15.326564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.326277    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:54:15.371050 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.371017    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:15.458138 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.458095    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-plugins-config-volume\") pod \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") "
Aug 05 17:54:15.458336 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.458190    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh4ht\" (UniqueName: \"kubernetes.io/projected/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-kube-api-access-kh4ht\") pod \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\" (UID: \"1d734303-3fdd-47f8-992b-8c3c5dcd33dc\") "
Aug 05 17:54:15.458520 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.458490    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d734303-3fdd-47f8-992b-8c3c5dcd33dc" (UID: "1d734303-3fdd-47f8-992b-8c3c5dcd33dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:54:15.460475 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.460445    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-kube-api-access-kh4ht" (OuterVolumeSpecName: "kube-api-access-kh4ht") pod "1d734303-3fdd-47f8-992b-8c3c5dcd33dc" (UID: "1d734303-3fdd-47f8-992b-8c3c5dcd33dc"). InnerVolumeSpecName "kube-api-access-kh4ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:54:15.537013 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.536920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:15.559155 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.559127    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:15.559155 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.559152    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh4ht\" (UniqueName: \"kubernetes.io/projected/1d734303-3fdd-47f8-992b-8c3c5dcd33dc-kube-api-access-kh4ht\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:15.750993 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:15.750951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:16.062064 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.062025    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0a3b75-130e-4fe3-99e6-4217bee01235" path="/var/lib/kubelet/pods/2f0a3b75-130e-4fe3-99e6-4217bee01235/volumes"
Aug 05 17:54:16.074207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.074176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:16.199192 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.199158    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c" event={"ID":"1d734303-3fdd-47f8-992b-8c3c5dcd33dc","Type":"ContainerDied","Data":"2420e00e28930efa1f0b1bbe536aeb1fddd90d3763776ebe3d06732058c6be2b"}
Aug 05 17:54:16.199192 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.199179    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"
Aug 05 17:54:16.199457 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.199219    2560 scope.go:117] "RemoveContainer" containerID="e4e93652b16b89c57745dde3f534d36c58da3adfa46cc23d49095915cf4a5461"
Aug 05 17:54:16.218032 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.218003    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"]
Aug 05 17:54:16.225419 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.225393    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d993b9ed-cd4fd54c6-9rm2c"]
Aug 05 17:54:16.474047 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:16.474014    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:17.939264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:17.939224    2560 patch_prober.go:28] interesting pod/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 05 17:54:17.939702 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:17.939297    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:54:18.062098 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:18.062066    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d734303-3fdd-47f8-992b-8c3c5dcd33dc" path="/var/lib/kubelet/pods/1d734303-3fdd-47f8-992b-8c3c5dcd33dc/volumes"
Aug 05 17:54:18.864238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:18.864201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:18.964091 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:18.964057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:20.016417 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.016372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:20.462253 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.462214    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:20.558705 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.558677    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:54:20.594890 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.594857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:20.606827 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.606773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klrw9\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-kube-api-access-klrw9\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.606973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.606864    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-certs\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.606973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.606891    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-envoy\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.606973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.606931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-credential-socket\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.607135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.606972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a915393-da14-4b63-bf4d-eacca2291cff-istiod-ca-cert\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.607135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.606995    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-istio-token\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.607135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607025    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-data\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.607135 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607116    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-socket\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.607344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607152    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a915393-da14-4b63-bf4d-eacca2291cff-istio-podinfo\") pod \"4a915393-da14-4b63-bf4d-eacca2291cff\" (UID: \"4a915393-da14-4b63-bf4d-eacca2291cff\") "
Aug 05 17:54:20.607344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607254    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:54:20.607558 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607506    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.607767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:54:20.607767 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:54:20.607904 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607776    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:54:20.607904 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.607788    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a915393-da14-4b63-bf4d-eacca2291cff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:54:20.609420 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.609385    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:54:20.609420 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.609401    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-kube-api-access-klrw9" (OuterVolumeSpecName: "kube-api-access-klrw9") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "kube-api-access-klrw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:54:20.609564 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.609489    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a915393-da14-4b63-bf4d-eacca2291cff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:54:20.610207 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.610182    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a915393-da14-4b63-bf4d-eacca2291cff" (UID: "4a915393-da14-4b63-bf4d-eacca2291cff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:54:20.668582 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.668546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:20.708251 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708215    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.708251 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708243    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a915393-da14-4b63-bf4d-eacca2291cff-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.708251 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708256    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klrw9\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-kube-api-access-klrw9\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.708503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708267    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.708503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708277    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.708503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708286    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a915393-da14-4b63-bf4d-eacca2291cff-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.708503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708294    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a915393-da14-4b63-bf4d-eacca2291cff-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.708503 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.708302    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a915393-da14-4b63-bf4d-eacca2291cff-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:20.788520 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.788475    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"]
Aug 05 17:54:20.788956 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.788939    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy"
Aug 05 17:54:20.789051 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.788959    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy"
Aug 05 17:54:20.789051 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.788974    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d734303-3fdd-47f8-992b-8c3c5dcd33dc" containerName="payload-pre-processing"
Aug 05 17:54:20.789051 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.788981    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d734303-3fdd-47f8-992b-8c3c5dcd33dc" containerName="payload-pre-processing"
Aug 05 17:54:20.789051 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.788989    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0a3b75-130e-4fe3-99e6-4217bee01235" containerName="revoke-keys"
Aug 05 17:54:20.789051 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.788999    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0a3b75-130e-4fe3-99e6-4217bee01235" containerName="revoke-keys"
Aug 05 17:54:20.789340 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.789119    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d734303-3fdd-47f8-992b-8c3c5dcd33dc" containerName="payload-pre-processing"
Aug 05 17:54:20.789340 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.789137    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy"
Aug 05 17:54:20.789340 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.789146    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy"
Aug 05 17:54:20.789340 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.789154    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0a3b75-130e-4fe3-99e6-4217bee01235" containerName="revoke-keys"
Aug 05 17:54:20.791619 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.791597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:20.794162 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.794139    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9759ef96\""
Aug 05 17:54:20.794383 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.794367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9759ef96-dockercfg-ff8bc\""
Aug 05 17:54:20.802553 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.802526    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"]
Aug 05 17:54:20.808820 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.808796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7n5\" (UniqueName: \"kubernetes.io/projected/3e1be721-b655-4c0d-a745-e11c3e00ce07-kube-api-access-mk7n5\") pod \"payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:20.808948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.808881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e1be721-b655-4c0d-a745-e11c3e00ce07-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:20.909555 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.909463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e1be721-b655-4c0d-a745-e11c3e00ce07-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:20.909555 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.909530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7n5\" (UniqueName: \"kubernetes.io/projected/3e1be721-b655-4c0d-a745-e11c3e00ce07-kube-api-access-mk7n5\") pod \"payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:20.910181 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.910161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e1be721-b655-4c0d-a745-e11c3e00ce07-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:20.918420 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:20.918388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7n5\" (UniqueName: \"kubernetes.io/projected/3e1be721-b655-4c0d-a745-e11c3e00ce07-kube-api-access-mk7n5\") pod \"payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:21.104029 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.103985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:21.233711 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.233677    2560 generic.go:356] "Generic (PLEG): container finished" podID="4a915393-da14-4b63-bf4d-eacca2291cff" containerID="03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc" exitCode=0
Aug 05 17:54:21.233916 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.233721    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"
Aug 05 17:54:21.233916 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.233758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" event={"ID":"4a915393-da14-4b63-bf4d-eacca2291cff","Type":"ContainerDied","Data":"03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc"}
Aug 05 17:54:21.233916 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.233824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l" event={"ID":"4a915393-da14-4b63-bf4d-eacca2291cff","Type":"ContainerDied","Data":"af2b1ca596d216978ac57046e4f7df6c9e77d19df9d3d0b875646166c1135956"}
Aug 05 17:54:21.233916 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.233888    2560 scope.go:117] "RemoveContainer" containerID="03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc"
Aug 05 17:54:21.245169 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.245148    2560 scope.go:117] "RemoveContainer" containerID="b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961"
Aug 05 17:54:21.247219 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.247194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"]
Aug 05 17:54:21.247562 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:54:21.247541    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1be721_b655_4c0d_a745_e11c3e00ce07.slice/crio-bede997d099a8c05fcdafc083e29638d69db1399433ca19c94cd624d0684dee7 WatchSource:0}: Error finding container bede997d099a8c05fcdafc083e29638d69db1399433ca19c94cd624d0684dee7: Status 404 returned error can't find the container with id bede997d099a8c05fcdafc083e29638d69db1399433ca19c94cd624d0684dee7
Aug 05 17:54:21.255640 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.255617    2560 scope.go:117] "RemoveContainer" containerID="03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc"
Aug 05 17:54:21.255968 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:54:21.255947    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc\": container with ID starting with 03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc not found: ID does not exist" containerID="03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc"
Aug 05 17:54:21.256072 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.255982    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc"} err="failed to get container status \"03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc\": rpc error: code = NotFound desc = could not find container \"03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc\": container with ID starting with 03be7dbdce8739b83c03ee3ec7bc571f8e77ab6f4f72ea606db2d7ba9d2221fc not found: ID does not exist"
Aug 05 17:54:21.256072 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.256009    2560 scope.go:117] "RemoveContainer" containerID="b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961"
Aug 05 17:54:21.256335 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:54:21.256316    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961\": container with ID starting with b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961 not found: ID does not exist" containerID="b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961"
Aug 05 17:54:21.256404 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.256343    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961"} err="failed to get container status \"b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961\": rpc error: code = NotFound desc = could not find container \"b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961\": container with ID starting with b849c1d0f239ae496e55ed9c709282305f38e6572aa89206402127ce06daa961 not found: ID does not exist"
Aug 05 17:54:21.256673 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.256654    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"]
Aug 05 17:54:21.262203 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:21.262183    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d993b9ed-gw-openshift-default-7d6ff47b6d-7jc6l"]
Aug 05 17:54:22.061981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:22.061948    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" path="/var/lib/kubelet/pods/4a915393-da14-4b63-bf4d-eacca2291cff/volumes"
Aug 05 17:54:22.247017 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:22.246977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s" event={"ID":"3e1be721-b655-4c0d-a745-e11c3e00ce07","Type":"ContainerStarted","Data":"94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993"}
Aug 05 17:54:22.247519 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:22.247070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s" event={"ID":"3e1be721-b655-4c0d-a745-e11c3e00ce07","Type":"ContainerStarted","Data":"bede997d099a8c05fcdafc083e29638d69db1399433ca19c94cd624d0684dee7"}
Aug 05 17:54:22.247519 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:22.247099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:22.264981 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:22.264838    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s" podStartSLOduration=2.2648224 podStartE2EDuration="2.2648224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:54:22.264124866 +0000 UTC m=+1910.749048307" watchObservedRunningTime="2026-08-05 17:54:22.2648224 +0000 UTC m=+1910.749745819"
Aug 05 17:54:33.256938 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:33.256905    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:36.582734 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:36.582692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:44.529961 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.529926    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"]
Aug 05 17:54:44.530423 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.530304    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy"
Aug 05 17:54:44.530423 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.530315    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a915393-da14-4b63-bf4d-eacca2291cff" containerName="istio-proxy"
Aug 05 17:54:44.533819 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.533798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"
Aug 05 17:54:44.536114 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.536093    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:54:44.536194 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.536116    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 17:54:44.541021 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.540954    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"]
Aug 05 17:54:44.625013 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.624971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ae7793-9e5e-4f02-b524-353140d80907-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb\" (UID: \"f0ae7793-9e5e-4f02-b524-353140d80907\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"
Aug 05 17:54:44.726389 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.726349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ae7793-9e5e-4f02-b524-353140d80907-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb\" (UID: \"f0ae7793-9e5e-4f02-b524-353140d80907\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"
Aug 05 17:54:44.727047 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.727030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ae7793-9e5e-4f02-b524-353140d80907-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb\" (UID: \"f0ae7793-9e5e-4f02-b524-353140d80907\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"
Aug 05 17:54:44.845867 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:44.845749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"
Aug 05 17:54:45.191275 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:45.191239    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"]
Aug 05 17:54:45.193372 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:54:45.193344    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ae7793_9e5e_4f02_b524_353140d80907.slice/crio-5965aac46d86703bbbea37857cd4e5c287bc6f09f29dd92fd423ee6da868472a WatchSource:0}: Error finding container 5965aac46d86703bbbea37857cd4e5c287bc6f09f29dd92fd423ee6da868472a: Status 404 returned error can't find the container with id 5965aac46d86703bbbea37857cd4e5c287bc6f09f29dd92fd423ee6da868472a
Aug 05 17:54:45.385764 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:45.385726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb" event={"ID":"f0ae7793-9e5e-4f02-b524-353140d80907","Type":"ContainerStarted","Data":"5965aac46d86703bbbea37857cd4e5c287bc6f09f29dd92fd423ee6da868472a"}
Aug 05 17:54:46.393120 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:46.393080    2560 generic.go:356] "Generic (PLEG): container finished" podID="f0ae7793-9e5e-4f02-b524-353140d80907" containerID="0c9d885ffce7e3e5fd40f1cf6e807032a123ff95f185774001d9187a6bf815ee" exitCode=0
Aug 05 17:54:46.393500 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:46.393153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb" event={"ID":"f0ae7793-9e5e-4f02-b524-353140d80907","Type":"ContainerDied","Data":"0c9d885ffce7e3e5fd40f1cf6e807032a123ff95f185774001d9187a6bf815ee"}
Aug 05 17:54:47.533417 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:47.533391    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"
Aug 05 17:54:47.653488 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:47.653396    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ae7793-9e5e-4f02-b524-353140d80907-maas-api-service-ca\") pod \"f0ae7793-9e5e-4f02-b524-353140d80907\" (UID: \"f0ae7793-9e5e-4f02-b524-353140d80907\") "
Aug 05 17:54:47.653753 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:47.653728    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ae7793-9e5e-4f02-b524-353140d80907-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0ae7793-9e5e-4f02-b524-353140d80907" (UID: "f0ae7793-9e5e-4f02-b524-353140d80907"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:54:47.754256 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:47.754210    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ae7793-9e5e-4f02-b524-353140d80907-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:48.405265 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:48.405180    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"
Aug 05 17:54:48.405265 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:48.405189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb" event={"ID":"f0ae7793-9e5e-4f02-b524-353140d80907","Type":"ContainerDied","Data":"5965aac46d86703bbbea37857cd4e5c287bc6f09f29dd92fd423ee6da868472a"}
Aug 05 17:54:48.405265 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:48.405242    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5965aac46d86703bbbea37857cd4e5c287bc6f09f29dd92fd423ee6da868472a"
Aug 05 17:54:50.440768 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.440734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:50.476435 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.476404    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"]
Aug 05 17:54:50.476628 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.476604    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s" podUID="3e1be721-b655-4c0d-a745-e11c3e00ce07" containerName="payload-pre-processing" containerID="cri-o://94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993" gracePeriod=30
Aug 05 17:54:50.603182 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.603147    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"]
Aug 05 17:54:50.606834 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.606811    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9759ef96-lm9xb"]
Aug 05 17:54:50.740400 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.740375    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:50.883238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.883204    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e1be721-b655-4c0d-a745-e11c3e00ce07-plugins-config-volume\") pod \"3e1be721-b655-4c0d-a745-e11c3e00ce07\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") "
Aug 05 17:54:50.883238 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.883246    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk7n5\" (UniqueName: \"kubernetes.io/projected/3e1be721-b655-4c0d-a745-e11c3e00ce07-kube-api-access-mk7n5\") pod \"3e1be721-b655-4c0d-a745-e11c3e00ce07\" (UID: \"3e1be721-b655-4c0d-a745-e11c3e00ce07\") "
Aug 05 17:54:50.883584 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.883563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e1be721-b655-4c0d-a745-e11c3e00ce07-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e1be721-b655-4c0d-a745-e11c3e00ce07" (UID: "3e1be721-b655-4c0d-a745-e11c3e00ce07"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:54:50.885454 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.885434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e1be721-b655-4c0d-a745-e11c3e00ce07-kube-api-access-mk7n5" (OuterVolumeSpecName: "kube-api-access-mk7n5") pod "3e1be721-b655-4c0d-a745-e11c3e00ce07" (UID: "3e1be721-b655-4c0d-a745-e11c3e00ce07"). InnerVolumeSpecName "kube-api-access-mk7n5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:54:50.984190 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.984097    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e1be721-b655-4c0d-a745-e11c3e00ce07-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:50.984190 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:50.984133    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk7n5\" (UniqueName: \"kubernetes.io/projected/3e1be721-b655-4c0d-a745-e11c3e00ce07-kube-api-access-mk7n5\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:54:51.422690 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.422661    2560 generic.go:356] "Generic (PLEG): container finished" podID="3e1be721-b655-4c0d-a745-e11c3e00ce07" containerID="94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993" exitCode=0
Aug 05 17:54:51.422909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.422711    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"
Aug 05 17:54:51.422909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.422758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s" event={"ID":"3e1be721-b655-4c0d-a745-e11c3e00ce07","Type":"ContainerDied","Data":"94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993"}
Aug 05 17:54:51.422909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.422816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s" event={"ID":"3e1be721-b655-4c0d-a745-e11c3e00ce07","Type":"ContainerDied","Data":"bede997d099a8c05fcdafc083e29638d69db1399433ca19c94cd624d0684dee7"}
Aug 05 17:54:51.422909 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.422872    2560 scope.go:117] "RemoveContainer" containerID="94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993"
Aug 05 17:54:51.431901 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.431884    2560 scope.go:117] "RemoveContainer" containerID="94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993"
Aug 05 17:54:51.432150 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:54:51.432129    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993\": container with ID starting with 94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993 not found: ID does not exist" containerID="94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993"
Aug 05 17:54:51.432194 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.432159    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993"} err="failed to get container status \"94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993\": rpc error: code = NotFound desc = could not find container \"94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993\": container with ID starting with 94041c1baa006ead8cae947aebcd28bd30e383229021ba429f66f1622f706993 not found: ID does not exist"
Aug 05 17:54:51.443153 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.443125    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"]
Aug 05 17:54:51.446659 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.446635    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9759ef96-5679f69d4d-n5k6s"]
Aug 05 17:54:51.663716 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.663676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:51.728322 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.728232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:51.978974 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:51.978882    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:52.065475 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.065438    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e1be721-b655-4c0d-a745-e11c3e00ce07" path="/var/lib/kubelet/pods/3e1be721-b655-4c0d-a745-e11c3e00ce07/volumes"
Aug 05 17:54:52.065778 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.065764    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ae7793-9e5e-4f02-b524-353140d80907" path="/var/lib/kubelet/pods/f0ae7793-9e5e-4f02-b524-353140d80907/volumes"
Aug 05 17:54:52.186375 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.186332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:52.427681 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.427653    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"]
Aug 05 17:54:52.428085 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.428071    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ae7793-9e5e-4f02-b524-353140d80907" containerName="revoke-keys"
Aug 05 17:54:52.428132 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.428088    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ae7793-9e5e-4f02-b524-353140d80907" containerName="revoke-keys"
Aug 05 17:54:52.428132 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.428099    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e1be721-b655-4c0d-a745-e11c3e00ce07" containerName="payload-pre-processing"
Aug 05 17:54:52.428132 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.428104    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e1be721-b655-4c0d-a745-e11c3e00ce07" containerName="payload-pre-processing"
Aug 05 17:54:52.428235 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.428155    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ae7793-9e5e-4f02-b524-353140d80907" containerName="revoke-keys"
Aug 05 17:54:52.428235 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.428167    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e1be721-b655-4c0d-a745-e11c3e00ce07" containerName="payload-pre-processing"
Aug 05 17:54:52.432736 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.432716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.435324 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.435303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0d1b0907-openshift-default-dockercfg-9jvg7\""
Aug 05 17:54:52.443892 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.443862    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"]
Aug 05 17:54:52.451175 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.451142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:52.575310 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.575275    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:52.599267 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-envoy\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de4c02a-d05a-4736-90de-c7f629e53a10-istiod-ca-cert\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-credential-socket\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-podinfo\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-token\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lrlq\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-kube-api-access-9lrlq\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-socket\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599648 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-data\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.599648 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.599566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-certs\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700514 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-socket\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700514 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-data\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700514 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-certs\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700813 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-envoy\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700813 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de4c02a-d05a-4736-90de-c7f629e53a10-istiod-ca-cert\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700813 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-credential-socket\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700813 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-podinfo\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700813 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-token\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.700813 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.700703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrlq\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-kube-api-access-9lrlq\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.701140 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.701088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-credential-socket\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.701140 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.701115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-socket\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.701328 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.701297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de4c02a-d05a-4736-90de-c7f629e53a10-istiod-ca-cert\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.701328 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.701324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-data\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.701516 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.701346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-certs\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.703301 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.703276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-envoy\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.703423 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.703401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-podinfo\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.709948 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.709923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-token\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.710048 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.709949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrlq\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-kube-api-access-9lrlq\") pod \"e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") " pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.745660 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.745628    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:52.889128 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.889102    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"]
Aug 05 17:54:52.890670 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:54:52.890645    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de4c02a_d05a_4736_90de_c7f629e53a10.slice/crio-b5b3f7ca2bed2a91d4ce918db417095d91529b0d5ec0c0c32c975943a39c8293 WatchSource:0}: Error finding container b5b3f7ca2bed2a91d4ce918db417095d91529b0d5ec0c0c32c975943a39c8293: Status 404 returned error can't find the container with id b5b3f7ca2bed2a91d4ce918db417095d91529b0d5ec0c0c32c975943a39c8293
Aug 05 17:54:52.892827 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.892794    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:54:52.892950 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.892926    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:54:52.893014 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:52.892978    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:54:53.437492 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:53.437448    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" event={"ID":"2de4c02a-d05a-4736-90de-c7f629e53a10","Type":"ContainerStarted","Data":"2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d"}
Aug 05 17:54:53.437679 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:53.437521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" event={"ID":"2de4c02a-d05a-4736-90de-c7f629e53a10","Type":"ContainerStarted","Data":"b5b3f7ca2bed2a91d4ce918db417095d91529b0d5ec0c0c32c975943a39c8293"}
Aug 05 17:54:53.460018 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:53.459963    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podStartSLOduration=1.45994922 podStartE2EDuration="1.45994922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:54:53.457981724 +0000 UTC m=+1941.942905142" watchObservedRunningTime="2026-08-05 17:54:53.45994922 +0000 UTC m=+1941.944872638"
Aug 05 17:54:53.746973 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:53.746882    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:53.752690 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:53.752660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:54.443688 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:54.443654    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:54.444805 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:54.444777    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:54:54.792607 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:54.792511    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:54.891365 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:54.891332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:55.928901 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:55.928867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:56.414426 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.414338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:56.511026 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.510990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:54:56.542579 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.542551    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"]
Aug 05 17:54:56.546264 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.546246    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.548463 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.548443    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0d1b0907\""
Aug 05 17:54:56.548687 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.548674    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0d1b0907-dockercfg-tcvr9\""
Aug 05 17:54:56.556701 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.556674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"]
Aug 05 17:54:56.642030 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.641987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqrwg\" (UniqueName: \"kubernetes.io/projected/951bd175-67d9-4a0e-a4c1-12c5a29b1755-kube-api-access-nqrwg\") pod \"payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.642254 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.642139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/951bd175-67d9-4a0e-a4c1-12c5a29b1755-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.742702 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.742669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqrwg\" (UniqueName: \"kubernetes.io/projected/951bd175-67d9-4a0e-a4c1-12c5a29b1755-kube-api-access-nqrwg\") pod \"payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.742905 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.742744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/951bd175-67d9-4a0e-a4c1-12c5a29b1755-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.743447 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.743427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/951bd175-67d9-4a0e-a4c1-12c5a29b1755-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.751595 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.751561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqrwg\" (UniqueName: \"kubernetes.io/projected/951bd175-67d9-4a0e-a4c1-12c5a29b1755-kube-api-access-nqrwg\") pod \"payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.860374 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.860335    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:56.996920 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:56.996895    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"]
Aug 05 17:54:56.999431 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:54:56.999402    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951bd175_67d9_4a0e_a4c1_12c5a29b1755.slice/crio-7eabc97d84a7c3b56aeebcc8ccdec54c7f888c8bd6701286cabdb55181a2477d WatchSource:0}: Error finding container 7eabc97d84a7c3b56aeebcc8ccdec54c7f888c8bd6701286cabdb55181a2477d: Status 404 returned error can't find the container with id 7eabc97d84a7c3b56aeebcc8ccdec54c7f888c8bd6701286cabdb55181a2477d
Aug 05 17:54:57.461110 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:57.461076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp" event={"ID":"951bd175-67d9-4a0e-a4c1-12c5a29b1755","Type":"ContainerStarted","Data":"c764940ba5d76d3d5fe1654d4bc737cc5b1641ba016a2de4c9a325952a77f388"}
Aug 05 17:54:57.461308 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:57.461132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp" event={"ID":"951bd175-67d9-4a0e-a4c1-12c5a29b1755","Type":"ContainerStarted","Data":"7eabc97d84a7c3b56aeebcc8ccdec54c7f888c8bd6701286cabdb55181a2477d"}
Aug 05 17:54:57.461308 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:57.461164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:54:57.479288 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:54:57.479236    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp" podStartSLOduration=1.479221238 podStartE2EDuration="1.479221238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:54:57.478170026 +0000 UTC m=+1945.963093449" watchObservedRunningTime="2026-08-05 17:54:57.479221238 +0000 UTC m=+1945.964144657"
Aug 05 17:55:08.469309 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:08.469260    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp" podUID="951bd175-67d9-4a0e-a4c1-12c5a29b1755" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.53:9004: connect: connection refused"
Aug 05 17:55:08.533554 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:08.533519    2560 generic.go:356] "Generic (PLEG): container finished" podID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerID="2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d" exitCode=0
Aug 05 17:55:08.533719 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:08.533591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" event={"ID":"2de4c02a-d05a-4736-90de-c7f629e53a10","Type":"ContainerDied","Data":"2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d"}
Aug 05 17:55:08.534053 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:08.534039    2560 scope.go:117] "RemoveContainer" containerID="2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d"
Aug 05 17:55:08.535124 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:08.535095    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:55:08.535191 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:08.535176    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:55:08.535231 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:08.535212    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:55:09.444280 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:09.444236    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:55:09.546753 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:09.546696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" event={"ID":"2de4c02a-d05a-4736-90de-c7f629e53a10","Type":"ContainerStarted","Data":"ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd"}
Aug 05 17:55:09.746874 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:09.746747    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:55:09.747750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:09.747709    2560 patch_prober.go:28] interesting pod/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:55:09.747893 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:09.747777    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 05 17:55:10.746698 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:10.746655    2560 patch_prober.go:28] interesting pod/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:55:10.747372 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:10.747339    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 05 17:55:11.747033 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:11.746563    2560 patch_prober.go:28] interesting pod/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:55:11.747033 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:11.746629    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 05 17:55:12.746687 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:12.746226    2560 patch_prober.go:28] interesting pod/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:55:12.746687 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:12.746298    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 05 17:55:13.746712 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:13.746670    2560 patch_prober.go:28] interesting pod/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:55:13.747348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:13.747315    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 05 17:55:14.750861 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:14.750815    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:55:14.751298 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:14.751286    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:55:14.751946 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:14.751925    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:55:18.468460 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:18.468430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:55:19.667105 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.664101    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"]
Aug 05 17:55:19.668612 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.668584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"
Aug 05 17:55:19.672996 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.672967    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 17:55:19.673215 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.673197    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:55:19.675294 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.675264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"]
Aug 05 17:55:19.770809 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.770764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc7859-0a6f-4e72-b1d8-a07a33ffce5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s\" (UID: \"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"
Aug 05 17:55:19.871345 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.871301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc7859-0a6f-4e72-b1d8-a07a33ffce5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s\" (UID: \"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"
Aug 05 17:55:19.872047 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.872025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc7859-0a6f-4e72-b1d8-a07a33ffce5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s\" (UID: \"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"
Aug 05 17:55:19.981213 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:19.981125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"
Aug 05 17:55:20.116652 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:20.116504    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"]
Aug 05 17:55:20.119107 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:55:20.119079    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bc7859_0a6f_4e72_b1d8_a07a33ffce5a.slice/crio-0ebe9db94303c0b051bef4fc5716875b50dce9aae6f41b317e0132f0a2c3ec05 WatchSource:0}: Error finding container 0ebe9db94303c0b051bef4fc5716875b50dce9aae6f41b317e0132f0a2c3ec05: Status 404 returned error can't find the container with id 0ebe9db94303c0b051bef4fc5716875b50dce9aae6f41b317e0132f0a2c3ec05
Aug 05 17:55:20.619105 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:20.619000    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s" event={"ID":"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a","Type":"ContainerStarted","Data":"e3ec90b4c8dc98e0df066eb7105764f8529b9805577ee05b4315f5e7799fb483"}
Aug 05 17:55:20.619105 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:20.619066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s" event={"ID":"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a","Type":"ContainerStarted","Data":"0ebe9db94303c0b051bef4fc5716875b50dce9aae6f41b317e0132f0a2c3ec05"}
Aug 05 17:55:20.636537 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:20.636477    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s" podStartSLOduration=1.636457689 podStartE2EDuration="1.636457689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:55:20.636191466 +0000 UTC m=+1969.121114885" watchObservedRunningTime="2026-08-05 17:55:20.636457689 +0000 UTC m=+1969.121381109"
Aug 05 17:55:21.626895 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:21.626834    2560 generic.go:356] "Generic (PLEG): container finished" podID="23bc7859-0a6f-4e72-b1d8-a07a33ffce5a" containerID="e3ec90b4c8dc98e0df066eb7105764f8529b9805577ee05b4315f5e7799fb483" exitCode=0
Aug 05 17:55:21.626895 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:21.626883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s" event={"ID":"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a","Type":"ContainerDied","Data":"e3ec90b4c8dc98e0df066eb7105764f8529b9805577ee05b4315f5e7799fb483"}
Aug 05 17:55:22.769773 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:22.769743    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"
Aug 05 17:55:22.902397 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:22.902301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc7859-0a6f-4e72-b1d8-a07a33ffce5a-maas-api-service-ca\") pod \"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a\" (UID: \"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a\") "
Aug 05 17:55:22.902652 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:22.902630    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23bc7859-0a6f-4e72-b1d8-a07a33ffce5a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23bc7859-0a6f-4e72-b1d8-a07a33ffce5a" (UID: "23bc7859-0a6f-4e72-b1d8-a07a33ffce5a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:55:23.003730 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:23.003690    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23bc7859-0a6f-4e72-b1d8-a07a33ffce5a-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:23.639997 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:23.639971    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"
Aug 05 17:55:23.640173 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:23.640016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s" event={"ID":"23bc7859-0a6f-4e72-b1d8-a07a33ffce5a","Type":"ContainerDied","Data":"0ebe9db94303c0b051bef4fc5716875b50dce9aae6f41b317e0132f0a2c3ec05"}
Aug 05 17:55:23.640173 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:23.640062    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ebe9db94303c0b051bef4fc5716875b50dce9aae6f41b317e0132f0a2c3ec05"
Aug 05 17:55:26.511980 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.511930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:26.541395 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.541363    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"]
Aug 05 17:55:26.541609 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.541582    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp" podUID="951bd175-67d9-4a0e-a4c1-12c5a29b1755" containerName="payload-pre-processing" containerID="cri-o://c764940ba5d76d3d5fe1654d4bc737cc5b1641ba016a2de4c9a325952a77f388" gracePeriod=30
Aug 05 17:55:26.608121 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.608082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:26.660836 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.660804    2560 generic.go:356] "Generic (PLEG): container finished" podID="951bd175-67d9-4a0e-a4c1-12c5a29b1755" containerID="c764940ba5d76d3d5fe1654d4bc737cc5b1641ba016a2de4c9a325952a77f388" exitCode=0
Aug 05 17:55:26.660836 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.660885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp" event={"ID":"951bd175-67d9-4a0e-a4c1-12c5a29b1755","Type":"ContainerDied","Data":"c764940ba5d76d3d5fe1654d4bc737cc5b1641ba016a2de4c9a325952a77f388"}
Aug 05 17:55:26.680644 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.680593    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"]
Aug 05 17:55:26.682576 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.682519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:26.684206 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.684182    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d1b0907-5wx5s"]
Aug 05 17:55:26.752711 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.752679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:26.808386 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.808357    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:55:26.814958 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.814930    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"]
Aug 05 17:55:26.815166 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.815139    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy" containerID="cri-o://ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd" gracePeriod=30
Aug 05 17:55:26.838664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.838624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:26.939363 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.939328    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/951bd175-67d9-4a0e-a4c1-12c5a29b1755-plugins-config-volume\") pod \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") "
Aug 05 17:55:26.939540 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.939493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqrwg\" (UniqueName: \"kubernetes.io/projected/951bd175-67d9-4a0e-a4c1-12c5a29b1755-kube-api-access-nqrwg\") pod \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\" (UID: \"951bd175-67d9-4a0e-a4c1-12c5a29b1755\") "
Aug 05 17:55:26.939699 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.939671    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951bd175-67d9-4a0e-a4c1-12c5a29b1755-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "951bd175-67d9-4a0e-a4c1-12c5a29b1755" (UID: "951bd175-67d9-4a0e-a4c1-12c5a29b1755"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:55:26.939831 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.939813    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/951bd175-67d9-4a0e-a4c1-12c5a29b1755-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:26.941656 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:26.941637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951bd175-67d9-4a0e-a4c1-12c5a29b1755-kube-api-access-nqrwg" (OuterVolumeSpecName: "kube-api-access-nqrwg") pod "951bd175-67d9-4a0e-a4c1-12c5a29b1755" (UID: "951bd175-67d9-4a0e-a4c1-12c5a29b1755"). InnerVolumeSpecName "kube-api-access-nqrwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:55:27.041395 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.041307    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqrwg\" (UniqueName: \"kubernetes.io/projected/951bd175-67d9-4a0e-a4c1-12c5a29b1755-kube-api-access-nqrwg\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:27.048286 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.048257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:27.495329 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.495287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:27.591750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.591708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:27.668464 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.668429    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"
Aug 05 17:55:27.668637 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.668475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp" event={"ID":"951bd175-67d9-4a0e-a4c1-12c5a29b1755","Type":"ContainerDied","Data":"7eabc97d84a7c3b56aeebcc8ccdec54c7f888c8bd6701286cabdb55181a2477d"}
Aug 05 17:55:27.668637 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.668530    2560 scope.go:117] "RemoveContainer" containerID="c764940ba5d76d3d5fe1654d4bc737cc5b1641ba016a2de4c9a325952a77f388"
Aug 05 17:55:27.693750 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.693725    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"]
Aug 05 17:55:27.696402 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.696370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:27.699598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:27.699577    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0d1b0907-65f5cbd47b-cjcsp"]
Aug 05 17:55:28.060934 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:28.060900    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23bc7859-0a6f-4e72-b1d8-a07a33ffce5a" path="/var/lib/kubelet/pods/23bc7859-0a6f-4e72-b1d8-a07a33ffce5a/volumes"
Aug 05 17:55:28.061271 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:28.061258    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951bd175-67d9-4a0e-a4c1-12c5a29b1755" path="/var/lib/kubelet/pods/951bd175-67d9-4a0e-a4c1-12c5a29b1755/volumes"
Aug 05 17:55:29.754459 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:29.754420    2560 patch_prober.go:28] interesting pod/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:55:29.754879 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:29.754511    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:55:32.065979 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.065950    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:55:32.187086 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187062    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lrlq\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-kube-api-access-9lrlq\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187112    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-credential-socket\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-certs\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187187    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-podinfo\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187216    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de4c02a-d05a-4736-90de-c7f629e53a10-istiod-ca-cert\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187274    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-data\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187332 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-socket\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187478 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187343    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-token\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187478 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-envoy\") pod \"2de4c02a-d05a-4736-90de-c7f629e53a10\" (UID: \"2de4c02a-d05a-4736-90de-c7f629e53a10\") "
Aug 05 17:55:32.187478 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187467    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:55:32.187632 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:55:32.187632 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187603    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-data" (OuterVolumeSpecName: "istio-data") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:55:32.187745 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187702    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de4c02a-d05a-4736-90de-c7f629e53a10-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:55:32.187943 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.187920    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:55:32.188098 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.188078    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.188151 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.188117    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.188151 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.188135    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.189452 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.189428    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-kube-api-access-9lrlq" (OuterVolumeSpecName: "kube-api-access-9lrlq") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "kube-api-access-9lrlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:55:32.189555 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.189493    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:55:32.190101 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.190077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:55:32.190101 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.190086    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-token" (OuterVolumeSpecName: "istio-token") pod "2de4c02a-d05a-4736-90de-c7f629e53a10" (UID: "2de4c02a-d05a-4736-90de-c7f629e53a10"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:55:32.289348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.289319    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.289348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.289345    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2de4c02a-d05a-4736-90de-c7f629e53a10-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.289348 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.289354    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.289599 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.289363    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.289599 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.289373    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2de4c02a-d05a-4736-90de-c7f629e53a10-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.289599 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.289382    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lrlq\" (UniqueName: \"kubernetes.io/projected/2de4c02a-d05a-4736-90de-c7f629e53a10-kube-api-access-9lrlq\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:55:32.699743 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.699700    2560 generic.go:356] "Generic (PLEG): container finished" podID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerID="ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd" exitCode=0
Aug 05 17:55:32.699983 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.699779    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"
Aug 05 17:55:32.699983 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.699800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" event={"ID":"2de4c02a-d05a-4736-90de-c7f629e53a10","Type":"ContainerDied","Data":"ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd"}
Aug 05 17:55:32.699983 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.699908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p" event={"ID":"2de4c02a-d05a-4736-90de-c7f629e53a10","Type":"ContainerDied","Data":"b5b3f7ca2bed2a91d4ce918db417095d91529b0d5ec0c0c32c975943a39c8293"}
Aug 05 17:55:32.699983 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.699941    2560 scope.go:117] "RemoveContainer" containerID="ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd"
Aug 05 17:55:32.709770 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.709752    2560 scope.go:117] "RemoveContainer" containerID="2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d"
Aug 05 17:55:32.718669 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.718647    2560 scope.go:117] "RemoveContainer" containerID="ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd"
Aug 05 17:55:32.718979 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:55:32.718959    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd\": container with ID starting with ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd not found: ID does not exist" containerID="ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd"
Aug 05 17:55:32.719053 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.718989    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd"} err="failed to get container status \"ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd\": rpc error: code = NotFound desc = could not find container \"ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd\": container with ID starting with ee2a4511ffb18e8aa3b9646051db8650e5d53a14b9f303e0909b00e0a654efcd not found: ID does not exist"
Aug 05 17:55:32.719053 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.719010    2560 scope.go:117] "RemoveContainer" containerID="2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d"
Aug 05 17:55:32.719262 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:55:32.719245    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d\": container with ID starting with 2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d not found: ID does not exist" containerID="2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d"
Aug 05 17:55:32.719301 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.719268    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d"} err="failed to get container status \"2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d\": rpc error: code = NotFound desc = could not find container \"2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d\": container with ID starting with 2c6c29eb30e428411491212b7e1b2d7ec6aeb6da691c02bbfe23f6a0e307832d not found: ID does not exist"
Aug 05 17:55:32.726555 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.726533    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"]
Aug 05 17:55:32.745092 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:32.745067    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0d1b0907-openshift-default-7ddc5fbb96-n2m5p"]
Aug 05 17:55:34.060649 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:34.060608    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" path="/var/lib/kubelet/pods/2de4c02a-d05a-4736-90de-c7f629e53a10/volumes"
Aug 05 17:55:39.331468 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:39.331424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:46.995946 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:46.995907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:47.102045 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:47.102008    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:47.225462 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:47.225427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:47.331774 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:47.331663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:55:47.757955 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:55:47.757924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:13.727224 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:13.727179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:20.114538 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:20.114506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:20.186446 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:20.186415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:20.316998 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:20.316964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:20.428309 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:20.428272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:38.248175 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:38.248139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:44.275317 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:44.275273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:44.336621 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:44.336579    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:44.424250 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:44.424212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:44.525942 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:44.525822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:56:54.976725 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:56:54.976631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:05.998018 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:05.997985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:08.457370 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:08.457337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:08.561295 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:08.561257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:12.600962 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:12.600927    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:12.721245 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:12.721205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:12.817303 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:12.817262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:12.916955 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:12.916921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:13.558219 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:13.558183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:13.651116 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:13.651073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:13.749079 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:13.749045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:15.197508 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:15.197472    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:22.427125 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:22.427091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:22.487012 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:22.486977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:23.092722 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:23.092683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:30.054622 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.054578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:30.155594 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.155557    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:30.293608 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.293552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:30.569258 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569231    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"]
Aug 05 17:57:30.569610 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569598    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy"
Aug 05 17:57:30.569657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569611    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy"
Aug 05 17:57:30.569657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569619    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23bc7859-0a6f-4e72-b1d8-a07a33ffce5a" containerName="revoke-keys"
Aug 05 17:57:30.569657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569624    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="23bc7859-0a6f-4e72-b1d8-a07a33ffce5a" containerName="revoke-keys"
Aug 05 17:57:30.569657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569634    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951bd175-67d9-4a0e-a4c1-12c5a29b1755" containerName="payload-pre-processing"
Aug 05 17:57:30.569657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569643    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="951bd175-67d9-4a0e-a4c1-12c5a29b1755" containerName="payload-pre-processing"
Aug 05 17:57:30.569657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569652    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy"
Aug 05 17:57:30.569657 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569658    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy"
Aug 05 17:57:30.569922 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569714    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy"
Aug 05 17:57:30.569922 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569722    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="951bd175-67d9-4a0e-a4c1-12c5a29b1755" containerName="payload-pre-processing"
Aug 05 17:57:30.569922 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569729    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="23bc7859-0a6f-4e72-b1d8-a07a33ffce5a" containerName="revoke-keys"
Aug 05 17:57:30.569922 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.569736    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de4c02a-d05a-4736-90de-c7f629e53a10" containerName="istio-proxy"
Aug 05 17:57:30.571716 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.571702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.574287 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.574270    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cc16b618-openshift-default-dockercfg-wqf6r\""
Aug 05 17:57:30.594122 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.594096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"]
Aug 05 17:57:30.594598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.594571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:30.679414 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-envoy\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-certs\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-socket\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-data\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9q42\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-kube-api-access-p9q42\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679782 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-credential-socket\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679782 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-istio-token\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679782 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9903208b-1f24-48d1-b2c0-00abe6056714-istio-podinfo\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.679782 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.679751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9903208b-1f24-48d1-b2c0-00abe6056714-istiod-ca-cert\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.780676 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-data\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.780900 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9q42\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-kube-api-access-p9q42\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.780900 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-credential-socket\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.780900 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-istio-token\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.780900 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9903208b-1f24-48d1-b2c0-00abe6056714-istio-podinfo\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781154 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9903208b-1f24-48d1-b2c0-00abe6056714-istiod-ca-cert\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781154 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-envoy\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781154 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.780994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-certs\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781154 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.781051    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-socket\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781154 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.781127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-data\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781427 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.781186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-credential-socket\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781427 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.781343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-socket\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.781520 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.781471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-certs\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.782019 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.781991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9903208b-1f24-48d1-b2c0-00abe6056714-istiod-ca-cert\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.783474 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.783449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-envoy\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.783670 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.783652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9903208b-1f24-48d1-b2c0-00abe6056714-istio-podinfo\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.794324 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.789954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-istio-token\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.794324 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.790722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9q42\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-kube-api-access-p9q42\") pod \"e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") " pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.882021 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.881942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:30.885458 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:30.885422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:31.029879 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.029819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"]
Aug 05 17:57:31.031837 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:57:31.031804    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9903208b_1f24_48d1_b2c0_00abe6056714.slice/crio-0c4181939141c5807f8ff756fc1b93b4656f1b9479281a2e8ede2f194a96d5e8 WatchSource:0}: Error finding container 0c4181939141c5807f8ff756fc1b93b4656f1b9479281a2e8ede2f194a96d5e8: Status 404 returned error can't find the container with id 0c4181939141c5807f8ff756fc1b93b4656f1b9479281a2e8ede2f194a96d5e8
Aug 05 17:57:31.034414 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.034379    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:57:31.034481 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.034464    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:57:31.034517 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.034507    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:57:31.366786 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.366754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" event={"ID":"9903208b-1f24-48d1-b2c0-00abe6056714","Type":"ContainerStarted","Data":"8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786"}
Aug 05 17:57:31.367188 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.366802    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" event={"ID":"9903208b-1f24-48d1-b2c0-00abe6056714","Type":"ContainerStarted","Data":"0c4181939141c5807f8ff756fc1b93b4656f1b9479281a2e8ede2f194a96d5e8"}
Aug 05 17:57:31.388802 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.388756    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podStartSLOduration=1.388741886 podStartE2EDuration="1.388741886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:57:31.38726731 +0000 UTC m=+2099.872190744" watchObservedRunningTime="2026-08-05 17:57:31.388741886 +0000 UTC m=+2099.873665305"
Aug 05 17:57:31.882353 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:31.882319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:32.887105 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:32.887078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:33.287444 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:33.287405    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:33.377926 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:33.377894    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:33.379056 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:33.379031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:33.381292 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:33.381266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:34.531504 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:34.531459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:34.839598 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:34.839506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:35.204420 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:35.204379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:35.305479 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:35.305443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:48.379419 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.379335    2560 patch_prober.go:28] interesting pod/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:57:48.379419 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.379401    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 05 17:57:48.465613 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.465581    2560 generic.go:356] "Generic (PLEG): container finished" podID="9903208b-1f24-48d1-b2c0-00abe6056714" containerID="8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786" exitCode=0
Aug 05 17:57:48.465825 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.465645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" event={"ID":"9903208b-1f24-48d1-b2c0-00abe6056714","Type":"ContainerDied","Data":"8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786"}
Aug 05 17:57:48.466106 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.466091    2560 scope.go:117] "RemoveContainer" containerID="8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786"
Aug 05 17:57:48.467117 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.467089    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:57:48.467201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.467166    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:57:48.467201 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:48.467196    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 17:57:49.474302 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:49.474261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" event={"ID":"9903208b-1f24-48d1-b2c0-00abe6056714","Type":"ContainerStarted","Data":"9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d"}
Aug 05 17:57:49.883123 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:49.883033    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:49.883294 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:49.883268    2560 patch_prober.go:28] interesting pod/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:57:49.883346 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:49.883326    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 05 17:57:50.883034 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:50.882992    2560 patch_prober.go:28] interesting pod/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:57:50.883449 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:50.883081    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 05 17:57:51.882413 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:51.882371    2560 patch_prober.go:28] interesting pod/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:57:51.882612 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:51.882429    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 05 17:57:52.883092 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:52.883056    2560 patch_prober.go:28] interesting pod/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:57:52.883532 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:52.883116    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 05 17:57:53.882608 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:53.882563    2560 patch_prober.go:28] interesting pod/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:57:53.882827 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:53.882641    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 05 17:57:54.886551 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:54.886517    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:54.886964 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:54.886789    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:54.887559 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:54.887543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:57:58.240391 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:58.240357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:58.885221 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:58.885178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:58.981627 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:58.981589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:57:59.294423 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:57:59.294386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:05.309185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.309127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:05.366254 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.366224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:05.670403 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.670350    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"]
Aug 05 17:58:05.674489 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.674469    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"
Aug 05 17:58:05.677143 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.677101    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 17:58:05.677143 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.677126    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:58:05.679586 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.679562    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"]
Aug 05 17:58:05.711865 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.711813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9874127-313e-4d13-bcdc-c1c9af593596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t\" (UID: \"f9874127-313e-4d13-bcdc-c1c9af593596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"
Aug 05 17:58:05.812498 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.812465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9874127-313e-4d13-bcdc-c1c9af593596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t\" (UID: \"f9874127-313e-4d13-bcdc-c1c9af593596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"
Aug 05 17:58:05.813062 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.813045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9874127-313e-4d13-bcdc-c1c9af593596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t\" (UID: \"f9874127-313e-4d13-bcdc-c1c9af593596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"
Aug 05 17:58:05.986419 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:05.986330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"
Aug 05 17:58:06.133276 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:06.133255    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"]
Aug 05 17:58:06.135432 ip-10-0-138-196 kubenswrapper[2560]: W0805 17:58:06.135398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9874127_313e_4d13_bcdc_c1c9af593596.slice/crio-5d8a3bf675450a13a9d6e588db6b32521aef8fd2029dfb17d9b26f04038d4929 WatchSource:0}: Error finding container 5d8a3bf675450a13a9d6e588db6b32521aef8fd2029dfb17d9b26f04038d4929: Status 404 returned error can't find the container with id 5d8a3bf675450a13a9d6e588db6b32521aef8fd2029dfb17d9b26f04038d4929
Aug 05 17:58:06.575660 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:06.575628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t" event={"ID":"f9874127-313e-4d13-bcdc-c1c9af593596","Type":"ContainerStarted","Data":"dd78ce3777137d634046c02a1a00b93a6a443e6a8863fe21682ce90bd6a919e2"}
Aug 05 17:58:06.576083 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:06.575680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t" event={"ID":"f9874127-313e-4d13-bcdc-c1c9af593596","Type":"ContainerStarted","Data":"5d8a3bf675450a13a9d6e588db6b32521aef8fd2029dfb17d9b26f04038d4929"}
Aug 05 17:58:06.591525 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:06.591475    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t" podStartSLOduration=1.5914622980000002 podStartE2EDuration="1.591462298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:58:06.590064848 +0000 UTC m=+2135.074988268" watchObservedRunningTime="2026-08-05 17:58:06.591462298 +0000 UTC m=+2135.076385754"
Aug 05 17:58:07.583402 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:07.583368    2560 generic.go:356] "Generic (PLEG): container finished" podID="f9874127-313e-4d13-bcdc-c1c9af593596" containerID="dd78ce3777137d634046c02a1a00b93a6a443e6a8863fe21682ce90bd6a919e2" exitCode=0
Aug 05 17:58:07.583867 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:07.583466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t" event={"ID":"f9874127-313e-4d13-bcdc-c1c9af593596","Type":"ContainerDied","Data":"dd78ce3777137d634046c02a1a00b93a6a443e6a8863fe21682ce90bd6a919e2"}
Aug 05 17:58:08.722161 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:08.722139    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"
Aug 05 17:58:08.737728 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:08.737702    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9874127-313e-4d13-bcdc-c1c9af593596-maas-api-service-ca\") pod \"f9874127-313e-4d13-bcdc-c1c9af593596\" (UID: \"f9874127-313e-4d13-bcdc-c1c9af593596\") "
Aug 05 17:58:08.738153 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:08.738122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9874127-313e-4d13-bcdc-c1c9af593596-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9874127-313e-4d13-bcdc-c1c9af593596" (UID: "f9874127-313e-4d13-bcdc-c1c9af593596"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:58:08.838857 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:08.838823    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9874127-313e-4d13-bcdc-c1c9af593596-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:09.596870 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:09.596827    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"
Aug 05 17:58:09.597054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:09.596868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t" event={"ID":"f9874127-313e-4d13-bcdc-c1c9af593596","Type":"ContainerDied","Data":"5d8a3bf675450a13a9d6e588db6b32521aef8fd2029dfb17d9b26f04038d4929"}
Aug 05 17:58:09.597054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:09.596911    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d8a3bf675450a13a9d6e588db6b32521aef8fd2029dfb17d9b26f04038d4929"
Aug 05 17:58:16.140410 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:16.140357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:16.210954 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:16.210913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:16.287454 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:16.287414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:16.329560 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:16.329530    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"]
Aug 05 17:58:16.331874 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:16.331840    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc16b618-n7b9t"]
Aug 05 17:58:16.382980 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:16.382946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:16.734516 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:16.734477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:18.060799 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:18.060751    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9874127-313e-4d13-bcdc-c1c9af593596" path="/var/lib/kubelet/pods/f9874127-313e-4d13-bcdc-c1c9af593596/volumes"
Aug 05 17:58:22.802345 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:22.802255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:22.873168 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:22.873124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:23.040861 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:23.040811    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"]
Aug 05 17:58:23.041182 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:23.041122    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" containerID="cri-o://9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d" gracePeriod=30
Aug 05 17:58:23.057421 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:23.057327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:23.287748 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:23.287711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:23.398402 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:23.398317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:23.498900 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:23.498834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:23.631587 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:23.631555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:24.889295 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:24.889257    2560 patch_prober.go:28] interesting pod/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:58:24.889759 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:24.889333    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:58:28.288145 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.288117    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:58:28.425489 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-istio-token\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-socket\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9q42\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-kube-api-access-p9q42\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425602    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9903208b-1f24-48d1-b2c0-00abe6056714-istio-podinfo\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425664 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425649    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-envoy\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-credential-socket\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425699    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-certs\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425724    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9903208b-1f24-48d1-b2c0-00abe6056714-istiod-ca-cert\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425758    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-data\") pod \"9903208b-1f24-48d1-b2c0-00abe6056714\" (UID: \"9903208b-1f24-48d1-b2c0-00abe6056714\") "
Aug 05 17:58:28.425994 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.425947    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:58:28.426234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.426025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:58:28.426234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.426077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:58:28.426234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.426155    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.426234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.426175    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.426234 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.426182    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-data" (OuterVolumeSpecName: "istio-data") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:58:28.426492 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.426361    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9903208b-1f24-48d1-b2c0-00abe6056714-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:58:28.428080 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.428041    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-kube-api-access-p9q42" (OuterVolumeSpecName: "kube-api-access-p9q42") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "kube-api-access-p9q42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:58:28.428198 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.428091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:58:28.428198 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.428121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-istio-token" (OuterVolumeSpecName: "istio-token") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:58:28.428198 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.428127    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9903208b-1f24-48d1-b2c0-00abe6056714-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9903208b-1f24-48d1-b2c0-00abe6056714" (UID: "9903208b-1f24-48d1-b2c0-00abe6056714"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:58:28.527438 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.527396    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9q42\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-kube-api-access-p9q42\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.527438 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.527432    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9903208b-1f24-48d1-b2c0-00abe6056714-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.527438 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.527441    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.527438 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.527451    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.527713 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.527461    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9903208b-1f24-48d1-b2c0-00abe6056714-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.527713 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.527469    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9903208b-1f24-48d1-b2c0-00abe6056714-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.527713 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.527476    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9903208b-1f24-48d1-b2c0-00abe6056714-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:58:28.713439 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.713352    2560 generic.go:356] "Generic (PLEG): container finished" podID="9903208b-1f24-48d1-b2c0-00abe6056714" containerID="9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d" exitCode=0
Aug 05 17:58:28.713439 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.713404    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"
Aug 05 17:58:28.713666 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.713440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" event={"ID":"9903208b-1f24-48d1-b2c0-00abe6056714","Type":"ContainerDied","Data":"9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d"}
Aug 05 17:58:28.713666 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.713494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c" event={"ID":"9903208b-1f24-48d1-b2c0-00abe6056714","Type":"ContainerDied","Data":"0c4181939141c5807f8ff756fc1b93b4656f1b9479281a2e8ede2f194a96d5e8"}
Aug 05 17:58:28.713666 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.713518    2560 scope.go:117] "RemoveContainer" containerID="9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d"
Aug 05 17:58:28.723365 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.723351    2560 scope.go:117] "RemoveContainer" containerID="8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786"
Aug 05 17:58:28.731775 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.731747    2560 scope.go:117] "RemoveContainer" containerID="9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d"
Aug 05 17:58:28.732185 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:58:28.732109    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d\": container with ID starting with 9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d not found: ID does not exist" containerID="9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d"
Aug 05 17:58:28.732185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.732153    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d"} err="failed to get container status \"9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d\": rpc error: code = NotFound desc = could not find container \"9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d\": container with ID starting with 9bfab32fb58cb4a856dd036b145279eb7dbfc38dd26065686725815c74319e5d not found: ID does not exist"
Aug 05 17:58:28.732185 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.732178    2560 scope.go:117] "RemoveContainer" containerID="8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786"
Aug 05 17:58:28.732472 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:58:28.732453    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786\": container with ID starting with 8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786 not found: ID does not exist" containerID="8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786"
Aug 05 17:58:28.732546 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.732480    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786"} err="failed to get container status \"8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786\": rpc error: code = NotFound desc = could not find container \"8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786\": container with ID starting with 8d268648decbc7aaefdd2b0af2ce70fc326f2e795c78d18890121943082bc786 not found: ID does not exist"
Aug 05 17:58:28.734752 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.734732    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"]
Aug 05 17:58:28.740068 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:28.740039    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cc16b618-openshift-default-568dd47fb4-q8g9c"]
Aug 05 17:58:29.548780 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:29.548740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:29.627467 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:29.627427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:29.720597 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:29.720561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:29.943258 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:29.943220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:30.060082 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:30.060049    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" path="/var/lib/kubelet/pods/9903208b-1f24-48d1-b2c0-00abe6056714/volumes"
Aug 05 17:58:30.498182 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:30.498140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:36.064344 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:36.064286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:36.162765 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:36.162728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:58:57.752597 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:58:57.752546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:59:01.776298 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:01.776256    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 17:59:04.248193 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.248147    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"]
Aug 05 17:59:04.248706 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.248404    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v" podUID="961be2bc-c0e8-4a73-9323-29fda15905f5" containerName="manager" containerID="cri-o://dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8" gracePeriod=10
Aug 05 17:59:04.504268 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.504194    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:59:04.573694 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.573660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/961be2bc-c0e8-4a73-9323-29fda15905f5-extensions-socket-volume\") pod \"961be2bc-c0e8-4a73-9323-29fda15905f5\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") "
Aug 05 17:59:04.573883 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.573732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhrl4\" (UniqueName: \"kubernetes.io/projected/961be2bc-c0e8-4a73-9323-29fda15905f5-kube-api-access-bhrl4\") pod \"961be2bc-c0e8-4a73-9323-29fda15905f5\" (UID: \"961be2bc-c0e8-4a73-9323-29fda15905f5\") "
Aug 05 17:59:04.574097 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.574074    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/961be2bc-c0e8-4a73-9323-29fda15905f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "961be2bc-c0e8-4a73-9323-29fda15905f5" (UID: "961be2bc-c0e8-4a73-9323-29fda15905f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:59:04.575998 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.575971    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/961be2bc-c0e8-4a73-9323-29fda15905f5-kube-api-access-bhrl4" (OuterVolumeSpecName: "kube-api-access-bhrl4") pod "961be2bc-c0e8-4a73-9323-29fda15905f5" (UID: "961be2bc-c0e8-4a73-9323-29fda15905f5"). InnerVolumeSpecName "kube-api-access-bhrl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:59:04.674908 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.674809    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/961be2bc-c0e8-4a73-9323-29fda15905f5-extensions-socket-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:59:04.674908 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.674841    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhrl4\" (UniqueName: \"kubernetes.io/projected/961be2bc-c0e8-4a73-9323-29fda15905f5-kube-api-access-bhrl4\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 17:59:04.924360 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.924328    2560 generic.go:356] "Generic (PLEG): container finished" podID="961be2bc-c0e8-4a73-9323-29fda15905f5" containerID="dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8" exitCode=0
Aug 05 17:59:04.924563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.924384    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"
Aug 05 17:59:04.924563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.924425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v" event={"ID":"961be2bc-c0e8-4a73-9323-29fda15905f5","Type":"ContainerDied","Data":"dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8"}
Aug 05 17:59:04.924563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.924478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v" event={"ID":"961be2bc-c0e8-4a73-9323-29fda15905f5","Type":"ContainerDied","Data":"0ad65199796f7f68c91c130fcc31e074e6616f66743f2b3629f00e18fef85439"}
Aug 05 17:59:04.924563 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.924505    2560 scope.go:117] "RemoveContainer" containerID="dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8"
Aug 05 17:59:04.935693 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.935677    2560 scope.go:117] "RemoveContainer" containerID="dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8"
Aug 05 17:59:04.935982 ip-10-0-138-196 kubenswrapper[2560]: E0805 17:59:04.935965    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8\": container with ID starting with dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8 not found: ID does not exist" containerID="dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8"
Aug 05 17:59:04.936054 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.935993    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8"} err="failed to get container status \"dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8\": rpc error: code = NotFound desc = could not find container \"dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8\": container with ID starting with dcc69fa2987a4423e004f280a3b49850070a7aa36fe78cc9c2988814f18fb9b8 not found: ID does not exist"
Aug 05 17:59:04.948171 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.948142    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"]
Aug 05 17:59:04.951468 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:04.951443    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-6q72v"]
Aug 05 17:59:06.061044 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:06.061016    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="961be2bc-c0e8-4a73-9323-29fda15905f5" path="/var/lib/kubelet/pods/961be2bc-c0e8-4a73-9323-29fda15905f5/volumes"
Aug 05 17:59:32.217917 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:32.217885    2560 scope.go:117] "RemoveContainer" containerID="722be1ff9976e340513ebcdd76e88239bfb57f2c21dee6a255a33f5a12927c4e"
Aug 05 17:59:37.981400 ip-10-0-138-196 kubenswrapper[2560]: I0805 17:59:37.981350    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:00.145477 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145394    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627"]
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145752    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy"
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145762    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy"
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145773    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy"
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145779    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy"
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145785    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9874127-313e-4d13-bcdc-c1c9af593596" containerName="revoke-keys"
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145791    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9874127-313e-4d13-bcdc-c1c9af593596" containerName="revoke-keys"
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145806    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961be2bc-c0e8-4a73-9323-29fda15905f5" containerName="manager"
Aug 05 18:00:00.145869 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145810    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="961be2bc-c0e8-4a73-9323-29fda15905f5" containerName="manager"
Aug 05 18:00:00.146128 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145884    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="961be2bc-c0e8-4a73-9323-29fda15905f5" containerName="manager"
Aug 05 18:00:00.146128 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145894    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy"
Aug 05 18:00:00.146128 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145900    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9903208b-1f24-48d1-b2c0-00abe6056714" containerName="istio-proxy"
Aug 05 18:00:00.146128 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.145907    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9874127-313e-4d13-bcdc-c1c9af593596" containerName="revoke-keys"
Aug 05 18:00:00.148055 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.148039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627"
Aug 05 18:00:00.150330 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.150313    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:00:00.156449 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.156422    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627"]
Aug 05 18:00:00.158613 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.158596    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627"
Aug 05 18:00:00.297069 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:00.297041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627"]
Aug 05 18:00:00.299759 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:00:00.299725    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode751d08c_2e77_4264_9306_5813ce84c0a5.slice/crio-ae4711a07dc550d55136408ad5bcdb4d4d7e63ad16fa817045856350309a1dde WatchSource:0}: Error finding container ae4711a07dc550d55136408ad5bcdb4d4d7e63ad16fa817045856350309a1dde: Status 404 returned error can't find the container with id ae4711a07dc550d55136408ad5bcdb4d4d7e63ad16fa817045856350309a1dde
Aug 05 18:00:01.242307 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:01.242267    2560 generic.go:356] "Generic (PLEG): container finished" podID="e751d08c-2e77-4264-9306-5813ce84c0a5" containerID="658996c082e180c3fe4467987ed3aec09514543393fe0da82c9575afe00696b3" exitCode=0
Aug 05 18:00:01.242718 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:01.242352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627" event={"ID":"e751d08c-2e77-4264-9306-5813ce84c0a5","Type":"ContainerDied","Data":"658996c082e180c3fe4467987ed3aec09514543393fe0da82c9575afe00696b3"}
Aug 05 18:00:01.242718 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:01.242402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627" event={"ID":"e751d08c-2e77-4264-9306-5813ce84c0a5","Type":"ContainerStarted","Data":"ae4711a07dc550d55136408ad5bcdb4d4d7e63ad16fa817045856350309a1dde"}
Aug 05 18:00:02.391656 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:02.391625    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627"
Aug 05 18:00:03.262346 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:03.262315    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627"
Aug 05 18:00:03.262609 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:03.262343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765880-8l627" event={"ID":"e751d08c-2e77-4264-9306-5813ce84c0a5","Type":"ContainerDied","Data":"ae4711a07dc550d55136408ad5bcdb4d4d7e63ad16fa817045856350309a1dde"}
Aug 05 18:00:03.262609 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:03.262389    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae4711a07dc550d55136408ad5bcdb4d4d7e63ad16fa817045856350309a1dde"
Aug 05 18:00:19.890339 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.890305    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"]
Aug 05 18:00:19.890961 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.890871    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e751d08c-2e77-4264-9306-5813ce84c0a5" containerName="cleanup"
Aug 05 18:00:19.890961 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.890892    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e751d08c-2e77-4264-9306-5813ce84c0a5" containerName="cleanup"
Aug 05 18:00:19.891093 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.890988    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e751d08c-2e77-4264-9306-5813ce84c0a5" containerName="cleanup"
Aug 05 18:00:19.898783 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.898745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:19.902120 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.902100    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tq282\""
Aug 05 18:00:19.908980 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.908958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"]
Aug 05 18:00:19.957575 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.957542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89zjp\" (UniqueName: \"kubernetes.io/projected/a025f2ef-eb73-4d27-96e7-d0ab0b54a0da-kube-api-access-89zjp\") pod \"kuadrant-operator-controller-manager-68cf589589-xqgn8\" (UID: \"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:19.957745 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:19.957602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a025f2ef-eb73-4d27-96e7-d0ab0b54a0da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xqgn8\" (UID: \"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:20.058686 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:20.058654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89zjp\" (UniqueName: \"kubernetes.io/projected/a025f2ef-eb73-4d27-96e7-d0ab0b54a0da-kube-api-access-89zjp\") pod \"kuadrant-operator-controller-manager-68cf589589-xqgn8\" (UID: \"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:20.058906 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:20.058726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a025f2ef-eb73-4d27-96e7-d0ab0b54a0da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xqgn8\" (UID: \"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:20.059197 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:20.059177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a025f2ef-eb73-4d27-96e7-d0ab0b54a0da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-xqgn8\" (UID: \"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:20.072106 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:20.072071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89zjp\" (UniqueName: \"kubernetes.io/projected/a025f2ef-eb73-4d27-96e7-d0ab0b54a0da-kube-api-access-89zjp\") pod \"kuadrant-operator-controller-manager-68cf589589-xqgn8\" (UID: \"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:20.210234 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:20.210200    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:20.369970 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:20.369946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"]
Aug 05 18:00:20.371738 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:00:20.371710    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda025f2ef_eb73_4d27_96e7_d0ab0b54a0da.slice/crio-ef4e8ba13bcc1fec0bd106419ceb438308ee18676cbfe318823d2552382977f2 WatchSource:0}: Error finding container ef4e8ba13bcc1fec0bd106419ceb438308ee18676cbfe318823d2552382977f2: Status 404 returned error can't find the container with id ef4e8ba13bcc1fec0bd106419ceb438308ee18676cbfe318823d2552382977f2
Aug 05 18:00:21.366238 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:21.366199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8" event={"ID":"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da","Type":"ContainerStarted","Data":"69cdcc4f52e57bb4d905eaae98ccc3339a20379eade493699c0888b45f98dfb6"}
Aug 05 18:00:21.366642 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:21.366253    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8" event={"ID":"a025f2ef-eb73-4d27-96e7-d0ab0b54a0da","Type":"ContainerStarted","Data":"ef4e8ba13bcc1fec0bd106419ceb438308ee18676cbfe318823d2552382977f2"}
Aug 05 18:00:21.366642 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:21.366339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:21.412329 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:21.412250    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8" podStartSLOduration=2.412234008 podStartE2EDuration="2.412234008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:00:21.408962867 +0000 UTC m=+2269.893886285" watchObservedRunningTime="2026-08-05 18:00:21.412234008 +0000 UTC m=+2269.897157427"
Aug 05 18:00:32.243420 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:32.243387    2560 scope.go:117] "RemoveContainer" containerID="f35dfea74a11e11bcfc6d2279363a905dd0eb3f6ada1c4a34973f580b6d1b88b"
Aug 05 18:00:32.373988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:32.373964    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-xqgn8"
Aug 05 18:00:38.835127 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:38.835084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:39.111209 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.111120    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"]
Aug 05 18:00:39.121694 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.121667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.124675 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.124632    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-75d3fbe4-openshift-default-dockercfg-7xq2j\""
Aug 05 18:00:39.126210 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.126186    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"]
Aug 05 18:00:39.229807 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.229775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-certs\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230005 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.229819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-envoy\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230005 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.229863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-credential-socket\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230005 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.229900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-data\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230005 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.229945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-podinfo\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230005 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.229989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-socket\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230005 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.230008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-token\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.230063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5s74\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-kube-api-access-w5s74\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.230327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.230106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561c47b9-dc37-4e17-a2d8-756d431ce526-istiod-ca-cert\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.331567 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-certs\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.331567 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-envoy\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.331833 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-credential-socket\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.331833 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-data\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.331971 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-podinfo\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.331971 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-socket\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-certs\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.331986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-token\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.332068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-credential-socket\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332245 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.332103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-data\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332245 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.332140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5s74\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-kube-api-access-w5s74\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332245 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.332183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561c47b9-dc37-4e17-a2d8-756d431ce526-istiod-ca-cert\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332644 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.332622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-socket\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.332891 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.332840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561c47b9-dc37-4e17-a2d8-756d431ce526-istiod-ca-cert\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.334118 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.334102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-envoy\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.334617 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.334598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-podinfo\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.340124 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.340107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-token\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.340548 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.340524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5s74\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-kube-api-access-w5s74\") pod \"e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") " pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.435837 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.435797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:39.586766 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.586740    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"]
Aug 05 18:00:39.588705 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:00:39.588674    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561c47b9_dc37_4e17_a2d8_756d431ce526.slice/crio-daec717bc28c6b25901fa4d2db5c5ccf6beee4650adff4d60ea2dbac2124b02f WatchSource:0}: Error finding container daec717bc28c6b25901fa4d2db5c5ccf6beee4650adff4d60ea2dbac2124b02f: Status 404 returned error can't find the container with id daec717bc28c6b25901fa4d2db5c5ccf6beee4650adff4d60ea2dbac2124b02f
Aug 05 18:00:39.591519 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.591482    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:00:39.591610 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.591579    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:00:39.591660 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:39.591620    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:00:40.480150 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:40.480097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" event={"ID":"561c47b9-dc37-4e17-a2d8-756d431ce526","Type":"ContainerStarted","Data":"492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28"}
Aug 05 18:00:40.480536 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:40.480172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" event={"ID":"561c47b9-dc37-4e17-a2d8-756d431ce526","Type":"ContainerStarted","Data":"daec717bc28c6b25901fa4d2db5c5ccf6beee4650adff4d60ea2dbac2124b02f"}
Aug 05 18:00:40.503012 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:40.502963    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podStartSLOduration=1.502947717 podStartE2EDuration="1.502947717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:00:40.500670599 +0000 UTC m=+2288.985594019" watchObservedRunningTime="2026-08-05 18:00:40.502947717 +0000 UTC m=+2288.987871136"
Aug 05 18:00:41.436531 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:41.436492    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:41.441821 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:41.441796    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:41.486081 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:41.486051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:41.487068 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:41.487052    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:41.724482 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:41.724363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:42.477307 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:42.477272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:42.822492 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:42.822392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:43.597073 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:43.597038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:43.908437 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:43.908352    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:44.096336 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:44.096286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:44.190650 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:44.190617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:00:56.567594 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:56.567556    2560 patch_prober.go:28] interesting pod/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:34854->10.134.0.59:15021: read: connection reset by peer" start-of-body=
Aug 05 18:00:56.568090 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:56.567643    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:34854->10.134.0.59:15021: read: connection reset by peer"
Aug 05 18:00:56.604934 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:00:56.604903    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561c47b9_dc37_4e17_a2d8_756d431ce526.slice/crio-conmon-492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561c47b9_dc37_4e17_a2d8_756d431ce526.slice/crio-492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28.scope\": RecentStats: unable to find data in memory cache]"
Aug 05 18:00:57.588889 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:57.588833    2560 generic.go:356] "Generic (PLEG): container finished" podID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerID="492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28" exitCode=0
Aug 05 18:00:57.589274 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:57.588907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" event={"ID":"561c47b9-dc37-4e17-a2d8-756d431ce526","Type":"ContainerDied","Data":"492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28"}
Aug 05 18:00:57.589320 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:57.589274    2560 scope.go:117] "RemoveContainer" containerID="492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28"
Aug 05 18:00:57.590272 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:57.590247    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:00:57.590352 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:57.590309    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:00:57.590352 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:57.590340    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:00:58.597210 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:58.597176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" event={"ID":"561c47b9-dc37-4e17-a2d8-756d431ce526","Type":"ContainerStarted","Data":"efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6"}
Aug 05 18:00:59.436200 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:59.436161    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:00:59.436437 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:59.436417    2560 patch_prober.go:28] interesting pod/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 05 18:00:59.436487 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:00:59.436463    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 05 18:01:00.436448 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:00.436409    2560 patch_prober.go:28] interesting pod/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 05 18:01:00.436882 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:00.436476    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 05 18:01:01.437137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:01.437100    2560 patch_prober.go:28] interesting pod/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 05 18:01:01.437539 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:01.437159    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 05 18:01:02.436614 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:02.436577    2560 patch_prober.go:28] interesting pod/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 05 18:01:02.436827 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:02.436642    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 05 18:01:03.436199 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:03.436164    2560 patch_prober.go:28] interesting pod/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 05 18:01:03.436675 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:03.436234    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 05 18:01:04.440279 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:04.440251    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:01:04.440768 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:04.440527    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:01:04.441264 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:04.441249    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:01:07.381142 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:07.381105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:01:15.313318 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:15.313282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:01:32.264821 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:32.264745    2560 scope.go:117] "RemoveContainer" containerID="e3ec90b4c8dc98e0df066eb7105764f8529b9805577ee05b4315f5e7799fb483"
Aug 05 18:01:32.273643 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:32.273623    2560 scope.go:117] "RemoveContainer" containerID="0c9d885ffce7e3e5fd40f1cf6e807032a123ff95f185774001d9187a6bf815ee"
Aug 05 18:01:57.096765 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.096731    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"]
Aug 05 18:01:57.099371 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.099352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"
Aug 05 18:01:57.101938 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.101900    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:01:57.102056 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.101937    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 18:01:57.108892 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.108838    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"]
Aug 05 18:01:57.146653 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.146618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9602d39-97bf-4750-93ae-d034d95ff2a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw\" (UID: \"d9602d39-97bf-4750-93ae-d034d95ff2a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"
Aug 05 18:01:57.247972 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.247935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9602d39-97bf-4750-93ae-d034d95ff2a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw\" (UID: \"d9602d39-97bf-4750-93ae-d034d95ff2a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"
Aug 05 18:01:57.248582 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.248562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9602d39-97bf-4750-93ae-d034d95ff2a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw\" (UID: \"d9602d39-97bf-4750-93ae-d034d95ff2a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"
Aug 05 18:01:57.410791 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.410694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"
Aug 05 18:01:57.553780 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.553749    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"]
Aug 05 18:01:57.555423 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:01:57.555392    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9602d39_97bf_4750_93ae_d034d95ff2a3.slice/crio-251cc285afeb70e566a76e0717ed7c0004116859e64899d0295a307d92f3195d WatchSource:0}: Error finding container 251cc285afeb70e566a76e0717ed7c0004116859e64899d0295a307d92f3195d: Status 404 returned error can't find the container with id 251cc285afeb70e566a76e0717ed7c0004116859e64899d0295a307d92f3195d
Aug 05 18:01:57.931833 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.931785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw" event={"ID":"d9602d39-97bf-4750-93ae-d034d95ff2a3","Type":"ContainerStarted","Data":"ffda82637eb17992872e9850c1203a1371391115d7084698dc724b3599c31179"}
Aug 05 18:01:57.932028 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.931889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw" event={"ID":"d9602d39-97bf-4750-93ae-d034d95ff2a3","Type":"ContainerStarted","Data":"251cc285afeb70e566a76e0717ed7c0004116859e64899d0295a307d92f3195d"}
Aug 05 18:01:57.948374 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:57.948317    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw" podStartSLOduration=0.94829946 podStartE2EDuration="948.29946ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:01:57.946829587 +0000 UTC m=+2366.431753006" watchObservedRunningTime="2026-08-05 18:01:57.94829946 +0000 UTC m=+2366.433222880"
Aug 05 18:01:58.938804 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:58.938763    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9602d39-97bf-4750-93ae-d034d95ff2a3" containerID="ffda82637eb17992872e9850c1203a1371391115d7084698dc724b3599c31179" exitCode=0
Aug 05 18:01:58.939225 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:01:58.938867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw" event={"ID":"d9602d39-97bf-4750-93ae-d034d95ff2a3","Type":"ContainerDied","Data":"ffda82637eb17992872e9850c1203a1371391115d7084698dc724b3599c31179"}
Aug 05 18:02:00.080518 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:00.080497    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"
Aug 05 18:02:00.175482 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:00.175440    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9602d39-97bf-4750-93ae-d034d95ff2a3-maas-api-service-ca\") pod \"d9602d39-97bf-4750-93ae-d034d95ff2a3\" (UID: \"d9602d39-97bf-4750-93ae-d034d95ff2a3\") "
Aug 05 18:02:00.175827 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:00.175805    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9602d39-97bf-4750-93ae-d034d95ff2a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d9602d39-97bf-4750-93ae-d034d95ff2a3" (UID: "d9602d39-97bf-4750-93ae-d034d95ff2a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:02:00.276967 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:00.276883    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9602d39-97bf-4750-93ae-d034d95ff2a3-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:02:00.951832 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:00.951792    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"
Aug 05 18:02:00.951832 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:00.951827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw" event={"ID":"d9602d39-97bf-4750-93ae-d034d95ff2a3","Type":"ContainerDied","Data":"251cc285afeb70e566a76e0717ed7c0004116859e64899d0295a307d92f3195d"}
Aug 05 18:02:00.952082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:00.951889    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="251cc285afeb70e566a76e0717ed7c0004116859e64899d0295a307d92f3195d"
Aug 05 18:02:05.967682 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:05.967648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:06.063913 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:06.063881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:06.117331 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:06.117290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:06.183611 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:06.183574    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"]
Aug 05 18:02:06.185620 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:06.185587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:06.186227 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:06.186206    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-75d3fbe4-v9pgw"]
Aug 05 18:02:08.060300 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:08.060268    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9602d39-97bf-4750-93ae-d034d95ff2a3" path="/var/lib/kubelet/pods/d9602d39-97bf-4750-93ae-d034d95ff2a3/volumes"
Aug 05 18:02:09.270404 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:09.270372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:12.108841 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:12.108800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:14.352479 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:14.352444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:22.924518 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:22.924477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:50.772620 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:50.772584    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:51.831391 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:51.831354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:57.692105 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:57.692014    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:57.756600 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:57.756568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:57.950583 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:57.950489    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"]
Aug 05 18:02:57.950756 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:57.950704    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy" containerID="cri-o://efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6" gracePeriod=30
Aug 05 18:02:57.969589 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:57.969552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:02:58.196143 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:02:58.196104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:03.207018 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.206995    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:03:03.260327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260240    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-data\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.260327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260277    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-token\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.260327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260316    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-credential-socket\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.260617 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561c47b9-dc37-4e17-a2d8-756d431ce526-istiod-ca-cert\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.260617 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-envoy\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.260617 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260420    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-certs\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.260617 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260450    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5s74\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-kube-api-access-w5s74\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.260969 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260540    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:03:03.261082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260568    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-data" (OuterVolumeSpecName: "istio-data") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:03:03.261082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260773    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561c47b9-dc37-4e17-a2d8-756d431ce526-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:03:03.261082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.260948    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-socket\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.261082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261016    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:03:03.261301 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:03:03.261301 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261267    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-podinfo\") pod \"561c47b9-dc37-4e17-a2d8-756d431ce526\" (UID: \"561c47b9-dc37-4e17-a2d8-756d431ce526\") "
Aug 05 18:03:03.261604 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261582    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.261693 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261612    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.261693 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261629    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561c47b9-dc37-4e17-a2d8-756d431ce526-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.261693 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261642    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.261693 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.261655    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.262792 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.262755    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-kube-api-access-w5s74" (OuterVolumeSpecName: "kube-api-access-w5s74") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "kube-api-access-w5s74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:03:03.262926 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.262800    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:03:03.262999 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.262971    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-token" (OuterVolumeSpecName: "istio-token") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:03:03.263323 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.263306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "561c47b9-dc37-4e17-a2d8-756d431ce526" (UID: "561c47b9-dc37-4e17-a2d8-756d431ce526"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:03:03.304160 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.304131    2560 generic.go:356] "Generic (PLEG): container finished" podID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerID="efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6" exitCode=0
Aug 05 18:03:03.304327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.304177    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"
Aug 05 18:03:03.304327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.304222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" event={"ID":"561c47b9-dc37-4e17-a2d8-756d431ce526","Type":"ContainerDied","Data":"efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6"}
Aug 05 18:03:03.304327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.304279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs" event={"ID":"561c47b9-dc37-4e17-a2d8-756d431ce526","Type":"ContainerDied","Data":"daec717bc28c6b25901fa4d2db5c5ccf6beee4650adff4d60ea2dbac2124b02f"}
Aug 05 18:03:03.304327 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.304302    2560 scope.go:117] "RemoveContainer" containerID="efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6"
Aug 05 18:03:03.314098 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.314080    2560 scope.go:117] "RemoveContainer" containerID="492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28"
Aug 05 18:03:03.322907 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.322879    2560 scope.go:117] "RemoveContainer" containerID="efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6"
Aug 05 18:03:03.323191 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:03:03.323171    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6\": container with ID starting with efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6 not found: ID does not exist" containerID="efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6"
Aug 05 18:03:03.323245 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.323203    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6"} err="failed to get container status \"efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6\": rpc error: code = NotFound desc = could not find container \"efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6\": container with ID starting with efea6a501203dd82afbe52f41ac60d8d52de73a97b17fbfb4191dd581ff984f6 not found: ID does not exist"
Aug 05 18:03:03.323245 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.323224    2560 scope.go:117] "RemoveContainer" containerID="492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28"
Aug 05 18:03:03.323448 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:03:03.323433    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28\": container with ID starting with 492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28 not found: ID does not exist" containerID="492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28"
Aug 05 18:03:03.323499 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.323453    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28"} err="failed to get container status \"492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28\": rpc error: code = NotFound desc = could not find container \"492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28\": container with ID starting with 492cad3a69c5a43f127a6d7d806747d92c46e20066455ea0efc9d641eb888d28 not found: ID does not exist"
Aug 05 18:03:03.328094 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.328071    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"]
Aug 05 18:03:03.331832 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.331808    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-75d3fbe4-openshift-default-74fc5fdd5b-gmgzs"]
Aug 05 18:03:03.363260 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.363225    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.363260 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.363262    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.363464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.363278    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561c47b9-dc37-4e17-a2d8-756d431ce526-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:03.363464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:03.363291    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5s74\" (UniqueName: \"kubernetes.io/projected/561c47b9-dc37-4e17-a2d8-756d431ce526-kube-api-access-w5s74\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:03:04.061386 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:04.061353    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" path="/var/lib/kubelet/pods/561c47b9-dc37-4e17-a2d8-756d431ce526/volumes"
Aug 05 18:03:09.490601 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:09.490551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:09.590995 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:09.590950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:09.691289 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:09.691228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:10.290296 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:10.290259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:10.386979 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:10.386940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:10.486345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:10.486303    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:11.689891 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:11.689833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:14.013983 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:14.013953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:14.075502 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:14.075473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:18.618485 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:18.618447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:18.682168 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:18.682130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:19.282648 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:19.282601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:26.204372 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:26.204322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:26.272454 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:26.272418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:26.340528 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:26.340493    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:26.443180 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:26.443147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:37.010332 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:37.010300    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:37.143149 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:37.143113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:03:58.088359 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:03:58.088317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:04.694190 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:04.694154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:04.799027 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:04.798993    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:05.033820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.033722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:05.333304 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333227    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"]
Aug 05 18:04:05.333632 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333618    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9602d39-97bf-4750-93ae-d034d95ff2a3" containerName="revoke-keys"
Aug 05 18:04:05.333679 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333634    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9602d39-97bf-4750-93ae-d034d95ff2a3" containerName="revoke-keys"
Aug 05 18:04:05.333679 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333651    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy"
Aug 05 18:04:05.333679 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333656    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy"
Aug 05 18:04:05.333679 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333665    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy"
Aug 05 18:04:05.333679 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333670    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy"
Aug 05 18:04:05.333837 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333731    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy"
Aug 05 18:04:05.333837 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333740    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9602d39-97bf-4750-93ae-d034d95ff2a3" containerName="revoke-keys"
Aug 05 18:04:05.333837 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.333748    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="561c47b9-dc37-4e17-a2d8-756d431ce526" containerName="istio-proxy"
Aug 05 18:04:05.337145 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.337126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.339654 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.339635    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-83d598-openshift-default-dockercfg-9zmtx\""
Aug 05 18:04:05.354770 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.354745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"]
Aug 05 18:04:05.355731 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.355702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:05.426621 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.426584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-credential-socket\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.426832 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.426756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-certs\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.426832 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.426788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-socket\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.426832 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.426810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdp4\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-kube-api-access-6rdp4\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.427030 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.426901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-envoy\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.427030 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.426946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-podinfo\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.427030 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.426983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdaa34c-4aba-468e-913a-e5c914b6352c-istiod-ca-cert\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.427149 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.427067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-token\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.427149 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.427116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-data\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.526360 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.526313    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:05.528381 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-podinfo\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528544 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdaa34c-4aba-468e-913a-e5c914b6352c-istiod-ca-cert\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528544 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-token\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528544 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-data\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528544 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-credential-socket\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528790 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-certs\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528790 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-socket\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528790 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdp4\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-kube-api-access-6rdp4\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.528790 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-envoy\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.529027 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.528995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-data\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.529253 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.529086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-socket\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.529360 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.529248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-credential-socket\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.529360 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.529281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-certs\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.529360 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.529284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdaa34c-4aba-468e-913a-e5c914b6352c-istiod-ca-cert\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.531151 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.531122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-podinfo\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.531249 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.531187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-envoy\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.539256 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.539227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-token\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.539544 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.539526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdp4\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-kube-api-access-6rdp4\") pod \"e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") " pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.647983 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.647894    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:05.798608 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.798583    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"]
Aug 05 18:04:05.800324 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:04:05.800296    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdaa34c_4aba_468e_913a_e5c914b6352c.slice/crio-1c7a37e64eb70faa37e8f577cbacc2e5b400701ff128f2c9783ea6fd5f428ef9 WatchSource:0}: Error finding container 1c7a37e64eb70faa37e8f577cbacc2e5b400701ff128f2c9783ea6fd5f428ef9: Status 404 returned error can't find the container with id 1c7a37e64eb70faa37e8f577cbacc2e5b400701ff128f2c9783ea6fd5f428ef9
Aug 05 18:04:05.802395 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.802362    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:05.802484 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.802443    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:05.802484 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:05.802473    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:06.669800 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:06.669757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" event={"ID":"1bdaa34c-4aba-468e-913a-e5c914b6352c","Type":"ContainerStarted","Data":"79aa8b76000e10190a8841f136a93cb967d64dcb24a9b2a0eae0403a54fe6050"}
Aug 05 18:04:06.670012 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:06.669822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" event={"ID":"1bdaa34c-4aba-468e-913a-e5c914b6352c","Type":"ContainerStarted","Data":"1c7a37e64eb70faa37e8f577cbacc2e5b400701ff128f2c9783ea6fd5f428ef9"}
Aug 05 18:04:06.693258 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:06.693214    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podStartSLOduration=1.6931986509999999 podStartE2EDuration="1.693198651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:04:06.690617624 +0000 UTC m=+2495.175541044" watchObservedRunningTime="2026-08-05 18:04:06.693198651 +0000 UTC m=+2495.178122071"
Aug 05 18:04:07.572273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:07.572226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:07.648611 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:07.648572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:07.654043 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:07.654016    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:07.675579 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:07.675548    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:07.676902 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:07.676878    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:08.596960 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:08.596924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:08.699952 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:08.699921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:09.728569 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:09.728539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:09.922343 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:09.922302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:10.356235 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:10.356172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:10.454110 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:10.454079    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:22.706934 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.706873    2560 patch_prober.go:28] interesting pod/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": read tcp 10.134.0.2:50738->10.134.0.61:15021: read: connection reset by peer" start-of-body=
Aug 05 18:04:22.707367 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.706961    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": read tcp 10.134.0.2:50738->10.134.0.61:15021: read: connection reset by peer"
Aug 05 18:04:22.764908 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.764870    2560 generic.go:356] "Generic (PLEG): container finished" podID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerID="79aa8b76000e10190a8841f136a93cb967d64dcb24a9b2a0eae0403a54fe6050" exitCode=0
Aug 05 18:04:22.765069 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.764877    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" event={"ID":"1bdaa34c-4aba-468e-913a-e5c914b6352c","Type":"ContainerDied","Data":"79aa8b76000e10190a8841f136a93cb967d64dcb24a9b2a0eae0403a54fe6050"}
Aug 05 18:04:22.765316 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.765302    2560 scope.go:117] "RemoveContainer" containerID="79aa8b76000e10190a8841f136a93cb967d64dcb24a9b2a0eae0403a54fe6050"
Aug 05 18:04:22.766483 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.766452    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:22.766552 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.766541    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:22.766594 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:22.766577    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:23.774454 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:23.774410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" event={"ID":"1bdaa34c-4aba-468e-913a-e5c914b6352c","Type":"ContainerStarted","Data":"8f1927ae6c77587910f02246fa6888d174c207710d951897affdee34d91fd8d0"}
Aug 05 18:04:24.648892 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:24.648830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:24.649174 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:24.649146    2560 patch_prober.go:28] interesting pod/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 05 18:04:24.649276 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:24.649208    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 05 18:04:25.649259 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:25.649221    2560 patch_prober.go:28] interesting pod/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 05 18:04:25.649895 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:25.649833    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 05 18:04:26.657873 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:26.649283    2560 patch_prober.go:28] interesting pod/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 05 18:04:26.657873 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:26.649353    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 05 18:04:27.649388 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:27.649337    2560 patch_prober.go:28] interesting pod/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 05 18:04:27.649612 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:27.649412    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 05 18:04:28.649102 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:28.649054    2560 patch_prober.go:28] interesting pod/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 05 18:04:28.649659 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:28.649127    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 05 18:04:29.652417 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:29.652386    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:29.653018 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:29.652765    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:29.653540 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:29.653519    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:04:32.318926 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:32.318892    2560 scope.go:117] "RemoveContainer" containerID="dd78ce3777137d634046c02a1a00b93a6a443e6a8863fe21682ce90bd6a919e2"
Aug 05 18:04:33.591511 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:33.591457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:33.906556 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:33.906470    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:34.188236 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.188202    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"]
Aug 05 18:04:34.193342 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.193315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.195954 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.195932    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ed4837-openshift-default-dockercfg-sn5b4\""
Aug 05 18:04:34.204464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.204438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"]
Aug 05 18:04:34.220484 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.220449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:34.293693 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.293654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-data\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.293890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.293699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdw5g\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-kube-api-access-xdw5g\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.293890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.293730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b7357a-97f3-47fe-883b-887b1a13339f-istiod-ca-cert\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.293890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.293760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-certs\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.293890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.293782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-socket\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.294137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.293905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-envoy\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.294137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.293984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-credential-socket\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.294137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.294033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-podinfo\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.294137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.294092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-token\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.380290 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.380255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:34.394992 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.394956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-podinfo\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.394992 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-token\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395221 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-data\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395221 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdw5g\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-kube-api-access-xdw5g\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395221 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b7357a-97f3-47fe-883b-887b1a13339f-istiod-ca-cert\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395221 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-certs\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395221 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-socket\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395221 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-envoy\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395520 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-credential-socket\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395580 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-data\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395636 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-certs\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395684 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-socket\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.395774 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.395695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-credential-socket\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.396063 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.396045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b7357a-97f3-47fe-883b-887b1a13339f-istiod-ca-cert\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.397767 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.397745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-envoy\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.397822 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.397754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-podinfo\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.404936 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.404911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdw5g\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-kube-api-access-xdw5g\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.406045 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.406020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-token\") pod \"e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") " pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.506714 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.506616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:34.656383 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.656351    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"]
Aug 05 18:04:34.657465 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:04:34.657433    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b7357a_97f3_47fe_883b_887b1a13339f.slice/crio-3fc351b77b999b2847f8489ceaaf22f55ecf73a31ef28317512f9b22c9edc426 WatchSource:0}: Error finding container 3fc351b77b999b2847f8489ceaaf22f55ecf73a31ef28317512f9b22c9edc426: Status 404 returned error can't find the container with id 3fc351b77b999b2847f8489ceaaf22f55ecf73a31ef28317512f9b22c9edc426
Aug 05 18:04:34.659944 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.659911    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:34.660064 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.659987    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:34.660064 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.660032    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:34.841742 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.841648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" event={"ID":"e1b7357a-97f3-47fe-883b-887b1a13339f","Type":"ContainerStarted","Data":"7158c5db3867e000d70edc0bda29088668fc2d6afb0b33e269c232bdfb4b318c"}
Aug 05 18:04:34.841742 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.841704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" event={"ID":"e1b7357a-97f3-47fe-883b-887b1a13339f","Type":"ContainerStarted","Data":"3fc351b77b999b2847f8489ceaaf22f55ecf73a31ef28317512f9b22c9edc426"}
Aug 05 18:04:34.867888 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:34.867818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podStartSLOduration=0.867802271 podStartE2EDuration="867.802271ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:04:34.864169944 +0000 UTC m=+2523.349093362" watchObservedRunningTime="2026-08-05 18:04:34.867802271 +0000 UTC m=+2523.352725689"
Aug 05 18:04:35.506934 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:35.506885    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:35.512073 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:35.512045    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:35.848873 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:35.848758    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:35.849682 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:35.849664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:36.816603 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:36.816567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:36.911608 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:36.911574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:37.958665 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:37.958625    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:38.521906 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:38.521863    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:38.621421 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:38.621377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:38.712907 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:38.712831    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:04:50.850124 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.850082    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 05 18:04:50.850582 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.850138    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 05 18:04:50.938046 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.938013    2560 generic.go:356] "Generic (PLEG): container finished" podID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerID="7158c5db3867e000d70edc0bda29088668fc2d6afb0b33e269c232bdfb4b318c" exitCode=0
Aug 05 18:04:50.938230 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.938092    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" event={"ID":"e1b7357a-97f3-47fe-883b-887b1a13339f","Type":"ContainerDied","Data":"7158c5db3867e000d70edc0bda29088668fc2d6afb0b33e269c232bdfb4b318c"}
Aug 05 18:04:50.938532 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.938518    2560 scope.go:117] "RemoveContainer" containerID="7158c5db3867e000d70edc0bda29088668fc2d6afb0b33e269c232bdfb4b318c"
Aug 05 18:04:50.939542 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.939517    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:50.939614 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.939581    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:50.939659 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:50.939612    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:04:51.946660 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:51.946620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" event={"ID":"e1b7357a-97f3-47fe-883b-887b1a13339f","Type":"ContainerStarted","Data":"8f9dde1ae22ca3503b1f5c77c9f93703b7ebdea537802c356745897e933dea7c"}
Aug 05 18:04:52.506933 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:52.506894    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:52.507208 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:52.507183    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 05 18:04:52.507256 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:52.507235    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 05 18:04:53.507422 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:53.507385    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 05 18:04:53.507835 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:53.507440    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 05 18:04:54.507396 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:54.507362    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 05 18:04:54.507576 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:54.507415    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 05 18:04:55.507749 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:55.507711    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 05 18:04:55.508267 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:55.507783    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 05 18:04:56.507311 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:56.507279    2560 patch_prober.go:28] interesting pod/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 05 18:04:56.507490 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:56.507330    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 05 18:04:57.511414 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:57.511380    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:57.511905 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:57.511662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:04:57.512441 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:04:57.512419    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:05:01.781376 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:05:01.781337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:05:08.427913 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:05:08.427877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:05:53.198946 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:05:53.198836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:27.730402 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:27.730364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:36.807957 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:36.807916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:37.695583 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.695551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:37.812726 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.812694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"]
Aug 05 18:06:37.816308 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.816288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"
Aug 05 18:06:37.819074 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.819051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:06:37.819074 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.819071    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 18:06:37.827308 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.827267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"]
Aug 05 18:06:37.854933 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.854896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b0d461-ec5f-48e8-8d79-dc6c885b6071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-83d598-zscg4\" (UID: \"29b0d461-ec5f-48e8-8d79-dc6c885b6071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"
Aug 05 18:06:37.955509 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.955406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b0d461-ec5f-48e8-8d79-dc6c885b6071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-83d598-zscg4\" (UID: \"29b0d461-ec5f-48e8-8d79-dc6c885b6071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"
Aug 05 18:06:37.956163 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:37.956142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b0d461-ec5f-48e8-8d79-dc6c885b6071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-83d598-zscg4\" (UID: \"29b0d461-ec5f-48e8-8d79-dc6c885b6071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"
Aug 05 18:06:38.127621 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:38.127588    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"
Aug 05 18:06:38.270615 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:38.270574    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"]
Aug 05 18:06:38.273317 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:06:38.273285    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b0d461_ec5f_48e8_8d79_dc6c885b6071.slice/crio-5ea1deb29bff52001847f366a09987614b5b6e2302d2c0fc8b5206e0c7bbb2b3 WatchSource:0}: Error finding container 5ea1deb29bff52001847f366a09987614b5b6e2302d2c0fc8b5206e0c7bbb2b3: Status 404 returned error can't find the container with id 5ea1deb29bff52001847f366a09987614b5b6e2302d2c0fc8b5206e0c7bbb2b3
Aug 05 18:06:38.579147 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:38.579114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4" event={"ID":"29b0d461-ec5f-48e8-8d79-dc6c885b6071","Type":"ContainerStarted","Data":"17674f9d2a8c01f470f52be1938b49a8fabea4ad373cac3f948c6b50bfc03de0"}
Aug 05 18:06:38.579280 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:38.579161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4" event={"ID":"29b0d461-ec5f-48e8-8d79-dc6c885b6071","Type":"ContainerStarted","Data":"5ea1deb29bff52001847f366a09987614b5b6e2302d2c0fc8b5206e0c7bbb2b3"}
Aug 05 18:06:38.597299 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:38.597246    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4" podStartSLOduration=1.597231686 podStartE2EDuration="1.597231686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:06:38.596333405 +0000 UTC m=+2647.081256824" watchObservedRunningTime="2026-08-05 18:06:38.597231686 +0000 UTC m=+2647.082155105"
Aug 05 18:06:39.585820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:39.585779    2560 generic.go:356] "Generic (PLEG): container finished" podID="29b0d461-ec5f-48e8-8d79-dc6c885b6071" containerID="17674f9d2a8c01f470f52be1938b49a8fabea4ad373cac3f948c6b50bfc03de0" exitCode=0
Aug 05 18:06:39.585820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:39.585822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4" event={"ID":"29b0d461-ec5f-48e8-8d79-dc6c885b6071","Type":"ContainerDied","Data":"17674f9d2a8c01f470f52be1938b49a8fabea4ad373cac3f948c6b50bfc03de0"}
Aug 05 18:06:40.730303 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:40.730273    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"
Aug 05 18:06:40.876999 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:40.876896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b0d461-ec5f-48e8-8d79-dc6c885b6071-maas-api-service-ca\") pod \"29b0d461-ec5f-48e8-8d79-dc6c885b6071\" (UID: \"29b0d461-ec5f-48e8-8d79-dc6c885b6071\") "
Aug 05 18:06:40.877263 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:40.877238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29b0d461-ec5f-48e8-8d79-dc6c885b6071-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29b0d461-ec5f-48e8-8d79-dc6c885b6071" (UID: "29b0d461-ec5f-48e8-8d79-dc6c885b6071"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:06:40.978067 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:40.978019    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b0d461-ec5f-48e8-8d79-dc6c885b6071-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:06:41.598991 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:41.598959    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"
Aug 05 18:06:41.599175 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:41.599003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4" event={"ID":"29b0d461-ec5f-48e8-8d79-dc6c885b6071","Type":"ContainerDied","Data":"5ea1deb29bff52001847f366a09987614b5b6e2302d2c0fc8b5206e0c7bbb2b3"}
Aug 05 18:06:41.599175 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:41.599048    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ea1deb29bff52001847f366a09987614b5b6e2302d2c0fc8b5206e0c7bbb2b3"
Aug 05 18:06:48.481896 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:48.481819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:48.553661 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:48.553603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:48.644554 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:48.644519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:48.745332 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:48.745232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:48.767686 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:48.767654    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"]
Aug 05 18:06:48.772179 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:48.772154    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-83d598-zscg4"]
Aug 05 18:06:49.130292 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:49.130196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:50.061557 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:50.061525    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b0d461-ec5f-48e8-8d79-dc6c885b6071" path="/var/lib/kubelet/pods/29b0d461-ec5f-48e8-8d79-dc6c885b6071/volumes"
Aug 05 18:06:55.307403 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.307356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:55.426174 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.426137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:55.529120 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.529084    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"]
Aug 05 18:06:55.529426 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.529394    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" containerID="cri-o://8f1927ae6c77587910f02246fa6888d174c207710d951897affdee34d91fd8d0" gracePeriod=30
Aug 05 18:06:55.555116 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.555077    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:55.781339 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.781299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:06:55.896459 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.896423    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"]
Aug 05 18:06:55.896894 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.896880    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b0d461-ec5f-48e8-8d79-dc6c885b6071" containerName="revoke-keys"
Aug 05 18:06:55.896953 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.896896    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b0d461-ec5f-48e8-8d79-dc6c885b6071" containerName="revoke-keys"
Aug 05 18:06:55.896989 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.896960    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b0d461-ec5f-48e8-8d79-dc6c885b6071" containerName="revoke-keys"
Aug 05 18:06:55.900350 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.900333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"
Aug 05 18:06:55.902874 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.902841    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 18:06:55.902987 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.902856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:06:55.908555 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:55.908530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"]
Aug 05 18:06:56.022943 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.022906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d195129-3c60-423a-9270-e22fac336776-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l\" (UID: \"7d195129-3c60-423a-9270-e22fac336776\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"
Aug 05 18:06:56.124429 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.124332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d195129-3c60-423a-9270-e22fac336776-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l\" (UID: \"7d195129-3c60-423a-9270-e22fac336776\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"
Aug 05 18:06:56.125052 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.125030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d195129-3c60-423a-9270-e22fac336776-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l\" (UID: \"7d195129-3c60-423a-9270-e22fac336776\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"
Aug 05 18:06:56.212460 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.212425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"
Aug 05 18:06:56.354224 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.354193    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"]
Aug 05 18:06:56.355364 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:06:56.355333    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d195129_3c60_423a_9270_e22fac336776.slice/crio-7a7430371fdaff687f52aaecf40e123c145529e46f83d8515dbb632c9be83208 WatchSource:0}: Error finding container 7a7430371fdaff687f52aaecf40e123c145529e46f83d8515dbb632c9be83208: Status 404 returned error can't find the container with id 7a7430371fdaff687f52aaecf40e123c145529e46f83d8515dbb632c9be83208
Aug 05 18:06:56.685457 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.685420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l" event={"ID":"7d195129-3c60-423a-9270-e22fac336776","Type":"ContainerStarted","Data":"96019716bfd273b68b4730bda944d614435c3086b3327bc55344deb03a267d55"}
Aug 05 18:06:56.685622 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.685476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l" event={"ID":"7d195129-3c60-423a-9270-e22fac336776","Type":"ContainerStarted","Data":"7a7430371fdaff687f52aaecf40e123c145529e46f83d8515dbb632c9be83208"}
Aug 05 18:06:56.702633 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:56.702579    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l" podStartSLOduration=1.702563864 podStartE2EDuration="1.702563864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:06:56.70193964 +0000 UTC m=+2665.186863059" watchObservedRunningTime="2026-08-05 18:06:56.702563864 +0000 UTC m=+2665.187487314"
Aug 05 18:06:57.693434 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:57.693402    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d195129-3c60-423a-9270-e22fac336776" containerID="96019716bfd273b68b4730bda944d614435c3086b3327bc55344deb03a267d55" exitCode=0
Aug 05 18:06:57.693836 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:57.693498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l" event={"ID":"7d195129-3c60-423a-9270-e22fac336776","Type":"ContainerDied","Data":"96019716bfd273b68b4730bda944d614435c3086b3327bc55344deb03a267d55"}
Aug 05 18:06:58.832541 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:58.832513    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"
Aug 05 18:06:58.953721 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:58.953629    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d195129-3c60-423a-9270-e22fac336776-maas-api-service-ca\") pod \"7d195129-3c60-423a-9270-e22fac336776\" (UID: \"7d195129-3c60-423a-9270-e22fac336776\") "
Aug 05 18:06:58.954033 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:58.954008    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d195129-3c60-423a-9270-e22fac336776-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d195129-3c60-423a-9270-e22fac336776" (UID: "7d195129-3c60-423a-9270-e22fac336776"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:06:59.054668 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:59.054638    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d195129-3c60-423a-9270-e22fac336776-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:06:59.655328 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:59.655297    2560 patch_prober.go:28] interesting pod/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 18:06:59.655500 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:59.655365    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 18:06:59.706631 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:59.706592    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"
Aug 05 18:06:59.706631 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:59.706623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l" event={"ID":"7d195129-3c60-423a-9270-e22fac336776","Type":"ContainerDied","Data":"7a7430371fdaff687f52aaecf40e123c145529e46f83d8515dbb632c9be83208"}
Aug 05 18:06:59.706871 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:06:59.706679    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a7430371fdaff687f52aaecf40e123c145529e46f83d8515dbb632c9be83208"
Aug 05 18:07:00.717739 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.717704    2560 generic.go:356] "Generic (PLEG): container finished" podID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerID="8f1927ae6c77587910f02246fa6888d174c207710d951897affdee34d91fd8d0" exitCode=0
Aug 05 18:07:00.718154 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.717753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" event={"ID":"1bdaa34c-4aba-468e-913a-e5c914b6352c","Type":"ContainerDied","Data":"8f1927ae6c77587910f02246fa6888d174c207710d951897affdee34d91fd8d0"}
Aug 05 18:07:00.718154 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.717817    2560 scope.go:117] "RemoveContainer" containerID="79aa8b76000e10190a8841f136a93cb967d64dcb24a9b2a0eae0403a54fe6050"
Aug 05 18:07:00.787042 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.787018    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:07:00.873479 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rdp4\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-kube-api-access-6rdp4\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.873479 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-podinfo\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.873711 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-credential-socket\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.873711 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-envoy\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.873711 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873548    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdaa34c-4aba-468e-913a-e5c914b6352c-istiod-ca-cert\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.873711 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-certs\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.873711 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-token\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.873711 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873689    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-socket\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.874074 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873716    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-data\") pod \"1bdaa34c-4aba-468e-913a-e5c914b6352c\" (UID: \"1bdaa34c-4aba-468e-913a-e5c914b6352c\") "
Aug 05 18:07:00.874074 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873888    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:00.874074 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.873980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bdaa34c-4aba-468e-913a-e5c914b6352c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:07:00.874231 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.874105    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-data" (OuterVolumeSpecName: "istio-data") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:00.874461 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.874321    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:00.874461 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.874387    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:00.874461 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.874413    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.874461 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.874435    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdaa34c-4aba-468e-913a-e5c914b6352c-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.874461 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.874451    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.874461 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.874465    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.876065 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.876037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:00.876277 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.876250    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-kube-api-access-6rdp4" (OuterVolumeSpecName: "kube-api-access-6rdp4") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "kube-api-access-6rdp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:07:00.876571 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.876547    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-token" (OuterVolumeSpecName: "istio-token") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:07:00.876571 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.876555    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1bdaa34c-4aba-468e-913a-e5c914b6352c" (UID: "1bdaa34c-4aba-468e-913a-e5c914b6352c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:07:00.975310 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.975274    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.975310 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.975304    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdaa34c-4aba-468e-913a-e5c914b6352c-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.975310 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.975314    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.975553 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.975323    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rdp4\" (UniqueName: \"kubernetes.io/projected/1bdaa34c-4aba-468e-913a-e5c914b6352c-kube-api-access-6rdp4\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:00.975553 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:00.975334    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdaa34c-4aba-468e-913a-e5c914b6352c-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:01.724604 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:01.724575    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"
Aug 05 18:07:01.725050 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:01.724609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8" event={"ID":"1bdaa34c-4aba-468e-913a-e5c914b6352c","Type":"ContainerDied","Data":"1c7a37e64eb70faa37e8f577cbacc2e5b400701ff128f2c9783ea6fd5f428ef9"}
Aug 05 18:07:01.725050 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:01.724671    2560 scope.go:117] "RemoveContainer" containerID="8f1927ae6c77587910f02246fa6888d174c207710d951897affdee34d91fd8d0"
Aug 05 18:07:01.747562 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:01.747535    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"]
Aug 05 18:07:01.751375 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:01.751353    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-83d598-openshift-default-554dbfc46d-hg9z8"]
Aug 05 18:07:02.062454 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:02.062370    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" path="/var/lib/kubelet/pods/1bdaa34c-4aba-468e-913a-e5c914b6352c/volumes"
Aug 05 18:07:06.384123 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:06.384086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:06.457465 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:06.457409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:06.556206 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:06.556172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:06.565251 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:06.565224    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"]
Aug 05 18:07:06.567578 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:06.567554    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ed4837-gzs7l"]
Aug 05 18:07:06.672236 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:06.672201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:06.954377 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:06.954280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:08.060443 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:08.060409    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d195129-3c60-423a-9270-e22fac336776" path="/var/lib/kubelet/pods/7d195129-3c60-423a-9270-e22fac336776/volumes"
Aug 05 18:07:13.398190 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:13.398148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:13.499135 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:13.499094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:13.647330 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:13.647289    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"]
Aug 05 18:07:13.647579 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:13.647552    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy" containerID="cri-o://8f9dde1ae22ca3503b1f5c77c9f93703b7ebdea537802c356745897e933dea7c" gracePeriod=30
Aug 05 18:07:13.700134 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:13.700100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:13.864733 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:13.864692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:14.193370 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:14.193332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:14.502224 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:14.502132    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:15.088439 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:15.088402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:17.178067 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:17.178033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:17.326425 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:17.326391    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:18.409636 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.409601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:18.828715 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.828624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:18.845757 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.845361    2560 generic.go:356] "Generic (PLEG): container finished" podID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerID="8f9dde1ae22ca3503b1f5c77c9f93703b7ebdea537802c356745897e933dea7c" exitCode=0
Aug 05 18:07:18.845757 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.845428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" event={"ID":"e1b7357a-97f3-47fe-883b-887b1a13339f","Type":"ContainerDied","Data":"8f9dde1ae22ca3503b1f5c77c9f93703b7ebdea537802c356745897e933dea7c"}
Aug 05 18:07:18.845757 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.845550    2560 scope.go:117] "RemoveContainer" containerID="7158c5db3867e000d70edc0bda29088668fc2d6afb0b33e269c232bdfb4b318c"
Aug 05 18:07:18.914225 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.914198    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:07:18.928016 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.927914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:18.951736 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.951707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-certs\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.951952 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.951758    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-podinfo\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.951952 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.951805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdw5g\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-kube-api-access-xdw5g\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.951952 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.951840    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-envoy\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.951952 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.951940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-data\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.952198 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.951970    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b7357a-97f3-47fe-883b-887b1a13339f-istiod-ca-cert\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.952198 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.951988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:18.952198 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952029    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-socket\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.952198 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952055    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-credential-socket\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.952198 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-token\") pod \"e1b7357a-97f3-47fe-883b-887b1a13339f\" (UID: \"e1b7357a-97f3-47fe-883b-887b1a13339f\") "
Aug 05 18:07:18.952488 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952427    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:18.952488 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952422    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b7357a-97f3-47fe-883b-887b1a13339f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:07:18.953013 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952646    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:18.953013 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952660    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:18.953013 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.952815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:18.954376 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.954348    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:07:18.954781 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.954756    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-kube-api-access-xdw5g" (OuterVolumeSpecName: "kube-api-access-xdw5g") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "kube-api-access-xdw5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:07:18.954931 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.954833    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:07:18.955097 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.955070    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1b7357a-97f3-47fe-883b-887b1a13339f" (UID: "e1b7357a-97f3-47fe-883b-887b1a13339f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:07:18.995961 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.995925    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"]
Aug 05 18:07:18.996308 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996296    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d195129-3c60-423a-9270-e22fac336776" containerName="revoke-keys"
Aug 05 18:07:18.996367 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996309    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d195129-3c60-423a-9270-e22fac336776" containerName="revoke-keys"
Aug 05 18:07:18.996367 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996318    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy"
Aug 05 18:07:18.996367 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996323    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy"
Aug 05 18:07:18.996367 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996331    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy"
Aug 05 18:07:18.996367 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996337    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy"
Aug 05 18:07:18.996524 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996402    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy"
Aug 05 18:07:18.996524 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996410    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy"
Aug 05 18:07:18.996524 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996416    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy"
Aug 05 18:07:18.996524 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996422    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy"
Aug 05 18:07:18.996524 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.996433    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d195129-3c60-423a-9270-e22fac336776" containerName="revoke-keys"
Aug 05 18:07:18.999815 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:18.999797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.002120 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.002093    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b0e02a\""
Aug 05 18:07:19.009441 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.009411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:19.009897 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.009876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"]
Aug 05 18:07:19.053433 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtq8\" (UniqueName: \"kubernetes.io/projected/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-kube-api-access-2vtq8\") pod \"payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.053631 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053721    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b7357a-97f3-47fe-883b-887b1a13339f-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053742    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053756    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053769    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053782    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053794    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdw5g\" (UniqueName: \"kubernetes.io/projected/e1b7357a-97f3-47fe-883b-887b1a13339f-kube-api-access-xdw5g\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053807    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.053988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.053820    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b7357a-97f3-47fe-883b-887b1a13339f-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:07:19.154671 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.154630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtq8\" (UniqueName: \"kubernetes.io/projected/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-kube-api-access-2vtq8\") pod \"payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.154885 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.154706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.155596 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.155576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.163133 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.163104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtq8\" (UniqueName: \"kubernetes.io/projected/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-kube-api-access-2vtq8\") pod \"payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.313415 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.313323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.458589 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.458563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"]
Aug 05 18:07:19.460530 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:07:19.460501    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4b92e3_1ec4_464f_a3d2_f6dcb34456d5.slice/crio-a25b05e4131b3bde0f35872d6f7f45008a885baa5fd1512a3569d4b53358d6c5 WatchSource:0}: Error finding container a25b05e4131b3bde0f35872d6f7f45008a885baa5fd1512a3569d4b53358d6c5: Status 404 returned error can't find the container with id a25b05e4131b3bde0f35872d6f7f45008a885baa5fd1512a3569d4b53358d6c5
Aug 05 18:07:19.854111 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.854073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5" event={"ID":"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5","Type":"ContainerStarted","Data":"1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7"}
Aug 05 18:07:19.854305 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.854143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5" event={"ID":"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5","Type":"ContainerStarted","Data":"a25b05e4131b3bde0f35872d6f7f45008a885baa5fd1512a3569d4b53358d6c5"}
Aug 05 18:07:19.854305 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.854178    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:19.855589 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.855557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn" event={"ID":"e1b7357a-97f3-47fe-883b-887b1a13339f","Type":"ContainerDied","Data":"3fc351b77b999b2847f8489ceaaf22f55ecf73a31ef28317512f9b22c9edc426"}
Aug 05 18:07:19.855589 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.855580    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"
Aug 05 18:07:19.855778 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.855623    2560 scope.go:117] "RemoveContainer" containerID="8f9dde1ae22ca3503b1f5c77c9f93703b7ebdea537802c356745897e933dea7c"
Aug 05 18:07:19.873538 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.873491    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5" podStartSLOduration=1.873473482 podStartE2EDuration="1.873473482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:07:19.871892127 +0000 UTC m=+2688.356815561" watchObservedRunningTime="2026-08-05 18:07:19.873473482 +0000 UTC m=+2688.358396913"
Aug 05 18:07:19.889378 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.889352    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"]
Aug 05 18:07:19.893646 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:19.893621    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ed4837-openshift-default-5fd75bf854-4jhhn"]
Aug 05 18:07:20.061613 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:20.061573    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" path="/var/lib/kubelet/pods/e1b7357a-97f3-47fe-883b-887b1a13339f/volumes"
Aug 05 18:07:30.865095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:30.865007    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:07:42.078867 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.078817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:42.541630 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.541595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:42.810269 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.810182    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"]
Aug 05 18:07:42.810749 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.810726    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy"
Aug 05 18:07:42.810749 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.810752    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b7357a-97f3-47fe-883b-887b1a13339f" containerName="istio-proxy"
Aug 05 18:07:42.810941 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.810766    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy"
Aug 05 18:07:42.810941 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.810776    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdaa34c-4aba-468e-913a-e5c914b6352c" containerName="istio-proxy"
Aug 05 18:07:42.814246 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.814229    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.816576 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.816559    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-625864-openshift-default-dockercfg-kxxln\""
Aug 05 18:07:42.825462 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.825437    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"]
Aug 05 18:07:42.841073 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.841047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:42.979182 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-socket\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-data\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-credential-socket\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cc5n\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-kube-api-access-5cc5n\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-certs\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979508 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64476fde-e399-4685-a435-02395715fe01-istiod-ca-cert\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979508 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-istio-token\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979508 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-envoy\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:42.979508 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:42.979482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64476fde-e399-4685-a435-02395715fe01-istio-podinfo\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.035108 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.035067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:43.080470 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-data\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.080470 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-credential-socket\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.080470 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cc5n\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-kube-api-access-5cc5n\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-certs\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64476fde-e399-4685-a435-02395715fe01-istiod-ca-cert\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-istio-token\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-envoy\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64476fde-e399-4685-a435-02395715fe01-istio-podinfo\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-credential-socket\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-socket\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.080983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-certs\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081095 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.081088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-data\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081504 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.081266    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-socket\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.081554 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.081500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64476fde-e399-4685-a435-02395715fe01-istiod-ca-cert\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.083644 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.083619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-envoy\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.083786 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.083751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64476fde-e399-4685-a435-02395715fe01-istio-podinfo\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.089253 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.089229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-istio-token\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.089593 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.089568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cc5n\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-kube-api-access-5cc5n\") pod \"e2e-api-b-625864-openshift-default-65bb79db44-c99kv\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") " pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.126656 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.126620    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:43.273795 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.273767    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"]
Aug 05 18:07:43.276022 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:07:43.275978    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64476fde_e399_4685_a435_02395715fe01.slice/crio-dbfdf00ca1a3709fa68aa871fec964689408098a4ced9bcd0a05382a7b491142 WatchSource:0}: Error finding container dbfdf00ca1a3709fa68aa871fec964689408098a4ced9bcd0a05382a7b491142: Status 404 returned error can't find the container with id dbfdf00ca1a3709fa68aa871fec964689408098a4ced9bcd0a05382a7b491142
Aug 05 18:07:43.278472 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.278441    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:07:43.278557 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.278506    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:07:43.278557 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.278533    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:07:43.996602 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.996566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" event={"ID":"64476fde-e399-4685-a435-02395715fe01","Type":"ContainerStarted","Data":"be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e"}
Aug 05 18:07:43.996790 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:43.996624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" event={"ID":"64476fde-e399-4685-a435-02395715fe01","Type":"ContainerStarted","Data":"dbfdf00ca1a3709fa68aa871fec964689408098a4ced9bcd0a05382a7b491142"}
Aug 05 18:07:44.021119 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:44.021067    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podStartSLOduration=2.021050724 podStartE2EDuration="2.021050724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:07:44.019230701 +0000 UTC m=+2712.504154120" watchObservedRunningTime="2026-08-05 18:07:44.021050724 +0000 UTC m=+2712.505974143"
Aug 05 18:07:44.127702 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:44.127668    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:44.137548 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:44.137518    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:45.002983 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:45.002949    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:45.004076 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:45.004055    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:07:45.905631 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:45.905591    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:46.006154 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:46.006116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:47.079561 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.079526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:47.450408 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.450355    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:47.578965 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.578932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:47.678535 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.678500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:07:47.758977 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.758891    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"]
Aug 05 18:07:47.762686 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.762665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:47.765043 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.765023    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-625864\""
Aug 05 18:07:47.765137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.765062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-625864-dockercfg-nlbqq\""
Aug 05 18:07:47.770677 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.770650    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"]
Aug 05 18:07:47.928828 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.928794    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d9k9\" (UniqueName: \"kubernetes.io/projected/af9a45dd-c459-4c4c-ae17-20647dbff7d7-kube-api-access-9d9k9\") pod \"payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:47.928828 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:47.928831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af9a45dd-c459-4c4c-ae17-20647dbff7d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:48.029692 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:48.029600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d9k9\" (UniqueName: \"kubernetes.io/projected/af9a45dd-c459-4c4c-ae17-20647dbff7d7-kube-api-access-9d9k9\") pod \"payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:48.029692 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:48.029637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af9a45dd-c459-4c4c-ae17-20647dbff7d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:48.030329 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:48.030311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af9a45dd-c459-4c4c-ae17-20647dbff7d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:48.038576 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:48.038545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d9k9\" (UniqueName: \"kubernetes.io/projected/af9a45dd-c459-4c4c-ae17-20647dbff7d7-kube-api-access-9d9k9\") pod \"payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:48.076935 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:48.076901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:48.216911 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:48.216883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"]
Aug 05 18:07:48.219221 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:07:48.219179    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9a45dd_c459_4c4c_ae17_20647dbff7d7.slice/crio-0683605784a0d1e560e3843a97428b384fe7541a1164c8af1d042c61bd24d040 WatchSource:0}: Error finding container 0683605784a0d1e560e3843a97428b384fe7541a1164c8af1d042c61bd24d040: Status 404 returned error can't find the container with id 0683605784a0d1e560e3843a97428b384fe7541a1164c8af1d042c61bd24d040
Aug 05 18:07:49.029586 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:49.029547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" event={"ID":"af9a45dd-c459-4c4c-ae17-20647dbff7d7","Type":"ContainerStarted","Data":"c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c"}
Aug 05 18:07:49.029782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:49.029643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" event={"ID":"af9a45dd-c459-4c4c-ae17-20647dbff7d7","Type":"ContainerStarted","Data":"0683605784a0d1e560e3843a97428b384fe7541a1164c8af1d042c61bd24d040"}
Aug 05 18:07:49.029877 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:49.029812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:07:49.050373 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:07:49.050325    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" podStartSLOduration=2.050309379 podStartE2EDuration="2.050309379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:07:49.046962086 +0000 UTC m=+2717.531885505" watchObservedRunningTime="2026-08-05 18:07:49.050309379 +0000 UTC m=+2717.535232798"
Aug 05 18:08:00.004908 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.004839    2560 patch_prober.go:28] interesting pod/e2e-api-b-625864-openshift-default-65bb79db44-c99kv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 05 18:08:00.005322 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.004936    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 05 18:08:00.036691 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.036649    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" podUID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.67:9004: connect: connection refused"
Aug 05 18:08:00.106609 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.106581    2560 generic.go:356] "Generic (PLEG): container finished" podID="64476fde-e399-4685-a435-02395715fe01" containerID="be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e" exitCode=0
Aug 05 18:08:00.106782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.106626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" event={"ID":"64476fde-e399-4685-a435-02395715fe01","Type":"ContainerDied","Data":"be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e"}
Aug 05 18:08:00.107082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.107062    2560 scope.go:117] "RemoveContainer" containerID="be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e"
Aug 05 18:08:00.108204 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.108175    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:08:00.108260 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.108245    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:08:00.108294 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:00.108277    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:08:01.120645 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:01.120612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" event={"ID":"64476fde-e399-4685-a435-02395715fe01","Type":"ContainerStarted","Data":"8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f"}
Aug 05 18:08:01.127002 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:01.126970    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:08:01.127184 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:01.127163    2560 patch_prober.go:28] interesting pod/e2e-api-b-625864-openshift-default-65bb79db44-c99kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 05 18:08:01.127267 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:01.127228    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 05 18:08:02.127469 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:02.127437    2560 patch_prober.go:28] interesting pod/e2e-api-b-625864-openshift-default-65bb79db44-c99kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 05 18:08:02.127897 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:02.127500    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 05 18:08:03.127160 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:03.127125    2560 patch_prober.go:28] interesting pod/e2e-api-b-625864-openshift-default-65bb79db44-c99kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 05 18:08:03.127349 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:03.127191    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 05 18:08:04.127475 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:04.127439    2560 patch_prober.go:28] interesting pod/e2e-api-b-625864-openshift-default-65bb79db44-c99kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 05 18:08:04.127911 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:04.127502    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 05 18:08:05.127930 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:05.127892    2560 patch_prober.go:28] interesting pod/e2e-api-b-625864-openshift-default-65bb79db44-c99kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 05 18:08:05.128334 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:05.127954    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 05 18:08:06.127227 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:06.127186    2560 patch_prober.go:28] interesting pod/e2e-api-b-625864-openshift-default-65bb79db44-c99kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Aug 05 18:08:06.127413 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:06.127240    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Aug 05 18:08:07.131242 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:07.131214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:08:07.131637 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:07.131512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:08:07.132391 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:07.132376    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:08:08.077264 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:08.077221    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" podUID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.67:9004: connect: connection refused"
Aug 05 18:08:10.036502 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:10.036472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:08:10.875074 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:10.875029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:13.702927 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.702889    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"]
Aug 05 18:08:13.706252 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.706235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"
Aug 05 18:08:13.709198 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.709173    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 18:08:13.709333 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.709319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:08:13.732357 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.732323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"]
Aug 05 18:08:13.782780 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.782741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30db911-fe90-42c2-856e-0eddceee29c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r\" (UID: \"d30db911-fe90-42c2-856e-0eddceee29c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"
Aug 05 18:08:13.884404 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.884365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30db911-fe90-42c2-856e-0eddceee29c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r\" (UID: \"d30db911-fe90-42c2-856e-0eddceee29c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"
Aug 05 18:08:13.885088 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:13.885067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30db911-fe90-42c2-856e-0eddceee29c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r\" (UID: \"d30db911-fe90-42c2-856e-0eddceee29c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"
Aug 05 18:08:14.016557 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:14.016470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"
Aug 05 18:08:14.160594 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:14.160565    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"]
Aug 05 18:08:14.162296 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:08:14.162271    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30db911_fe90_42c2_856e_0eddceee29c0.slice/crio-5cadfea5c8fd65de6a1f4cca4c7f42404686520dc03c2f965c13285c771726b0 WatchSource:0}: Error finding container 5cadfea5c8fd65de6a1f4cca4c7f42404686520dc03c2f965c13285c771726b0: Status 404 returned error can't find the container with id 5cadfea5c8fd65de6a1f4cca4c7f42404686520dc03c2f965c13285c771726b0
Aug 05 18:08:14.201972 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:14.201940    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r" event={"ID":"d30db911-fe90-42c2-856e-0eddceee29c0","Type":"ContainerStarted","Data":"5cadfea5c8fd65de6a1f4cca4c7f42404686520dc03c2f965c13285c771726b0"}
Aug 05 18:08:15.210086 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:15.209990    2560 generic.go:356] "Generic (PLEG): container finished" podID="d30db911-fe90-42c2-856e-0eddceee29c0" containerID="2e0644b35d8b18be66f5416f84f0a62980be4a34e27a1d1b608949a6753478a0" exitCode=0
Aug 05 18:08:15.210086 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:15.210046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r" event={"ID":"d30db911-fe90-42c2-856e-0eddceee29c0","Type":"ContainerDied","Data":"2e0644b35d8b18be66f5416f84f0a62980be4a34e27a1d1b608949a6753478a0"}
Aug 05 18:08:16.353214 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:16.353189    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"
Aug 05 18:08:16.510680 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:16.510597    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30db911-fe90-42c2-856e-0eddceee29c0-maas-api-service-ca\") pod \"d30db911-fe90-42c2-856e-0eddceee29c0\" (UID: \"d30db911-fe90-42c2-856e-0eddceee29c0\") "
Aug 05 18:08:16.510988 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:16.510967    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d30db911-fe90-42c2-856e-0eddceee29c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d30db911-fe90-42c2-856e-0eddceee29c0" (UID: "d30db911-fe90-42c2-856e-0eddceee29c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:08:16.612408 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:16.612370    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30db911-fe90-42c2-856e-0eddceee29c0-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:08:17.223284 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:17.223254    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"
Aug 05 18:08:17.223284 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:17.223271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r" event={"ID":"d30db911-fe90-42c2-856e-0eddceee29c0","Type":"ContainerDied","Data":"5cadfea5c8fd65de6a1f4cca4c7f42404686520dc03c2f965c13285c771726b0"}
Aug 05 18:08:17.223507 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:17.223315    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cadfea5c8fd65de6a1f4cca4c7f42404686520dc03c2f965c13285c771726b0"
Aug 05 18:08:21.546585 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:21.546525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:24.659835 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:24.659796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:29.288424 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.288393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:29.325776 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.325745    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"]
Aug 05 18:08:29.326049 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.326022    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5" podUID="ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" containerName="payload-pre-processing" containerID="cri-o://1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7" gracePeriod=30
Aug 05 18:08:29.390518 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.390480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:29.476824 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.476781    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"]
Aug 05 18:08:29.479209 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.479164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:29.479631 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.479612    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b0e02a-gkx6r"]
Aug 05 18:08:29.542511 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.542413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:29.584032 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.584006    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:08:29.639383 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.639353    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vtq8\" (UniqueName: \"kubernetes.io/projected/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-kube-api-access-2vtq8\") pod \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") "
Aug 05 18:08:29.639551 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.639401    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-plugins-config-volume\") pod \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\" (UID: \"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5\") "
Aug 05 18:08:29.639837 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.639812    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" (UID: "ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:08:29.641586 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.641566    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-kube-api-access-2vtq8" (OuterVolumeSpecName: "kube-api-access-2vtq8") pod "ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" (UID: "ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5"). InnerVolumeSpecName "kube-api-access-2vtq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:08:29.740475 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.740429    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:08:29.740475 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.740468    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vtq8\" (UniqueName: \"kubernetes.io/projected/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5-kube-api-access-2vtq8\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:08:29.856977 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:29.856883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:30.060290 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.060254    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d30db911-fe90-42c2-856e-0eddceee29c0" path="/var/lib/kubelet/pods/d30db911-fe90-42c2-856e-0eddceee29c0/volumes"
Aug 05 18:08:30.299490 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.299450    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" containerID="1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7" exitCode=0
Aug 05 18:08:30.300002 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.299518    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"
Aug 05 18:08:30.300002 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.299533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5" event={"ID":"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5","Type":"ContainerDied","Data":"1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7"}
Aug 05 18:08:30.300002 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.299582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5" event={"ID":"ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5","Type":"ContainerDied","Data":"a25b05e4131b3bde0f35872d6f7f45008a885baa5fd1512a3569d4b53358d6c5"}
Aug 05 18:08:30.300002 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.299607    2560 scope.go:117] "RemoveContainer" containerID="1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7"
Aug 05 18:08:30.308780 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.308754    2560 scope.go:117] "RemoveContainer" containerID="1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7"
Aug 05 18:08:30.309080 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:08:30.309061    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7\": container with ID starting with 1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7 not found: ID does not exist" containerID="1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7"
Aug 05 18:08:30.309146 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.309088    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7"} err="failed to get container status \"1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7\": rpc error: code = NotFound desc = could not find container \"1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7\": container with ID starting with 1398df7bb88f0c0cfdd49bf2993e6e974f033aed9a9a2423ac50f6c20a5905f7 not found: ID does not exist"
Aug 05 18:08:30.327652 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.327623    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"]
Aug 05 18:08:30.330358 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:30.330336    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-b0e02a-685d7594b8-9shb5"]
Aug 05 18:08:32.060719 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:32.060681    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" path="/var/lib/kubelet/pods/ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5/volumes"
Aug 05 18:08:32.377207 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:32.377113    2560 scope.go:117] "RemoveContainer" containerID="ffda82637eb17992872e9850c1203a1371391115d7084698dc724b3599c31179"
Aug 05 18:08:35.807128 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:35.807090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:35.906750 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:35.906714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:36.051117 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.051078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:36.259015 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.258980    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:36.378464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.378430    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"]
Aug 05 18:08:36.378886 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.378872    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" containerName="payload-pre-processing"
Aug 05 18:08:36.378886 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.378888    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" containerName="payload-pre-processing"
Aug 05 18:08:36.378982 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.378902    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30db911-fe90-42c2-856e-0eddceee29c0" containerName="revoke-keys"
Aug 05 18:08:36.378982 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.378908    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30db911-fe90-42c2-856e-0eddceee29c0" containerName="revoke-keys"
Aug 05 18:08:36.379049 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.378992    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef4b92e3-1ec4-464f-a3d2-f6dcb34456d5" containerName="payload-pre-processing"
Aug 05 18:08:36.379049 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.379000    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30db911-fe90-42c2-856e-0eddceee29c0" containerName="revoke-keys"
Aug 05 18:08:36.383575 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.383559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"
Aug 05 18:08:36.387606 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.387580    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 18:08:36.387888 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.387623    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:08:36.390233 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.390208    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"]
Aug 05 18:08:36.403727 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.403691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eec02a4-d445-4708-ace8-3c1c464aa441-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-625864-rck97\" (UID: \"2eec02a4-d445-4708-ace8-3c1c464aa441\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"
Aug 05 18:08:36.504533 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.504499    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eec02a4-d445-4708-ace8-3c1c464aa441-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-625864-rck97\" (UID: \"2eec02a4-d445-4708-ace8-3c1c464aa441\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"
Aug 05 18:08:36.505170 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.505150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eec02a4-d445-4708-ace8-3c1c464aa441-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-625864-rck97\" (UID: \"2eec02a4-d445-4708-ace8-3c1c464aa441\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"
Aug 05 18:08:36.695594 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.695555    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"
Aug 05 18:08:36.847569 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:36.847537    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"]
Aug 05 18:08:36.849016 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:08:36.848988    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eec02a4_d445_4708_ace8_3c1c464aa441.slice/crio-01fbc90560ccbaf3a31b2d1e54aca72a904e5c653431948f6ef04833716f5700 WatchSource:0}: Error finding container 01fbc90560ccbaf3a31b2d1e54aca72a904e5c653431948f6ef04833716f5700: Status 404 returned error can't find the container with id 01fbc90560ccbaf3a31b2d1e54aca72a904e5c653431948f6ef04833716f5700
Aug 05 18:08:37.344606 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:37.344495    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97" event={"ID":"2eec02a4-d445-4708-ace8-3c1c464aa441","Type":"ContainerStarted","Data":"ee87acfd522dc558e6031a48e0e57c8ab90ec8698d27901337226c5b4d489e9d"}
Aug 05 18:08:37.344606 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:37.344576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97" event={"ID":"2eec02a4-d445-4708-ace8-3c1c464aa441","Type":"ContainerStarted","Data":"01fbc90560ccbaf3a31b2d1e54aca72a904e5c653431948f6ef04833716f5700"}
Aug 05 18:08:37.366507 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:37.366456    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97" podStartSLOduration=1.366439189 podStartE2EDuration="1.366439189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:08:37.363252908 +0000 UTC m=+2765.848176326" watchObservedRunningTime="2026-08-05 18:08:37.366439189 +0000 UTC m=+2765.851362609"
Aug 05 18:08:38.354073 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:38.354035    2560 generic.go:356] "Generic (PLEG): container finished" podID="2eec02a4-d445-4708-ace8-3c1c464aa441" containerID="ee87acfd522dc558e6031a48e0e57c8ab90ec8698d27901337226c5b4d489e9d" exitCode=0
Aug 05 18:08:38.354530 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:38.354099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97" event={"ID":"2eec02a4-d445-4708-ace8-3c1c464aa441","Type":"ContainerDied","Data":"ee87acfd522dc558e6031a48e0e57c8ab90ec8698d27901337226c5b4d489e9d"}
Aug 05 18:08:39.492708 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:39.492685    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"
Aug 05 18:08:39.535038 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:39.535000    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eec02a4-d445-4708-ace8-3c1c464aa441-maas-api-service-ca\") pod \"2eec02a4-d445-4708-ace8-3c1c464aa441\" (UID: \"2eec02a4-d445-4708-ace8-3c1c464aa441\") "
Aug 05 18:08:39.535356 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:39.535332    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eec02a4-d445-4708-ace8-3c1c464aa441-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2eec02a4-d445-4708-ace8-3c1c464aa441" (UID: "2eec02a4-d445-4708-ace8-3c1c464aa441"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:08:39.636614 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:39.636519    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eec02a4-d445-4708-ace8-3c1c464aa441-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:08:40.366216 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:40.366122    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"
Aug 05 18:08:40.366216 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:40.366144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97" event={"ID":"2eec02a4-d445-4708-ace8-3c1c464aa441","Type":"ContainerDied","Data":"01fbc90560ccbaf3a31b2d1e54aca72a904e5c653431948f6ef04833716f5700"}
Aug 05 18:08:40.366216 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:40.366195    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01fbc90560ccbaf3a31b2d1e54aca72a904e5c653431948f6ef04833716f5700"
Aug 05 18:08:51.920527 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:51.920482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:51.949613 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:51.949581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"]
Aug 05 18:08:51.950080 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:51.950047    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" podUID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" containerName="payload-pre-processing" containerID="cri-o://c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c" gracePeriod=30
Aug 05 18:08:51.998555 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:51.998517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:52.089530 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.089490    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"]
Aug 05 18:08:52.091984 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.091953    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-625864-rck97"]
Aug 05 18:08:52.101127 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.100380    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:52.219868 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.219824    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:08:52.356331 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.356302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af9a45dd-c459-4c4c-ae17-20647dbff7d7-plugins-config-volume\") pod \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") "
Aug 05 18:08:52.356539 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.356443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d9k9\" (UniqueName: \"kubernetes.io/projected/af9a45dd-c459-4c4c-ae17-20647dbff7d7-kube-api-access-9d9k9\") pod \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\" (UID: \"af9a45dd-c459-4c4c-ae17-20647dbff7d7\") "
Aug 05 18:08:52.356801 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.356777    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af9a45dd-c459-4c4c-ae17-20647dbff7d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af9a45dd-c459-4c4c-ae17-20647dbff7d7" (UID: "af9a45dd-c459-4c4c-ae17-20647dbff7d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:08:52.358916 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.358891    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9a45dd-c459-4c4c-ae17-20647dbff7d7-kube-api-access-9d9k9" (OuterVolumeSpecName: "kube-api-access-9d9k9") pod "af9a45dd-c459-4c4c-ae17-20647dbff7d7" (UID: "af9a45dd-c459-4c4c-ae17-20647dbff7d7"). InnerVolumeSpecName "kube-api-access-9d9k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:08:52.436311 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.436224    2560 generic.go:356] "Generic (PLEG): container finished" podID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" containerID="c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c" exitCode=0
Aug 05 18:08:52.436311 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.436268    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" event={"ID":"af9a45dd-c459-4c4c-ae17-20647dbff7d7","Type":"ContainerDied","Data":"c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c"}
Aug 05 18:08:52.436568 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.436278    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"
Aug 05 18:08:52.436568 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.436329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f" event={"ID":"af9a45dd-c459-4c4c-ae17-20647dbff7d7","Type":"ContainerDied","Data":"0683605784a0d1e560e3843a97428b384fe7541a1164c8af1d042c61bd24d040"}
Aug 05 18:08:52.436568 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.436361    2560 scope.go:117] "RemoveContainer" containerID="c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c"
Aug 05 18:08:52.446297 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.446279    2560 scope.go:117] "RemoveContainer" containerID="c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c"
Aug 05 18:08:52.446573 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:08:52.446554    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c\": container with ID starting with c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c not found: ID does not exist" containerID="c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c"
Aug 05 18:08:52.446621 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.446583    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c"} err="failed to get container status \"c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c\": rpc error: code = NotFound desc = could not find container \"c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c\": container with ID starting with c2aa68c1884799696578cb140ff40c496a652a916c25c2003205f7916b34d66c not found: ID does not exist"
Aug 05 18:08:52.457475 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.457416    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d9k9\" (UniqueName: \"kubernetes.io/projected/af9a45dd-c459-4c4c-ae17-20647dbff7d7-kube-api-access-9d9k9\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:08:52.457475 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.457442    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af9a45dd-c459-4c4c-ae17-20647dbff7d7-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:08:52.457799 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.457780    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"]
Aug 05 18:08:52.461802 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.461777    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-625864-8686b58fb8-c4x8f"]
Aug 05 18:08:52.465197 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:52.465172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:54.060606 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:54.060566    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eec02a4-d445-4708-ace8-3c1c464aa441" path="/var/lib/kubelet/pods/2eec02a4-d445-4708-ace8-3c1c464aa441/volumes"
Aug 05 18:08:54.061118 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:54.060939    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" path="/var/lib/kubelet/pods/af9a45dd-c459-4c4c-ae17-20647dbff7d7/volumes"
Aug 05 18:08:58.490433 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:58.490386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:58.589736 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:58.589690    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:58.710358 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:58.710325    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"]
Aug 05 18:08:58.710638 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:58.710610    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy" containerID="cri-o://8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f" gracePeriod=30
Aug 05 18:08:58.752764 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:58.752670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:59.002575 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:59.002541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:59.319115 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:59.319071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:59.627443 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:59.627342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:08:59.727344 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:08:59.727313    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:02.692231 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:02.692181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:02.789938 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:02.789904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:03.881527 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:03.881474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:03.988154 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:03.988087    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:09:04.174237 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-certs\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174260    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64476fde-e399-4685-a435-02395715fe01-istio-podinfo\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-data\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174316    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cc5n\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-kube-api-access-5cc5n\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174361    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-envoy\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174396    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-credential-socket\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174418    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64476fde-e399-4685-a435-02395715fe01-istiod-ca-cert\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-socket\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:09:04.174782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174578    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-data" (OuterVolumeSpecName: "istio-data") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:09:04.174782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-istio-token\") pod \"64476fde-e399-4685-a435-02395715fe01\" (UID: \"64476fde-e399-4685-a435-02395715fe01\") "
Aug 05 18:09:04.174782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174765    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:09:04.175076 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.174969    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:09:04.175356 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.175089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64476fde-e399-4685-a435-02395715fe01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:09:04.176083 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.175929    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.176083 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.175955    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.176083 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.175969    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.176083 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.175981    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.176083 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.175994    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64476fde-e399-4685-a435-02395715fe01-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.177121 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.177093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-istio-token" (OuterVolumeSpecName: "istio-token") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:09:04.177265 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.177247    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64476fde-e399-4685-a435-02395715fe01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:09:04.177347 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.177327    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:09:04.178192 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.178165    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-kube-api-access-5cc5n" (OuterVolumeSpecName: "kube-api-access-5cc5n") pod "64476fde-e399-4685-a435-02395715fe01" (UID: "64476fde-e399-4685-a435-02395715fe01"). InnerVolumeSpecName "kube-api-access-5cc5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:09:04.277207 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.277116    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.277207 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.277145    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64476fde-e399-4685-a435-02395715fe01-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.277207 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.277160    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cc5n\" (UniqueName: \"kubernetes.io/projected/64476fde-e399-4685-a435-02395715fe01-kube-api-access-5cc5n\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.277207 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.277174    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64476fde-e399-4685-a435-02395715fe01-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:09:04.335340 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.335310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:04.435228 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.435188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:04.466178 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466143    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"]
Aug 05 18:09:04.466597 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466579    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy"
Aug 05 18:09:04.466681 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466600    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy"
Aug 05 18:09:04.466681 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466618    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" containerName="payload-pre-processing"
Aug 05 18:09:04.466681 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466626    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" containerName="payload-pre-processing"
Aug 05 18:09:04.466681 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466652    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eec02a4-d445-4708-ace8-3c1c464aa441" containerName="revoke-keys"
Aug 05 18:09:04.466681 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466660    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eec02a4-d445-4708-ace8-3c1c464aa441" containerName="revoke-keys"
Aug 05 18:09:04.466972 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466781    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="af9a45dd-c459-4c4c-ae17-20647dbff7d7" containerName="payload-pre-processing"
Aug 05 18:09:04.466972 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466796    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy"
Aug 05 18:09:04.466972 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466806    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy"
Aug 05 18:09:04.466972 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.466814    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eec02a4-d445-4708-ace8-3c1c464aa441" containerName="revoke-keys"
Aug 05 18:09:04.470257 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.470235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.474807 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.474780    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-ba69fc-dockercfg-n9dbx\""
Aug 05 18:09:04.474807 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.474796    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-ba69fc\""
Aug 05 18:09:04.483165 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.483136    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"]
Aug 05 18:09:04.522903 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.522832    2560 generic.go:356] "Generic (PLEG): container finished" podID="64476fde-e399-4685-a435-02395715fe01" containerID="8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f" exitCode=0
Aug 05 18:09:04.523114 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.522919    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"
Aug 05 18:09:04.523114 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.522925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" event={"ID":"64476fde-e399-4685-a435-02395715fe01","Type":"ContainerDied","Data":"8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f"}
Aug 05 18:09:04.523114 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.523019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv" event={"ID":"64476fde-e399-4685-a435-02395715fe01","Type":"ContainerDied","Data":"dbfdf00ca1a3709fa68aa871fec964689408098a4ced9bcd0a05382a7b491142"}
Aug 05 18:09:04.523114 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.523051    2560 scope.go:117] "RemoveContainer" containerID="8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f"
Aug 05 18:09:04.528953 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.528875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:04.535145 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.535127    2560 scope.go:117] "RemoveContainer" containerID="be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e"
Aug 05 18:09:04.544016 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.543998    2560 scope.go:117] "RemoveContainer" containerID="8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f"
Aug 05 18:09:04.544382 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:09:04.544354    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f\": container with ID starting with 8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f not found: ID does not exist" containerID="8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f"
Aug 05 18:09:04.544444 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.544396    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f"} err="failed to get container status \"8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f\": rpc error: code = NotFound desc = could not find container \"8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f\": container with ID starting with 8ca222a8733b5e308374956bdf35b8c932cc7166ce3a2ee7bcf5b56169742f7f not found: ID does not exist"
Aug 05 18:09:04.544444 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.544421    2560 scope.go:117] "RemoveContainer" containerID="be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e"
Aug 05 18:09:04.544704 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:09:04.544684    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e\": container with ID starting with be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e not found: ID does not exist" containerID="be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e"
Aug 05 18:09:04.544771 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.544710    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e"} err="failed to get container status \"be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e\": rpc error: code = NotFound desc = could not find container \"be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e\": container with ID starting with be680cb7ba0a952a89d84994543b63e8a41af6aa34673ab4e4c43662613d880e not found: ID does not exist"
Aug 05 18:09:04.556620 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.556589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"]
Aug 05 18:09:04.560237 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.560211    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-625864-openshift-default-65bb79db44-c99kv"]
Aug 05 18:09:04.580371 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.580327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e721988-90fc-4948-ac9d-0b8d79b07988-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.580536 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.580438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxsd\" (UniqueName: \"kubernetes.io/projected/2e721988-90fc-4948-ac9d-0b8d79b07988-kube-api-access-4zxsd\") pod \"payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.681350 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.681307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e721988-90fc-4948-ac9d-0b8d79b07988-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.681537 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.681418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxsd\" (UniqueName: \"kubernetes.io/projected/2e721988-90fc-4948-ac9d-0b8d79b07988-kube-api-access-4zxsd\") pod \"payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.682105 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.682086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e721988-90fc-4948-ac9d-0b8d79b07988-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.689921 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.689897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxsd\" (UniqueName: \"kubernetes.io/projected/2e721988-90fc-4948-ac9d-0b8d79b07988-kube-api-access-4zxsd\") pod \"payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.783296 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.783205    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:04.933635 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:04.933608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"]
Aug 05 18:09:04.935489 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:09:04.935463    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e721988_90fc_4948_ac9d_0b8d79b07988.slice/crio-2ff0ef1c930a440e15dd06c1e377ec0fe07a2e0dd655d20126b40456b5e15f0d WatchSource:0}: Error finding container 2ff0ef1c930a440e15dd06c1e377ec0fe07a2e0dd655d20126b40456b5e15f0d: Status 404 returned error can't find the container with id 2ff0ef1c930a440e15dd06c1e377ec0fe07a2e0dd655d20126b40456b5e15f0d
Aug 05 18:09:05.530264 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:05.530224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b" event={"ID":"2e721988-90fc-4948-ac9d-0b8d79b07988","Type":"ContainerStarted","Data":"a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1"}
Aug 05 18:09:05.530471 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:05.530285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:05.530471 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:05.530305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b" event={"ID":"2e721988-90fc-4948-ac9d-0b8d79b07988","Type":"ContainerStarted","Data":"2ff0ef1c930a440e15dd06c1e377ec0fe07a2e0dd655d20126b40456b5e15f0d"}
Aug 05 18:09:05.557788 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:05.557718    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b" podStartSLOduration=1.557694958 podStartE2EDuration="1.557694958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:09:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:09:05.554503314 +0000 UTC m=+2794.039426736" watchObservedRunningTime="2026-08-05 18:09:05.557694958 +0000 UTC m=+2794.042618378"
Aug 05 18:09:06.060708 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:06.060676    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64476fde-e399-4685-a435-02395715fe01" path="/var/lib/kubelet/pods/64476fde-e399-4685-a435-02395715fe01/volumes"
Aug 05 18:09:16.540091 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:16.540041    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b" podUID="2e721988-90fc-4948-ac9d-0b8d79b07988" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.70:9004: connect: connection refused"
Aug 05 18:09:26.538631 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:26.538595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:09:27.672590 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:27.672551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:27.999566 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:27.999471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:28.265361 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.265276    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"]
Aug 05 18:09:28.265883 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.265867    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy"
Aug 05 18:09:28.265940 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.265887    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="64476fde-e399-4685-a435-02395715fe01" containerName="istio-proxy"
Aug 05 18:09:28.269609 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.269586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.272187 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.272163    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-594b65-openshift-default-dockercfg-nwknz\""
Aug 05 18:09:28.281588 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.281566    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"]
Aug 05 18:09:28.309835 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.309799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:28.399736 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004ee530-d727-4bad-a186-4f2e070c56c8-istio-podinfo\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.399736 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004ee530-d727-4bad-a186-4f2e070c56c8-istiod-ca-cert\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.399981 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-credential-socket\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.399981 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htgzt\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-kube-api-access-htgzt\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.399981 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-envoy\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.399981 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-socket\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.399981 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-certs\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.400150 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.399992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-istio-token\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.400150 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.400030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-data\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.500893 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.500840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-socket\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501077 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.500900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-certs\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501077 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.500939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-istio-token\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501077 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.500966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-data\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501077 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004ee530-d727-4bad-a186-4f2e070c56c8-istio-podinfo\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501312 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004ee530-d727-4bad-a186-4f2e070c56c8-istiod-ca-cert\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501379 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-credential-socket\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501437 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-certs\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501437 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgzt\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-kube-api-access-htgzt\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501531 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501435    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-data\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501531 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-socket\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501531 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-envoy\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501531 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-credential-socket\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.501834 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.501811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004ee530-d727-4bad-a186-4f2e070c56c8-istiod-ca-cert\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.503696 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.503656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-envoy\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.503817 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.503800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004ee530-d727-4bad-a186-4f2e070c56c8-istio-podinfo\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.509357 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.509339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-istio-token\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.509468 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.509448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htgzt\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-kube-api-access-htgzt\") pod \"e2e-shared-b-594b65-openshift-default-999d44448-l7dbh\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") " pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.510088 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.510063    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:28.582176 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.582073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:28.732391 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.732308    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"]
Aug 05 18:09:28.735103 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:09:28.735073    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004ee530_d727_4bad_a186_4f2e070c56c8.slice/crio-8354ed74b41c6aa86343948a17f033e6c6eb4095cbe1a0e861490a023b3f8512 WatchSource:0}: Error finding container 8354ed74b41c6aa86343948a17f033e6c6eb4095cbe1a0e861490a023b3f8512: Status 404 returned error can't find the container with id 8354ed74b41c6aa86343948a17f033e6c6eb4095cbe1a0e861490a023b3f8512
Aug 05 18:09:28.737291 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.737257    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:09:28.737383 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.737338    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:09:28.737453 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:28.737379    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:09:29.682725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:29.682690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" event={"ID":"004ee530-d727-4bad-a186-4f2e070c56c8","Type":"ContainerStarted","Data":"657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5"}
Aug 05 18:09:29.682967 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:29.682742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" event={"ID":"004ee530-d727-4bad-a186-4f2e070c56c8","Type":"ContainerStarted","Data":"8354ed74b41c6aa86343948a17f033e6c6eb4095cbe1a0e861490a023b3f8512"}
Aug 05 18:09:29.708343 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:29.708293    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podStartSLOduration=1.708278435 podStartE2EDuration="1.708278435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:09:29.705897104 +0000 UTC m=+2818.190820544" watchObservedRunningTime="2026-08-05 18:09:29.708278435 +0000 UTC m=+2818.193201853"
Aug 05 18:09:30.582725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:30.582688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:30.588162 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:30.588137    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:30.689261 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:30.689223    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:30.690751 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:30.690731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:31.638085 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:31.638019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:31.749211 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:31.749178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:32.919240 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:32.919202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:33.201763 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.201665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:33.374817 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.374787    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:33.474773 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.474678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:09:33.487907 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.487872    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"]
Aug 05 18:09:33.492915 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.492886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.495527 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.495502    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-594b65\""
Aug 05 18:09:33.495643 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.495572    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-594b65-dockercfg-zm52x\""
Aug 05 18:09:33.501611 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.501583    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"]
Aug 05 18:09:33.651429 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.651387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.651611 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.651505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4lwr\" (UniqueName: \"kubernetes.io/projected/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-kube-api-access-z4lwr\") pod \"payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.752170 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.752073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4lwr\" (UniqueName: \"kubernetes.io/projected/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-kube-api-access-z4lwr\") pod \"payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.752359 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.752176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.752965 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.752944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.761569 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.761545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4lwr\" (UniqueName: \"kubernetes.io/projected/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-kube-api-access-z4lwr\") pod \"payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.805701 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.805661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:33.948878 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:33.948828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"]
Aug 05 18:09:33.950339 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:09:33.950310    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbd1927_ae39_409b_8a40_09ca2e8b40d7.slice/crio-a0e26be1f80747723ed8e6580007ec8e24f7490ec78e3bfbc9e0034489afcf7a WatchSource:0}: Error finding container a0e26be1f80747723ed8e6580007ec8e24f7490ec78e3bfbc9e0034489afcf7a: Status 404 returned error can't find the container with id a0e26be1f80747723ed8e6580007ec8e24f7490ec78e3bfbc9e0034489afcf7a
Aug 05 18:09:34.713925 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:34.713889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm" event={"ID":"cbbd1927-ae39-409b-8a40-09ca2e8b40d7","Type":"ContainerStarted","Data":"9127802f49942f251c20e04d15c747fc756484df8083f9f9366c6804c8cb08c2"}
Aug 05 18:09:34.714137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:34.713979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm" event={"ID":"cbbd1927-ae39-409b-8a40-09ca2e8b40d7","Type":"ContainerStarted","Data":"a0e26be1f80747723ed8e6580007ec8e24f7490ec78e3bfbc9e0034489afcf7a"}
Aug 05 18:09:34.714137 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:34.714024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:34.738878 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:34.738804    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm" podStartSLOduration=1.7387880999999998 podStartE2EDuration="1.7387881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:09:34.736291194 +0000 UTC m=+2823.221214613" watchObservedRunningTime="2026-08-05 18:09:34.7387881 +0000 UTC m=+2823.223711519"
Aug 05 18:09:45.690795 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.690755    2560 patch_prober.go:28] interesting pod/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Aug 05 18:09:45.691280 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.690837    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Aug 05 18:09:45.721384 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.721357    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:09:45.782652 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.782622    2560 generic.go:356] "Generic (PLEG): container finished" podID="004ee530-d727-4bad-a186-4f2e070c56c8" containerID="657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5" exitCode=0
Aug 05 18:09:45.782815 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.782702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" event={"ID":"004ee530-d727-4bad-a186-4f2e070c56c8","Type":"ContainerDied","Data":"657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5"}
Aug 05 18:09:45.783156 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.783142    2560 scope.go:117] "RemoveContainer" containerID="657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5"
Aug 05 18:09:45.784235 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.784207    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:09:45.784316 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.784278    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:09:45.784316 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:45.784308    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:09:46.790240 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:46.790205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" event={"ID":"004ee530-d727-4bad-a186-4f2e070c56c8","Type":"ContainerStarted","Data":"6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973"}
Aug 05 18:09:47.582949 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:47.582914    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:47.583192 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:47.583166    2560 patch_prober.go:28] interesting pod/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Aug 05 18:09:47.583240 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:47.583218    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Aug 05 18:09:48.582594 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:48.582563    2560 patch_prober.go:28] interesting pod/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Aug 05 18:09:48.582990 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:48.582615    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Aug 05 18:09:49.582798 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:49.582760    2560 patch_prober.go:28] interesting pod/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Aug 05 18:09:49.583224 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:49.582815    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Aug 05 18:09:50.582673 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:50.582638    2560 patch_prober.go:28] interesting pod/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Aug 05 18:09:50.582892 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:50.582696    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Aug 05 18:09:51.582823 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:51.582784    2560 patch_prober.go:28] interesting pod/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Aug 05 18:09:51.583047 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:51.582867    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Aug 05 18:09:52.587446 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:52.587417    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:52.587841 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:52.587705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:52.588356 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:52.588339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:09:56.631649 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:09:56.631609    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:10:02.094239 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:10:02.094200    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:10:21.685219 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:10:21.685181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:11:16.136330 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:11:16.136289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:12:57.911269 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:12:57.911233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:13:18.278091 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:13:18.278055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:13:19.186542 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:13:19.186503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:13:32.450289 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:13:32.450261    2560 scope.go:117] "RemoveContainer" containerID="17674f9d2a8c01f470f52be1938b49a8fabea4ad373cac3f948c6b50bfc03de0"
Aug 05 18:13:32.462328 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:13:32.462306    2560 scope.go:117] "RemoveContainer" containerID="96019716bfd273b68b4730bda944d614435c3086b3327bc55344deb03a267d55"
Aug 05 18:13:32.733945 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:13:32.733835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:13:32.805041 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:13:32.805012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:13:36.075486 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:13:36.075444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:14:05.118108 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:14:05.118067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:14:15.149300 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:14:15.149258    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:14:32.487664 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:14:32.487601    2560 scope.go:117] "RemoveContainer" containerID="2e0644b35d8b18be66f5416f84f0a62980be4a34e27a1d1b608949a6753478a0"
Aug 05 18:15:00.142215 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.142107    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"]
Aug 05 18:15:00.145630 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.145604    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67"]
Aug 05 18:15:00.145767 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.145731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"
Aug 05 18:15:00.148447 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.148423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:15:00.149650 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.149627    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"]
Aug 05 18:15:00.149741 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.149727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67"
Aug 05 18:15:00.153495 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.153471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"
Aug 05 18:15:00.156291 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.155268    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"]
Aug 05 18:15:00.159917 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.159896    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67"]
Aug 05 18:15:00.160934 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.160687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"
Aug 05 18:15:00.166386 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.164737    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"]
Aug 05 18:15:00.171565 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.171545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67"
Aug 05 18:15:00.202935 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.202909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"
Aug 05 18:15:00.345783 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.345296    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"]
Aug 05 18:15:00.399532 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.399505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"]
Aug 05 18:15:00.401183 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:15:00.401145    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c1c248_6cf4_4e9c_906d_8338fc683262.slice/crio-7d58103ac4502124f9056dbfb097be64c2ea5367cbe8e4507996fb941bda4afe WatchSource:0}: Error finding container 7d58103ac4502124f9056dbfb097be64c2ea5367cbe8e4507996fb941bda4afe: Status 404 returned error can't find the container with id 7d58103ac4502124f9056dbfb097be64c2ea5367cbe8e4507996fb941bda4afe
Aug 05 18:15:00.575738 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.575707    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67"]
Aug 05 18:15:00.577306 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:15:00.577278    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc87cb34_0024_486f_b270_364cbb7629bb.slice/crio-149de4dc2813ebf24c18446d50e96deb7070fd4ef7e13ad36155a8005916dd8b WatchSource:0}: Error finding container 149de4dc2813ebf24c18446d50e96deb7070fd4ef7e13ad36155a8005916dd8b: Status 404 returned error can't find the container with id 149de4dc2813ebf24c18446d50e96deb7070fd4ef7e13ad36155a8005916dd8b
Aug 05 18:15:00.655170 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.655091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8" event={"ID":"a0c1c248-6cf4-4e9c-906d-8338fc683262","Type":"ContainerStarted","Data":"7d58103ac4502124f9056dbfb097be64c2ea5367cbe8e4507996fb941bda4afe"}
Aug 05 18:15:00.656516 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.656483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67" event={"ID":"dc87cb34-0024-486f-b270-364cbb7629bb","Type":"ContainerStarted","Data":"149de4dc2813ebf24c18446d50e96deb7070fd4ef7e13ad36155a8005916dd8b"}
Aug 05 18:15:00.658366 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:00.658341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq" event={"ID":"437351de-5f00-4870-9b00-46e764673beb","Type":"ContainerStarted","Data":"f47ec68df2c0b63ce31af8286ef55daf94feca1a9d83ccc81063228e03465d12"}
Aug 05 18:15:01.665892 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:01.665859    2560 generic.go:356] "Generic (PLEG): container finished" podID="a0c1c248-6cf4-4e9c-906d-8338fc683262" containerID="d800be9c42ca43128dbdb349c0a0ce6f6da95df5214c2eb35db606f25fefec5e" exitCode=0
Aug 05 18:15:01.666411 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:01.665937    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8" event={"ID":"a0c1c248-6cf4-4e9c-906d-8338fc683262","Type":"ContainerDied","Data":"d800be9c42ca43128dbdb349c0a0ce6f6da95df5214c2eb35db606f25fefec5e"}
Aug 05 18:15:01.667558 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:01.667533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67" event={"ID":"dc87cb34-0024-486f-b270-364cbb7629bb","Type":"ContainerStarted","Data":"470eca0f63ee7390cc2e9479030aa96d1b7b41a08a8794771c2a9ea9d31cad68"}
Aug 05 18:15:01.668995 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:01.668973    2560 generic.go:356] "Generic (PLEG): container finished" podID="437351de-5f00-4870-9b00-46e764673beb" containerID="9f7d6da7a1fd59e732a96324bfd3288b1ecc4275b3b3aa4eb92299643eb876f9" exitCode=0
Aug 05 18:15:01.669103 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:01.669056    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq" event={"ID":"437351de-5f00-4870-9b00-46e764673beb","Type":"ContainerDied","Data":"9f7d6da7a1fd59e732a96324bfd3288b1ecc4275b3b3aa4eb92299643eb876f9"}
Aug 05 18:15:01.722070 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:01.722022    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67" podStartSLOduration=1.7220051920000001 podStartE2EDuration="1.722005192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:15:01.721209893 +0000 UTC m=+3150.206133308" watchObservedRunningTime="2026-08-05 18:15:01.722005192 +0000 UTC m=+3150.206928610"
Aug 05 18:15:02.677094 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:02.677055    2560 generic.go:356] "Generic (PLEG): container finished" podID="dc87cb34-0024-486f-b270-364cbb7629bb" containerID="470eca0f63ee7390cc2e9479030aa96d1b7b41a08a8794771c2a9ea9d31cad68" exitCode=0
Aug 05 18:15:02.677581 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:02.677109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67" event={"ID":"dc87cb34-0024-486f-b270-364cbb7629bb","Type":"ContainerDied","Data":"470eca0f63ee7390cc2e9479030aa96d1b7b41a08a8794771c2a9ea9d31cad68"}
Aug 05 18:15:02.814513 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:02.814489    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"
Aug 05 18:15:02.847937 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:02.847905    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"
Aug 05 18:15:03.684082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:03.684048    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"
Aug 05 18:15:03.684571 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:03.684085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8" event={"ID":"a0c1c248-6cf4-4e9c-906d-8338fc683262","Type":"ContainerDied","Data":"7d58103ac4502124f9056dbfb097be64c2ea5367cbe8e4507996fb941bda4afe"}
Aug 05 18:15:03.684571 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:03.684135    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d58103ac4502124f9056dbfb097be64c2ea5367cbe8e4507996fb941bda4afe"
Aug 05 18:15:03.685570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:03.685551    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"
Aug 05 18:15:03.685700 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:03.685582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq" event={"ID":"437351de-5f00-4870-9b00-46e764673beb","Type":"ContainerDied","Data":"f47ec68df2c0b63ce31af8286ef55daf94feca1a9d83ccc81063228e03465d12"}
Aug 05 18:15:03.685700 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:03.685623    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f47ec68df2c0b63ce31af8286ef55daf94feca1a9d83ccc81063228e03465d12"
Aug 05 18:15:03.827178 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:03.827156    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67"
Aug 05 18:15:04.692822 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:04.692796    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67"
Aug 05 18:15:04.693250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:04.692856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765895-sdd67" event={"ID":"dc87cb34-0024-486f-b270-364cbb7629bb","Type":"ContainerDied","Data":"149de4dc2813ebf24c18446d50e96deb7070fd4ef7e13ad36155a8005916dd8b"}
Aug 05 18:15:04.693250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:04.692909    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="149de4dc2813ebf24c18446d50e96deb7070fd4ef7e13ad36155a8005916dd8b"
Aug 05 18:15:25.209781 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:25.209748    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:15:26.211029 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:26.210999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:15:29.567113 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:29.567074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:15:32.509096 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:32.509062    2560 scope.go:117] "RemoveContainer" containerID="ee87acfd522dc558e6031a48e0e57c8ab90ec8698d27901337226c5b4d489e9d"
Aug 05 18:15:38.310895 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:15:38.310840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:16:16.209428 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:16:16.209392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:23.614587 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:23.614547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:25.225410 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:25.225375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:43.768051 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:43.768019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:44.036519 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.036443    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"]
Aug 05 18:17:44.036867 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.036831    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="437351de-5f00-4870-9b00-46e764673beb" containerName="cleanup"
Aug 05 18:17:44.036920 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.036893    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="437351de-5f00-4870-9b00-46e764673beb" containerName="cleanup"
Aug 05 18:17:44.036920 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.036914    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c1c248-6cf4-4e9c-906d-8338fc683262" containerName="cleanup"
Aug 05 18:17:44.036920 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.036920    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c1c248-6cf4-4e9c-906d-8338fc683262" containerName="cleanup"
Aug 05 18:17:44.037024 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.036935    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc87cb34-0024-486f-b270-364cbb7629bb" containerName="cleanup"
Aug 05 18:17:44.037024 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.036941    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc87cb34-0024-486f-b270-364cbb7629bb" containerName="cleanup"
Aug 05 18:17:44.037087 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.037036    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c1c248-6cf4-4e9c-906d-8338fc683262" containerName="cleanup"
Aug 05 18:17:44.037087 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.037047    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc87cb34-0024-486f-b270-364cbb7629bb" containerName="cleanup"
Aug 05 18:17:44.037087 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.037053    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="437351de-5f00-4870-9b00-46e764673beb" containerName="cleanup"
Aug 05 18:17:44.040272 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.040257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.042541 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.042523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6427fe-openshift-default-dockercfg-vdmf6\""
Aug 05 18:17:44.061915 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.061882    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"]
Aug 05 18:17:44.087006 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.086978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-envoy\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087164 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-istio-token\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087164 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-socket\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087164 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-data\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087164 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbxxg\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-kube-api-access-xbxxg\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087310 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-certs\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087310 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35318837-69da-49ec-8646-1689e6725faa-istio-podinfo\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087310 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-credential-socket\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.087404 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.087310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35318837-69da-49ec-8646-1689e6725faa-istiod-ca-cert\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188059 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-envoy\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188059 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-istio-token\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-socket\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-data\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbxxg\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-kube-api-access-xbxxg\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188345 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-certs\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188568 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35318837-69da-49ec-8646-1689e6725faa-istio-podinfo\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188721 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-credential-socket\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188721 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-data\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188721 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35318837-69da-49ec-8646-1689e6725faa-istiod-ca-cert\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188931 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-socket\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.188931 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.188886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-credential-socket\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.189275 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.189248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-certs\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.189404 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.189391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35318837-69da-49ec-8646-1689e6725faa-istiod-ca-cert\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.190923 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.190905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-envoy\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.191183 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.191164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35318837-69da-49ec-8646-1689e6725faa-istio-podinfo\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.202604 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.202576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbxxg\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-kube-api-access-xbxxg\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.203113 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.203090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-istio-token\") pod \"e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") " pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.259118 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.259088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:44.354118 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.354040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:44.500571 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.500540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"]
Aug 05 18:17:44.502054 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:17:44.502026    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35318837_69da_49ec_8646_1689e6725faa.slice/crio-9f8dcba1c3b20f14aed2194737270b78a8b40e8cdf31147b50bea07db6121b0b WatchSource:0}: Error finding container 9f8dcba1c3b20f14aed2194737270b78a8b40e8cdf31147b50bea07db6121b0b: Status 404 returned error can't find the container with id 9f8dcba1c3b20f14aed2194737270b78a8b40e8cdf31147b50bea07db6121b0b
Aug 05 18:17:44.504124 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.504095    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:17:44.504185 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.504155    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:17:44.504223 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.504184    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:17:44.560265 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.560243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:44.655268 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.655169    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" event={"ID":"35318837-69da-49ec-8646-1689e6725faa","Type":"ContainerStarted","Data":"263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444"}
Aug 05 18:17:44.655268 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.655231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" event={"ID":"35318837-69da-49ec-8646-1689e6725faa","Type":"ContainerStarted","Data":"9f8dcba1c3b20f14aed2194737270b78a8b40e8cdf31147b50bea07db6121b0b"}
Aug 05 18:17:44.675732 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:44.675668    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podStartSLOduration=0.675646948 podStartE2EDuration="675.646948ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:17:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:17:44.674536276 +0000 UTC m=+3313.159459707" watchObservedRunningTime="2026-08-05 18:17:44.675646948 +0000 UTC m=+3313.160570367"
Aug 05 18:17:45.354545 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:45.354513    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:45.359822 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:45.359800    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:45.661138 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:45.661051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:45.661969 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:45.661948    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:17:46.683487 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:46.683451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:46.778142 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:46.778111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:47.813535 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:47.813503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:48.635036 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:48.634975    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:17:48.697182 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:17:48.697144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:01.485464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.485421    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": read tcp 10.134.0.2:50254->10.134.0.76:15021: read: connection reset by peer" start-of-body=
Aug 05 18:18:01.485915 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.485500    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": read tcp 10.134.0.2:50254->10.134.0.76:15021: read: connection reset by peer"
Aug 05 18:18:01.757992 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.757906    2560 generic.go:356] "Generic (PLEG): container finished" podID="35318837-69da-49ec-8646-1689e6725faa" containerID="263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444" exitCode=0
Aug 05 18:18:01.758144 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.757986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" event={"ID":"35318837-69da-49ec-8646-1689e6725faa","Type":"ContainerDied","Data":"263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444"}
Aug 05 18:18:01.758421 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.758404    2560 scope.go:117] "RemoveContainer" containerID="263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444"
Aug 05 18:18:01.759548 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.759517    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:01.759663 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.759599    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:01.759663 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:01.759649    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:02.770466 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:02.770429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" event={"ID":"35318837-69da-49ec-8646-1689e6725faa","Type":"ContainerStarted","Data":"44b997d065880b1126f65c338d5869a7614d365174f91107a730d3103ef440ac"}
Aug 05 18:18:03.354584 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:03.354545    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:18:03.354971 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:03.354942    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Aug 05 18:18:03.355197 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:03.355171    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Aug 05 18:18:04.355362 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:04.355321    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Aug 05 18:18:04.355992 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:04.355959    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Aug 05 18:18:05.354740 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:05.354704    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Aug 05 18:18:05.355068 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:05.355039    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Aug 05 18:18:06.354764 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:06.354722    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Aug 05 18:18:06.355451 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:06.355404    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Aug 05 18:18:07.355232 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:07.355187    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Aug 05 18:18:07.355758 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:07.355259    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Aug 05 18:18:08.358779 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:08.358743    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:18:08.359208 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:08.359129    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:18:08.359891 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:08.359871    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:18:12.425560 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.425521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:12.499902 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.499873    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"]
Aug 05 18:18:12.502174 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.502142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:12.502960 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.502939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.505406 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.505385    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a3125a-openshift-default-dockercfg-pl9px\""
Aug 05 18:18:12.526525 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.526489    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"]
Aug 05 18:18:12.567992 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.567952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-data\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.568340 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.568319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb34484-76ca-45ad-ae55-177591e293cb-istio-podinfo\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.568488 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.568474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-credential-socket\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.568657 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.568644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-socket\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.568908 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.568835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb34484-76ca-45ad-ae55-177591e293cb-istiod-ca-cert\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.569076 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.569062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-istio-token\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.569205 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.569191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-envoy\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.569330 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.569317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqrpq\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-kube-api-access-dqrpq\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.569441 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.569428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-certs\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.601623 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.601581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:12.670454 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb34484-76ca-45ad-ae55-177591e293cb-istiod-ca-cert\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670454 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-istio-token\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-envoy\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqrpq\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-kube-api-access-dqrpq\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-certs\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-data\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb34484-76ca-45ad-ae55-177591e293cb-istio-podinfo\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-credential-socket\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.670725 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.670718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-socket\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.671144 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.671060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-data\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.671284 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.671259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-certs\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.671487 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.671272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb34484-76ca-45ad-ae55-177591e293cb-istiod-ca-cert\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.671487 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.671305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-credential-socket\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.671649 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.671358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-socket\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.673053 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.673035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-envoy\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.673472 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.673453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb34484-76ca-45ad-ae55-177591e293cb-istio-podinfo\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.679399 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.679340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-istio-token\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.679512 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.679442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqrpq\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-kube-api-access-dqrpq\") pod \"e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") " pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.767526 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.767493    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:12.828738 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.828709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:12.979488 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.979458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"]
Aug 05 18:18:12.981157 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:18:12.981126    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb34484_76ca_45ad_ae55_177591e293cb.slice/crio-bd1cf9c74a9477361a78e3806fb33701df5a910c84b89bcd445339e140fc1171 WatchSource:0}: Error finding container bd1cf9c74a9477361a78e3806fb33701df5a910c84b89bcd445339e140fc1171: Status 404 returned error can't find the container with id bd1cf9c74a9477361a78e3806fb33701df5a910c84b89bcd445339e140fc1171
Aug 05 18:18:12.986678 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.984131    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:12.986678 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.984233    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:12.986678 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:12.984286    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:13.837676 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:13.837639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" event={"ID":"9fb34484-76ca-45ad-ae55-177591e293cb","Type":"ContainerStarted","Data":"726af10fcb993b35c48ba9317d4c81d15e7ab2bfd00790581b21ab30510717ff"}
Aug 05 18:18:13.838110 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:13.837690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" event={"ID":"9fb34484-76ca-45ad-ae55-177591e293cb","Type":"ContainerStarted","Data":"bd1cf9c74a9477361a78e3806fb33701df5a910c84b89bcd445339e140fc1171"}
Aug 05 18:18:13.859663 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:13.859612    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podStartSLOduration=1.859596604 podStartE2EDuration="1.859596604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:18:13.858664892 +0000 UTC m=+3342.343588313" watchObservedRunningTime="2026-08-05 18:18:13.859596604 +0000 UTC m=+3342.344520023"
Aug 05 18:18:14.829934 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:14.829894    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:14.835058 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:14.835031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:14.843894 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:14.843868    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:14.844689 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:14.844672    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:15.738363 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:15.738326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:15.837163 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:15.837130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:17.001457 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:17.001417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:17.106099 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:17.106064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:17.551718 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:17.551665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:17.670386 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:17.670353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:18:29.845825 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.845791    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Aug 05 18:18:29.846307 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.845893    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Aug 05 18:18:29.964321 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.964284    2560 generic.go:356] "Generic (PLEG): container finished" podID="9fb34484-76ca-45ad-ae55-177591e293cb" containerID="726af10fcb993b35c48ba9317d4c81d15e7ab2bfd00790581b21ab30510717ff" exitCode=0
Aug 05 18:18:29.964496 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.964361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" event={"ID":"9fb34484-76ca-45ad-ae55-177591e293cb","Type":"ContainerDied","Data":"726af10fcb993b35c48ba9317d4c81d15e7ab2bfd00790581b21ab30510717ff"}
Aug 05 18:18:29.964791 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.964771    2560 scope.go:117] "RemoveContainer" containerID="726af10fcb993b35c48ba9317d4c81d15e7ab2bfd00790581b21ab30510717ff"
Aug 05 18:18:29.965938 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.965908    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:29.966060 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.965991    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:29.966060 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:29.966042    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:18:30.975612 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:30.975582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" event={"ID":"9fb34484-76ca-45ad-ae55-177591e293cb","Type":"ContainerStarted","Data":"0f0bc3bb09a2bc436d38b2a52f76ed6149315d3ea4f0617541392317b4796687"}
Aug 05 18:18:31.829647 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:31.829591    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:31.829977 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:31.829952    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Aug 05 18:18:31.830097 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:31.830008    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Aug 05 18:18:32.829637 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:32.829598    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Aug 05 18:18:32.830059 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:32.829663    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Aug 05 18:18:33.830213 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:33.830112    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Aug 05 18:18:33.830213 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:33.830177    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Aug 05 18:18:34.829813 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:34.829776    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Aug 05 18:18:34.830036 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:34.829837    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Aug 05 18:18:35.829394 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:35.829353    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Aug 05 18:18:35.829825 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:35.829415    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Aug 05 18:18:36.833468 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:36.833438    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:36.833987 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:36.833894    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:36.834732 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:36.834717    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:18:40.712412 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:18:40.712380    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:19:10.800347 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:19:10.800310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:19:50.454515 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:19:50.454474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:03.505658 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.505624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:03.864109 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.864021    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"]
Aug 05 18:20:03.868248 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.868223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.871440 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.871420    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-2696ea-openshift-default-dockercfg-4rsln\""
Aug 05 18:20:03.890996 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.890959    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"]
Aug 05 18:20:03.905205 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.905176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:03.989956 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.989915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-socket\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.989956 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.989950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-token\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.990218 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.989981    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-certs\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.990218 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.990063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-podinfo\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.990218 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.990106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-data\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.990218 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.990132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-credential-socket\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.990218 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.990203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjnth\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-kube-api-access-tjnth\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.990480 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.990292    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:03.990480 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:03.990321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-envoy\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091232 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091448 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-envoy\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091448 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-socket\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091448 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-token\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091448 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-certs\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091448 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-podinfo\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091731 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-data\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091731 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-credential-socket\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091861 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjnth\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-kube-api-access-tjnth\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091861 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-socket\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.091861 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.091805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-certs\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.092044 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.092019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-data\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.092275 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.092250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-credential-socket\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.092721 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.092695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.094209 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.094187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-podinfo\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.094377 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.094360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-envoy\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.109823 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.109788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjnth\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-kube-api-access-tjnth\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.110235 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.110211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-token\") pod \"e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") " pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.140558 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.140466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:04.179720 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.179669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:04.330702 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.330676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"]
Aug 05 18:20:04.332134 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:20:04.332106    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca160ac0_e38e_4d4b_913e_e732ff3db78b.slice/crio-531a1b796da0b12030c5935f0952d12d252af901d51c64c1956bcf882653e84b WatchSource:0}: Error finding container 531a1b796da0b12030c5935f0952d12d252af901d51c64c1956bcf882653e84b: Status 404 returned error can't find the container with id 531a1b796da0b12030c5935f0952d12d252af901d51c64c1956bcf882653e84b
Aug 05 18:20:04.334343 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.334312    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:20:04.334429 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.334382    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:20:04.334429 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.334412    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:20:04.548492 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.548455    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" event={"ID":"ca160ac0-e38e-4d4b-913e-e732ff3db78b","Type":"ContainerStarted","Data":"d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca"}
Aug 05 18:20:04.549016 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.548519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" event={"ID":"ca160ac0-e38e-4d4b-913e-e732ff3db78b","Type":"ContainerStarted","Data":"531a1b796da0b12030c5935f0952d12d252af901d51c64c1956bcf882653e84b"}
Aug 05 18:20:04.571715 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:04.571648    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podStartSLOduration=1.571622354 podStartE2EDuration="1.571622354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:20:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:20:04.570524781 +0000 UTC m=+3453.055448224" watchObservedRunningTime="2026-08-05 18:20:04.571622354 +0000 UTC m=+3453.056545776"
Aug 05 18:20:05.180759 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:05.180714    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:05.186071 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:05.186042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:05.555782 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:05.555683    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:05.556991 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:05.556968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:06.536221 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:06.536183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:06.635112 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:06.635069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:07.676825 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:07.676792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:07.842510 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:07.842481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:08.216177 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:08.216140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:08.314933 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:08.314898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:21.598051 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:21.598008    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 05 18:20:21.598709 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:21.598090    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 05 18:20:22.665822 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:22.665778    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerID="d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca" exitCode=0
Aug 05 18:20:22.666262 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:22.665863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" event={"ID":"ca160ac0-e38e-4d4b-913e-e732ff3db78b","Type":"ContainerDied","Data":"d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca"}
Aug 05 18:20:22.666321 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:22.666307    2560 scope.go:117] "RemoveContainer" containerID="d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca"
Aug 05 18:20:22.667486 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:22.667453    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:20:22.667597 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:22.667531    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:20:22.667597 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:22.667563    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 05 18:20:23.676731 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:23.676697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" event={"ID":"ca160ac0-e38e-4d4b-913e-e732ff3db78b","Type":"ContainerStarted","Data":"3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1"}
Aug 05 18:20:24.180688 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:24.180650    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:24.180960 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:24.180937    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Aug 05 18:20:24.181022 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:24.180990    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Aug 05 18:20:25.180339 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:25.180298    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Aug 05 18:20:25.180765 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:25.180360    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Aug 05 18:20:26.181211 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:26.181167    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Aug 05 18:20:26.181616 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:26.181233    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Aug 05 18:20:27.180294 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:27.180259    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Aug 05 18:20:27.180498 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:27.180317    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Aug 05 18:20:28.180195 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:28.180160    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Aug 05 18:20:28.180602 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:28.180217    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Aug 05 18:20:29.184306 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:29.184276    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:29.184789 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:29.184669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:29.185447 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:29.185426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:31.544380 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:31.544350    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:32.220168 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.220135    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"]
Aug 05 18:20:32.223462 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.223442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"
Aug 05 18:20:32.227547 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.227522    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 18:20:32.227998 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.227978    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:20:32.250367 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.250338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"]
Aug 05 18:20:32.286211 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.286179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78733711-fad8-4a0c-852b-5ef7b99de58b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn\" (UID: \"78733711-fad8-4a0c-852b-5ef7b99de58b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"
Aug 05 18:20:32.387177 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.387144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78733711-fad8-4a0c-852b-5ef7b99de58b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn\" (UID: \"78733711-fad8-4a0c-852b-5ef7b99de58b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"
Aug 05 18:20:32.387739 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.387715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78733711-fad8-4a0c-852b-5ef7b99de58b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn\" (UID: \"78733711-fad8-4a0c-852b-5ef7b99de58b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"
Aug 05 18:20:32.535238 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.535158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"
Aug 05 18:20:32.684259 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.684232    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"]
Aug 05 18:20:32.690074 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:20:32.690043    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78733711_fad8_4a0c_852b_5ef7b99de58b.slice/crio-a25ad04eea5bade403a813fcde3ced0377ce3132ca1a7e413891382573e487e1 WatchSource:0}: Error finding container a25ad04eea5bade403a813fcde3ced0377ce3132ca1a7e413891382573e487e1: Status 404 returned error can't find the container with id a25ad04eea5bade403a813fcde3ced0377ce3132ca1a7e413891382573e487e1
Aug 05 18:20:32.730987 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:32.730953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn" event={"ID":"78733711-fad8-4a0c-852b-5ef7b99de58b","Type":"ContainerStarted","Data":"a25ad04eea5bade403a813fcde3ced0377ce3132ca1a7e413891382573e487e1"}
Aug 05 18:20:33.738164 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:33.738133    2560 generic.go:356] "Generic (PLEG): container finished" podID="78733711-fad8-4a0c-852b-5ef7b99de58b" containerID="8ff2cfca9d232ea064b23aff89b00be68d9adee7ba6b07b47889fdfcebc05872" exitCode=0
Aug 05 18:20:33.738565 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:33.738181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn" event={"ID":"78733711-fad8-4a0c-852b-5ef7b99de58b","Type":"ContainerDied","Data":"8ff2cfca9d232ea064b23aff89b00be68d9adee7ba6b07b47889fdfcebc05872"}
Aug 05 18:20:34.883676 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:34.883651    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"
Aug 05 18:20:35.017009 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:35.016920    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78733711-fad8-4a0c-852b-5ef7b99de58b-maas-api-service-ca\") pod \"78733711-fad8-4a0c-852b-5ef7b99de58b\" (UID: \"78733711-fad8-4a0c-852b-5ef7b99de58b\") "
Aug 05 18:20:35.017294 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:35.017269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78733711-fad8-4a0c-852b-5ef7b99de58b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78733711-fad8-4a0c-852b-5ef7b99de58b" (UID: "78733711-fad8-4a0c-852b-5ef7b99de58b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:20:35.118365 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:35.118330    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78733711-fad8-4a0c-852b-5ef7b99de58b-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:35.751231 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:35.751206    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"
Aug 05 18:20:35.751419 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:35.751208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn" event={"ID":"78733711-fad8-4a0c-852b-5ef7b99de58b","Type":"ContainerDied","Data":"a25ad04eea5bade403a813fcde3ced0377ce3132ca1a7e413891382573e487e1"}
Aug 05 18:20:35.751419 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:35.751326    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a25ad04eea5bade403a813fcde3ced0377ce3132ca1a7e413891382573e487e1"
Aug 05 18:20:38.317312 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:38.317280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:38.412353 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:38.412321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:38.510572 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:38.510538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:38.559228 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:38.559184    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"]
Aug 05 18:20:38.568029 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:38.567943    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2696ea-2gswn"]
Aug 05 18:20:38.616278 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:38.616244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:38.932359 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:38.932320    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:40.063643 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:40.063604    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78733711-fad8-4a0c-852b-5ef7b99de58b" path="/var/lib/kubelet/pods/78733711-fad8-4a0c-852b-5ef7b99de58b/volumes"
Aug 05 18:20:45.515493 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:45.515454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:45.615528 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:45.615498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:45.798222 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:45.798135    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"]
Aug 05 18:20:45.798380 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:45.798358    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy" containerID="cri-o://3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1" gracePeriod=30
Aug 05 18:20:45.826283 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:45.826249    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:46.057647 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:46.057469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:20:51.058170 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.058145    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:51.181424 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181383    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-data\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.181424 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181431    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istiod-ca-cert\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.181685 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181454    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjnth\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-kube-api-access-tjnth\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.181685 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181504    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-certs\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.181685 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-podinfo\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.181685 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181565    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-token\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.181685 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181591    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-credential-socket\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.181685 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-envoy\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.182053 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181713    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-socket\") pod \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\" (UID: \"ca160ac0-e38e-4d4b-913e-e732ff3db78b\") "
Aug 05 18:20:51.182053 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181707    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:20:51.182053 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181889    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:20:51.182053 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181907    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:20:51.182053 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.181949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:20:51.182357 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.182100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:20:51.182357 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.182155    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.182357 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.182173    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.182357 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.182185    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.182357 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.182198    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.184064 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.184035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:20:51.184064 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.184055    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:20:51.184230 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.184082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-kube-api-access-tjnth" (OuterVolumeSpecName: "kube-api-access-tjnth") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "kube-api-access-tjnth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:20:51.184230 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.184122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca160ac0-e38e-4d4b-913e-e732ff3db78b" (UID: "ca160ac0-e38e-4d4b-913e-e732ff3db78b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:20:51.283458 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.283427    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjnth\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-kube-api-access-tjnth\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.283458 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.283458    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.283677 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.283473    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.283677 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.283486    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.283677 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.283498    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca160ac0-e38e-4d4b-913e-e732ff3db78b-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:20:51.859508 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.859469    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerID="3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1" exitCode=0
Aug 05 18:20:51.859741 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.859518    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"
Aug 05 18:20:51.859741 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.859550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" event={"ID":"ca160ac0-e38e-4d4b-913e-e732ff3db78b","Type":"ContainerDied","Data":"3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1"}
Aug 05 18:20:51.859741 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.859613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9" event={"ID":"ca160ac0-e38e-4d4b-913e-e732ff3db78b","Type":"ContainerDied","Data":"531a1b796da0b12030c5935f0952d12d252af901d51c64c1956bcf882653e84b"}
Aug 05 18:20:51.859741 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.859644    2560 scope.go:117] "RemoveContainer" containerID="3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1"
Aug 05 18:20:51.871881 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.871794    2560 scope.go:117] "RemoveContainer" containerID="d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca"
Aug 05 18:20:51.882031 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.882006    2560 scope.go:117] "RemoveContainer" containerID="3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1"
Aug 05 18:20:51.882340 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:20:51.882317    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1\": container with ID starting with 3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1 not found: ID does not exist" containerID="3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1"
Aug 05 18:20:51.882406 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.882356    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1"} err="failed to get container status \"3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1\": rpc error: code = NotFound desc = could not find container \"3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1\": container with ID starting with 3638c672f02d5f0060e67d29dff6cede2d0b48a9b653f2ceaf31a4edb7ddd3b1 not found: ID does not exist"
Aug 05 18:20:51.882406 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.882377    2560 scope.go:117] "RemoveContainer" containerID="d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca"
Aug 05 18:20:51.882621 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:20:51.882604    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca\": container with ID starting with d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca not found: ID does not exist" containerID="d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca"
Aug 05 18:20:51.882659 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.882627    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca"} err="failed to get container status \"d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca\": rpc error: code = NotFound desc = could not find container \"d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca\": container with ID starting with d60f163e621033252576643e59d25e3e6aca9f5cef807d717435276f521850ca not found: ID does not exist"
Aug 05 18:20:51.884099 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.884078    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"]
Aug 05 18:20:51.889732 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:51.889706    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2696ea-openshift-default-69b6fcd7c4-nkws9"]
Aug 05 18:20:52.060514 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:20:52.060480    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" path="/var/lib/kubelet/pods/ca160ac0-e38e-4d4b-913e-e732ff3db78b/volumes"
Aug 05 18:21:05.045451 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:05.045357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:05.115964 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:05.115933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:05.217090 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:05.217060    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:05.276212 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:05.276175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:05.629961 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:05.629931    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:10.712374 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:10.712339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:17.941619 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:17.941587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:47.444876 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:47.444831    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:48.194483 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:48.194450    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:21:54.033443 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:21:54.033414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:11.693378 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:11.693342    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:11.751274 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:11.751246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:17.920190 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:17.920156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:17.994996 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:17.994968    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:18.180468 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:18.180377    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"]
Aug 05 18:22:18.180643 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:18.180600    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" containerID="cri-o://44b997d065880b1126f65c338d5869a7614d365174f91107a730d3103ef440ac" gracePeriod=30
Aug 05 18:22:18.209003 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:18.208968    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:18.424227 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:18.424193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:23.417650 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.417616    2560 generic.go:356] "Generic (PLEG): container finished" podID="35318837-69da-49ec-8646-1689e6725faa" containerID="44b997d065880b1126f65c338d5869a7614d365174f91107a730d3103ef440ac" exitCode=0
Aug 05 18:22:23.418113 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.417666    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" event={"ID":"35318837-69da-49ec-8646-1689e6725faa","Type":"ContainerDied","Data":"44b997d065880b1126f65c338d5869a7614d365174f91107a730d3103ef440ac"}
Aug 05 18:22:23.418113 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.417721    2560 scope.go:117] "RemoveContainer" containerID="263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444"
Aug 05 18:22:23.438083 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:22:23.438025    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444\": container with ID starting with 263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444 not found: ID does not exist" containerID="263c5391e4b13e2c9d165561af052c2ce8fc6a51ffc351c8dc9af7baa8387444"
Aug 05 18:22:23.439887 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.439871    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:22:23.487943 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.487904    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-istio-token\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.487943 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.487943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbxxg\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-kube-api-access-xbxxg\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488204 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.487960    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35318837-69da-49ec-8646-1689e6725faa-istiod-ca-cert\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488204 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.487991    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-envoy\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488204 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-credential-socket\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488204 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488073    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-data\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488506 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-certs\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488506 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488316    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-socket\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488506 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35318837-69da-49ec-8646-1689e6725faa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:22:23.488506 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488361    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35318837-69da-49ec-8646-1689e6725faa-istio-podinfo\") pod \"35318837-69da-49ec-8646-1689e6725faa\" (UID: \"35318837-69da-49ec-8646-1689e6725faa\") "
Aug 05 18:22:23.488731 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-data" (OuterVolumeSpecName: "istio-data") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:23.488731 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488590    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:23.488861 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488762    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:23.488861 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.488778    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:23.489140 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.489074    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.489140 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.489101    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.489140 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.489115    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35318837-69da-49ec-8646-1689e6725faa-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.489140 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.489129    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.489416 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.489143    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.490591 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.490563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-istio-token" (OuterVolumeSpecName: "istio-token") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:22:23.490785 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.490758    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-kube-api-access-xbxxg" (OuterVolumeSpecName: "kube-api-access-xbxxg") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "kube-api-access-xbxxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:22:23.491347 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.491311    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35318837-69da-49ec-8646-1689e6725faa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:22:23.491347 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.491313    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35318837-69da-49ec-8646-1689e6725faa" (UID: "35318837-69da-49ec-8646-1689e6725faa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:23.590111 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.590072    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35318837-69da-49ec-8646-1689e6725faa-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.590111 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.590106    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.590111 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.590121    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbxxg\" (UniqueName: \"kubernetes.io/projected/35318837-69da-49ec-8646-1689e6725faa-kube-api-access-xbxxg\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:23.590351 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:23.590130    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35318837-69da-49ec-8646-1689e6725faa-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:24.360706 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:24.360622    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 05 18:22:24.360706 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:24.360691    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 05 18:22:24.425963 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:24.425931    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"
Aug 05 18:22:24.426397 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:24.425962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl" event={"ID":"35318837-69da-49ec-8646-1689e6725faa","Type":"ContainerDied","Data":"9f8dcba1c3b20f14aed2194737270b78a8b40e8cdf31147b50bea07db6121b0b"}
Aug 05 18:22:24.426397 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:24.426041    2560 scope.go:117] "RemoveContainer" containerID="44b997d065880b1126f65c338d5869a7614d365174f91107a730d3103ef440ac"
Aug 05 18:22:24.449713 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:24.449675    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"]
Aug 05 18:22:24.454905 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:24.454878    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6427fe-openshift-default-7f7ddbf97d-hrhcl"]
Aug 05 18:22:26.061418 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:26.061388    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35318837-69da-49ec-8646-1689e6725faa" path="/var/lib/kubelet/pods/35318837-69da-49ec-8646-1689e6725faa/volumes"
Aug 05 18:22:29.191428 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:29.191396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:30.483767 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:30.483736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:36.138619 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.138579    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:36.238621 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.238581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:36.400646 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.400567    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"]
Aug 05 18:22:36.400809 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.400790    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" containerID="cri-o://0f0bc3bb09a2bc436d38b2a52f76ed6149315d3ea4f0617541392317b4796687" gracePeriod=30
Aug 05 18:22:36.416513 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.416486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:36.642078 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.642051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:36.836273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.836234    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 18:22:36.836457 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:36.836307    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 18:22:41.533283 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.533252    2560 generic.go:356] "Generic (PLEG): container finished" podID="9fb34484-76ca-45ad-ae55-177591e293cb" containerID="0f0bc3bb09a2bc436d38b2a52f76ed6149315d3ea4f0617541392317b4796687" exitCode=0
Aug 05 18:22:41.533692 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.533331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" event={"ID":"9fb34484-76ca-45ad-ae55-177591e293cb","Type":"ContainerDied","Data":"0f0bc3bb09a2bc436d38b2a52f76ed6149315d3ea4f0617541392317b4796687"}
Aug 05 18:22:41.533692 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.533419    2560 scope.go:117] "RemoveContainer" containerID="726af10fcb993b35c48ba9317d4c81d15e7ab2bfd00790581b21ab30510717ff"
Aug 05 18:22:41.663384 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.663359    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:22:41.772025 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.771991    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-istio-token\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772025 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772027    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-envoy\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-credential-socket\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772067    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb34484-76ca-45ad-ae55-177591e293cb-istiod-ca-cert\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-socket\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772175    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqrpq\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-kube-api-access-dqrpq\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772229    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb34484-76ca-45ad-ae55-177591e293cb-istio-podinfo\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772270    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-certs\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772580 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:41.772580 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772456    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-data\") pod \"9fb34484-76ca-45ad-ae55-177591e293cb\" (UID: \"9fb34484-76ca-45ad-ae55-177591e293cb\") "
Aug 05 18:22:41.772580 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772440    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:41.772580 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772528    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:41.772580 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772560    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb34484-76ca-45ad-ae55-177591e293cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:22:41.772890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772787    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.772890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772801    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.772890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772810    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb34484-76ca-45ad-ae55-177591e293cb-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.772890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772819    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.772890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.772803    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:41.774503 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.774477    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:22:41.774503 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.774494    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:22:41.774690 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.774665    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fb34484-76ca-45ad-ae55-177591e293cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:22:41.774907 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.774888    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-kube-api-access-dqrpq" (OuterVolumeSpecName: "kube-api-access-dqrpq") pod "9fb34484-76ca-45ad-ae55-177591e293cb" (UID: "9fb34484-76ca-45ad-ae55-177591e293cb"). InnerVolumeSpecName "kube-api-access-dqrpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:22:41.873496 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.873464    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb34484-76ca-45ad-ae55-177591e293cb-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.873496 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.873490    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.873496 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.873500    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.873496 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.873507    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb34484-76ca-45ad-ae55-177591e293cb-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:41.873755 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:41.873515    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqrpq\" (UniqueName: \"kubernetes.io/projected/9fb34484-76ca-45ad-ae55-177591e293cb-kube-api-access-dqrpq\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:42.540620 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:42.540593    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"
Aug 05 18:22:42.541155 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:42.540671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx" event={"ID":"9fb34484-76ca-45ad-ae55-177591e293cb","Type":"ContainerDied","Data":"bd1cf9c74a9477361a78e3806fb33701df5a910c84b89bcd445339e140fc1171"}
Aug 05 18:22:42.541155 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:42.540731    2560 scope.go:117] "RemoveContainer" containerID="0f0bc3bb09a2bc436d38b2a52f76ed6149315d3ea4f0617541392317b4796687"
Aug 05 18:22:42.560318 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:42.560288    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"]
Aug 05 18:22:42.565127 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:42.565100    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a3125a-openshift-default-d559579d-dpskx"]
Aug 05 18:22:44.061157 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:44.061125    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" path="/var/lib/kubelet/pods/9fb34484-76ca-45ad-ae55-177591e293cb/volumes"
Aug 05 18:22:47.319908 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.319868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:47.347778 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.347743    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"]
Aug 05 18:22:47.350204 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.350182    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ba69fc-29765895-vrxs8"]
Aug 05 18:22:47.468436 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.468395    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"]
Aug 05 18:22:47.468689 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.468663    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b" podUID="2e721988-90fc-4948-ac9d-0b8d79b07988" containerName="payload-pre-processing" containerID="cri-o://a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1" gracePeriod=30
Aug 05 18:22:47.503583 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.503549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:47.601489 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.601462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:47.690948 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.690916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:47.726152 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.726123    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:22:47.836469 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.836388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zxsd\" (UniqueName: \"kubernetes.io/projected/2e721988-90fc-4948-ac9d-0b8d79b07988-kube-api-access-4zxsd\") pod \"2e721988-90fc-4948-ac9d-0b8d79b07988\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") "
Aug 05 18:22:47.836469 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.836434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e721988-90fc-4948-ac9d-0b8d79b07988-plugins-config-volume\") pod \"2e721988-90fc-4948-ac9d-0b8d79b07988\" (UID: \"2e721988-90fc-4948-ac9d-0b8d79b07988\") "
Aug 05 18:22:47.836910 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.836886    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e721988-90fc-4948-ac9d-0b8d79b07988-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e721988-90fc-4948-ac9d-0b8d79b07988" (UID: "2e721988-90fc-4948-ac9d-0b8d79b07988"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:22:47.838634 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.838607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e721988-90fc-4948-ac9d-0b8d79b07988-kube-api-access-4zxsd" (OuterVolumeSpecName: "kube-api-access-4zxsd") pod "2e721988-90fc-4948-ac9d-0b8d79b07988" (UID: "2e721988-90fc-4948-ac9d-0b8d79b07988"). InnerVolumeSpecName "kube-api-access-4zxsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:22:47.937780 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.937742    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zxsd\" (UniqueName: \"kubernetes.io/projected/2e721988-90fc-4948-ac9d-0b8d79b07988-kube-api-access-4zxsd\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:47.937780 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:47.937768    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e721988-90fc-4948-ac9d-0b8d79b07988-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:48.041330 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.041292    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:48.061025 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.060995    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c1c248-6cf4-4e9c-906d-8338fc683262" path="/var/lib/kubelet/pods/a0c1c248-6cf4-4e9c-906d-8338fc683262/volumes"
Aug 05 18:22:48.577730 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.577693    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e721988-90fc-4948-ac9d-0b8d79b07988" containerID="a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1" exitCode=0
Aug 05 18:22:48.577730 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.577736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"
Aug 05 18:22:48.578307 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.577774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b" event={"ID":"2e721988-90fc-4948-ac9d-0b8d79b07988","Type":"ContainerDied","Data":"a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1"}
Aug 05 18:22:48.578307 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.577824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b" event={"ID":"2e721988-90fc-4948-ac9d-0b8d79b07988","Type":"ContainerDied","Data":"2ff0ef1c930a440e15dd06c1e377ec0fe07a2e0dd655d20126b40456b5e15f0d"}
Aug 05 18:22:48.578307 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.577866    2560 scope.go:117] "RemoveContainer" containerID="a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1"
Aug 05 18:22:48.587069 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.587049    2560 scope.go:117] "RemoveContainer" containerID="a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1"
Aug 05 18:22:48.587346 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:22:48.587327    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1\": container with ID starting with a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1 not found: ID does not exist" containerID="a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1"
Aug 05 18:22:48.587401 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.587357    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1"} err="failed to get container status \"a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1\": rpc error: code = NotFound desc = could not find container \"a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1\": container with ID starting with a185a1cec1622d1bd6bfa35e7502780ba37504ee44b20d8897795c0f596265b1 not found: ID does not exist"
Aug 05 18:22:48.594406 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.594369    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"]
Aug 05 18:22:48.600166 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:48.600143    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ba69fc-565bc9f48-c426b"]
Aug 05 18:22:50.060495 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:50.060460    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e721988-90fc-4948-ac9d-0b8d79b07988" path="/var/lib/kubelet/pods/2e721988-90fc-4948-ac9d-0b8d79b07988/volumes"
Aug 05 18:22:54.329187 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.329156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:54.390422 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.390371    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:54.613190 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.613075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:54.843581 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.843533    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:22:54.940688 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.940652    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"]
Aug 05 18:22:54.941146 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941128    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941149    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941175    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941183    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941193    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941201    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941212    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941221    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941232    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e721988-90fc-4948-ac9d-0b8d79b07988" containerName="payload-pre-processing"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941241    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e721988-90fc-4948-ac9d-0b8d79b07988" containerName="payload-pre-processing"
Aug 05 18:22:54.941250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941251    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78733711-fad8-4a0c-852b-5ef7b99de58b" containerName="revoke-keys"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941259    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="78733711-fad8-4a0c-852b-5ef7b99de58b" containerName="revoke-keys"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941284    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941293    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941396    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941406    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941419    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e721988-90fc-4948-ac9d-0b8d79b07988" containerName="payload-pre-processing"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941428    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="78733711-fad8-4a0c-852b-5ef7b99de58b" containerName="revoke-keys"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941437    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="35318837-69da-49ec-8646-1689e6725faa" containerName="istio-proxy"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941447    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy"
Aug 05 18:22:54.941723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.941455    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca160ac0-e38e-4d4b-913e-e732ff3db78b" containerName="istio-proxy"
Aug 05 18:22:54.946260 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.946242    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"
Aug 05 18:22:54.948758 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.948735    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 18:22:54.949237 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.949069    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jzbbt\""
Aug 05 18:22:54.953494 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:54.953364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"]
Aug 05 18:22:55.004319 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:55.004285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73086d1-3457-4c69-92e2-f7b694d57025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-594b65-h98n6\" (UID: \"a73086d1-3457-4c69-92e2-f7b694d57025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"
Aug 05 18:22:55.105064 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:55.105030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73086d1-3457-4c69-92e2-f7b694d57025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-594b65-h98n6\" (UID: \"a73086d1-3457-4c69-92e2-f7b694d57025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"
Aug 05 18:22:55.105635 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:55.105615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73086d1-3457-4c69-92e2-f7b694d57025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-594b65-h98n6\" (UID: \"a73086d1-3457-4c69-92e2-f7b694d57025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"
Aug 05 18:22:55.260196 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:55.260112    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"
Aug 05 18:22:55.401405 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:55.401369    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"]
Aug 05 18:22:55.402952 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:22:55.402923    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73086d1_3457_4c69_92e2_f7b694d57025.slice/crio-a9284d21b9e354d5066f09e5bb98393ad251e5a3508b86f5cd6a6ea287afdce5 WatchSource:0}: Error finding container a9284d21b9e354d5066f09e5bb98393ad251e5a3508b86f5cd6a6ea287afdce5: Status 404 returned error can't find the container with id a9284d21b9e354d5066f09e5bb98393ad251e5a3508b86f5cd6a6ea287afdce5
Aug 05 18:22:55.620941 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:55.620836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6" event={"ID":"a73086d1-3457-4c69-92e2-f7b694d57025","Type":"ContainerStarted","Data":"a9284d21b9e354d5066f09e5bb98393ad251e5a3508b86f5cd6a6ea287afdce5"}
Aug 05 18:22:56.628092 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:56.628061    2560 generic.go:356] "Generic (PLEG): container finished" podID="a73086d1-3457-4c69-92e2-f7b694d57025" containerID="a3042f03465a2c67630e2dcad56d79e6215e141df0bf08dd28d2d67a8f1a6620" exitCode=0
Aug 05 18:22:56.628469 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:56.628129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6" event={"ID":"a73086d1-3457-4c69-92e2-f7b694d57025","Type":"ContainerDied","Data":"a3042f03465a2c67630e2dcad56d79e6215e141df0bf08dd28d2d67a8f1a6620"}
Aug 05 18:22:57.802865 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:57.802827    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"
Aug 05 18:22:57.929839 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:57.929810    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73086d1-3457-4c69-92e2-f7b694d57025-maas-api-service-ca\") pod \"a73086d1-3457-4c69-92e2-f7b694d57025\" (UID: \"a73086d1-3457-4c69-92e2-f7b694d57025\") "
Aug 05 18:22:57.930170 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:57.930147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a73086d1-3457-4c69-92e2-f7b694d57025-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a73086d1-3457-4c69-92e2-f7b694d57025" (UID: "a73086d1-3457-4c69-92e2-f7b694d57025"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:22:58.031225 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:58.031186    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a73086d1-3457-4c69-92e2-f7b694d57025-maas-api-service-ca\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:22:58.641735 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:58.641702    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"
Aug 05 18:22:58.641978 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:58.641704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6" event={"ID":"a73086d1-3457-4c69-92e2-f7b694d57025","Type":"ContainerDied","Data":"a9284d21b9e354d5066f09e5bb98393ad251e5a3508b86f5cd6a6ea287afdce5"}
Aug 05 18:22:58.641978 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:22:58.641828    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9284d21b9e354d5066f09e5bb98393ad251e5a3508b86f5cd6a6ea287afdce5"
Aug 05 18:23:05.451211 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.451150    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"]
Aug 05 18:23:05.453930 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.453896    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:05.457169 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.457143    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-594b65-29765895-ndtqq"]
Aug 05 18:23:05.493925 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.493889    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"]
Aug 05 18:23:05.494186 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.494151    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm" podUID="cbbd1927-ae39-409b-8a40-09ca2e8b40d7" containerName="payload-pre-processing" containerID="cri-o://9127802f49942f251c20e04d15c747fc756484df8083f9f9366c6804c8cb08c2" gracePeriod=30
Aug 05 18:23:05.547907 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.547875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:05.629983 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.629945    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"]
Aug 05 18:23:05.632924 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.632896    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:05.634006 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.633982    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-594b65-h98n6"]
Aug 05 18:23:05.690524 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.690491    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbbd1927-ae39-409b-8a40-09ca2e8b40d7" containerID="9127802f49942f251c20e04d15c747fc756484df8083f9f9366c6804c8cb08c2" exitCode=0
Aug 05 18:23:05.690702 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.690562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm" event={"ID":"cbbd1927-ae39-409b-8a40-09ca2e8b40d7","Type":"ContainerDied","Data":"9127802f49942f251c20e04d15c747fc756484df8083f9f9366c6804c8cb08c2"}
Aug 05 18:23:05.699061 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.699011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:05.756996 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.756971    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:23:05.904936 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.904886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4lwr\" (UniqueName: \"kubernetes.io/projected/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-kube-api-access-z4lwr\") pod \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") "
Aug 05 18:23:05.905141 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.904998    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-plugins-config-volume\") pod \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\" (UID: \"cbbd1927-ae39-409b-8a40-09ca2e8b40d7\") "
Aug 05 18:23:05.905360 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.905337    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbbd1927-ae39-409b-8a40-09ca2e8b40d7" (UID: "cbbd1927-ae39-409b-8a40-09ca2e8b40d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:23:05.907195 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.907175    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-kube-api-access-z4lwr" (OuterVolumeSpecName: "kube-api-access-z4lwr") pod "cbbd1927-ae39-409b-8a40-09ca2e8b40d7" (UID: "cbbd1927-ae39-409b-8a40-09ca2e8b40d7"). InnerVolumeSpecName "kube-api-access-z4lwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:23:05.988550 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:05.988466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:06.005774 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.005743    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4lwr\" (UniqueName: \"kubernetes.io/projected/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-kube-api-access-z4lwr\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:06.005774 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.005772    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbbd1927-ae39-409b-8a40-09ca2e8b40d7-plugins-config-volume\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:06.061516 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.061483    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="437351de-5f00-4870-9b00-46e764673beb" path="/var/lib/kubelet/pods/437351de-5f00-4870-9b00-46e764673beb/volumes"
Aug 05 18:23:06.061839 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.061825    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a73086d1-3457-4c69-92e2-f7b694d57025" path="/var/lib/kubelet/pods/a73086d1-3457-4c69-92e2-f7b694d57025/volumes"
Aug 05 18:23:06.698042 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.698014    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"
Aug 05 18:23:06.698472 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.698058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm" event={"ID":"cbbd1927-ae39-409b-8a40-09ca2e8b40d7","Type":"ContainerDied","Data":"a0e26be1f80747723ed8e6580007ec8e24f7490ec78e3bfbc9e0034489afcf7a"}
Aug 05 18:23:06.698472 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.698127    2560 scope.go:117] "RemoveContainer" containerID="9127802f49942f251c20e04d15c747fc756484df8083f9f9366c6804c8cb08c2"
Aug 05 18:23:06.716701 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.716673    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"]
Aug 05 18:23:06.720591 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.720565    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm"]
Aug 05 18:23:06.720737 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:06.720614    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-594b65-5b448b6856-dgnkm" podUID="cbbd1927-ae39-409b-8a40-09ca2e8b40d7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.72:9004: i/o timeout"
Aug 05 18:23:08.061038 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:08.061000    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbd1927-ae39-409b-8a40-09ca2e8b40d7" path="/var/lib/kubelet/pods/cbbd1927-ae39-409b-8a40-09ca2e8b40d7/volumes"
Aug 05 18:23:12.500319 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:12.500286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:12.575914 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:12.575884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:12.742120 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:12.742089    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"]
Aug 05 18:23:12.742346 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:12.742284    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy" containerID="cri-o://6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973" gracePeriod=30
Aug 05 18:23:12.760393 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:12.760306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:12.969890 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:12.969841    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:17.992587 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:17.992562    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:23:18.126996 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.126922    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004ee530-d727-4bad-a186-4f2e070c56c8-istiod-ca-cert\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.126996 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.126965    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htgzt\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-kube-api-access-htgzt\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.126996 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.126989    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004ee530-d727-4bad-a186-4f2e070c56c8-istio-podinfo\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.127273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127016    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-certs\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.127273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-credential-socket\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.127273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127079    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-data\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.127273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-socket\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.127273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127213    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-envoy\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.127273 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127241    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-istio-token\") pod \"004ee530-d727-4bad-a186-4f2e070c56c8\" (UID: \"004ee530-d727-4bad-a186-4f2e070c56c8\") "
Aug 05 18:23:18.127564 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127314    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/004ee530-d727-4bad-a186-4f2e070c56c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:23:18.127564 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:23:18.127564 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127428    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:23:18.127564 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127442    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:23:18.127564 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:23:18.127793 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127659    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004ee530-d727-4bad-a186-4f2e070c56c8-istiod-ca-cert\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.127793 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127681    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-certs\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.127930 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127743    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-credential-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.127930 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127881    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-data\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.127930 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.127911    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-workload-socket\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.129455 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.129424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-kube-api-access-htgzt" (OuterVolumeSpecName: "kube-api-access-htgzt") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "kube-api-access-htgzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:23:18.129575 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.129561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:23:18.129624 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.129590    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:23:18.129668 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.129629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/004ee530-d727-4bad-a186-4f2e070c56c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "004ee530-d727-4bad-a186-4f2e070c56c8" (UID: "004ee530-d727-4bad-a186-4f2e070c56c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:23:18.229013 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.228973    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004ee530-d727-4bad-a186-4f2e070c56c8-istio-envoy\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.229013 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.229003    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-istio-token\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.229013 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.229013    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htgzt\" (UniqueName: \"kubernetes.io/projected/004ee530-d727-4bad-a186-4f2e070c56c8-kube-api-access-htgzt\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.229013 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.229023    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004ee530-d727-4bad-a186-4f2e070c56c8-istio-podinfo\") on node \"ip-10-0-138-196.ec2.internal\" DevicePath \"\""
Aug 05 18:23:18.770923 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.770888    2560 generic.go:356] "Generic (PLEG): container finished" podID="004ee530-d727-4bad-a186-4f2e070c56c8" containerID="6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973" exitCode=0
Aug 05 18:23:18.771146 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.770942    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"
Aug 05 18:23:18.771146 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.770978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" event={"ID":"004ee530-d727-4bad-a186-4f2e070c56c8","Type":"ContainerDied","Data":"6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973"}
Aug 05 18:23:18.771146 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.771032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh" event={"ID":"004ee530-d727-4bad-a186-4f2e070c56c8","Type":"ContainerDied","Data":"8354ed74b41c6aa86343948a17f033e6c6eb4095cbe1a0e861490a023b3f8512"}
Aug 05 18:23:18.771146 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.771058    2560 scope.go:117] "RemoveContainer" containerID="6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973"
Aug 05 18:23:18.783323 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.783303    2560 scope.go:117] "RemoveContainer" containerID="657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5"
Aug 05 18:23:18.791749 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.791728    2560 scope.go:117] "RemoveContainer" containerID="6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973"
Aug 05 18:23:18.792020 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:23:18.791999    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973\": container with ID starting with 6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973 not found: ID does not exist" containerID="6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973"
Aug 05 18:23:18.792096 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.792028    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973"} err="failed to get container status \"6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973\": rpc error: code = NotFound desc = could not find container \"6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973\": container with ID starting with 6a4c1d5ac6705230d26b9473d62a966748c4e1e534e8c4bbb7cc42608905e973 not found: ID does not exist"
Aug 05 18:23:18.792096 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.792047    2560 scope.go:117] "RemoveContainer" containerID="657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5"
Aug 05 18:23:18.792291 ip-10-0-138-196 kubenswrapper[2560]: E0805 18:23:18.792273    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5\": container with ID starting with 657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5 not found: ID does not exist" containerID="657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5"
Aug 05 18:23:18.792336 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.792303    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5"} err="failed to get container status \"657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5\": rpc error: code = NotFound desc = could not find container \"657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5\": container with ID starting with 657ab9e8aba6f94e8468ada945110d58dfacc184f6e67de9dd7b1d10f20ad1b5 not found: ID does not exist"
Aug 05 18:23:18.796696 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.796669    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"]
Aug 05 18:23:18.800480 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:18.800459    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-594b65-openshift-default-999d44448-l7dbh"]
Aug 05 18:23:19.187171 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:19.187146    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cc69f54b9-9f9v2_496e5b22-194a-49b5-a471-9985c35d0faf/copy-manifests/0.log"
Aug 05 18:23:19.200464 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:19.200432    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cc69f54b9-9f9v2_496e5b22-194a-49b5-a471-9985c35d0faf/manager/0.log"
Aug 05 18:23:19.906198 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:19.906170    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765865-xpbb7_674183c4-1172-4272-8316-9158582b7300/cleanup/0.log"
Aug 05 18:23:20.010569 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:20.010543    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765880-8l627_e751d08c-2e77-4264-9306-5813ce84c0a5/cleanup/0.log"
Aug 05 18:23:20.060651 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:20.060621    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" path="/var/lib/kubelet/pods/004ee530-d727-4bad-a186-4f2e070c56c8/volumes"
Aug 05 18:23:20.114716 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:20.114688    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765895-sdd67_dc87cb34-0024-486f-b270-364cbb7629bb/cleanup/0.log"
Aug 05 18:23:21.213160 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:21.213134    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-bvfwx_82a7c0ff-3e85-4e92-941e-8c45ddba60d1/manager/0.log"
Aug 05 18:23:21.430799 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:21.430767    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-xqgn8_a025f2ef-eb73-4d27-96e7-d0ab0b54a0da/manager/0.log"
Aug 05 18:23:22.122105 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:22.122072    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s85mq_20c06c53-8211-4061-88dd-91ca84d54ce5/discovery/0.log"
Aug 05 18:23:22.562690 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:22.562660    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbnj2_bab73008-0329-4e5b-8bf0-d65c1d107822/payload-pre-processing/0.log"
Aug 05 18:23:23.240514 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:23.240479    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ksk7q_a507d0b8-b5bb-44f7-bc32-c7932fd1dc0b/main/0.log"
Aug 05 18:23:29.337974 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:29.337937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:29.399082 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:29.399044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log" limit=1024
Aug 05 18:23:32.454951 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:32.454916    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mx8jq_cd5bf156-7684-48e1-8c4e-29e6a7553a65/global-pull-secret-syncer/0.log"
Aug 05 18:23:32.513255 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:32.513223    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c2rb5_71ba3056-a844-4951-8a4a-ff51a4af3bd8/konnectivity-agent/0.log"
Aug 05 18:23:32.615351 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:32.615315    2560 scope.go:117] "RemoveContainer" containerID="d800be9c42ca43128dbdb349c0a0ce6f6da95df5214c2eb35db606f25fefec5e"
Aug 05 18:23:32.625609 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:32.625583    2560 scope.go:117] "RemoveContainer" containerID="9f7d6da7a1fd59e732a96324bfd3288b1ecc4275b3b3aa4eb92299643eb876f9"
Aug 05 18:23:32.675673 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:32.675649    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-196.ec2.internal_35ce26a74ea51f8bcd5eeb415ccdf08c/haproxy/0.log"
Aug 05 18:23:37.822723 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:37.822687    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-bvfwx_82a7c0ff-3e85-4e92-941e-8c45ddba60d1/manager/0.log"
Aug 05 18:23:37.949447 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:37.949418    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-xqgn8_a025f2ef-eb73-4d27-96e7-d0ab0b54a0da/manager/0.log"
Aug 05 18:23:39.433102 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.433076    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f94fe3f8-45eb-4adf-831c-f41c13d60775/alertmanager/0.log"
Aug 05 18:23:39.459282 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.459252    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f94fe3f8-45eb-4adf-831c-f41c13d60775/config-reloader/0.log"
Aug 05 18:23:39.487866 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.487823    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f94fe3f8-45eb-4adf-831c-f41c13d60775/kube-rbac-proxy-web/0.log"
Aug 05 18:23:39.523484 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.523451    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f94fe3f8-45eb-4adf-831c-f41c13d60775/kube-rbac-proxy/0.log"
Aug 05 18:23:39.542807 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.542781    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f94fe3f8-45eb-4adf-831c-f41c13d60775/kube-rbac-proxy-metric/0.log"
Aug 05 18:23:39.569268 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.569229    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f94fe3f8-45eb-4adf-831c-f41c13d60775/prom-label-proxy/0.log"
Aug 05 18:23:39.594353 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.594324    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f94fe3f8-45eb-4adf-831c-f41c13d60775/init-config-reloader/0.log"
Aug 05 18:23:39.857360 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:39.857333    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-4rvqs_9af91e8e-172a-477e-87f7-a83dd2006549/monitoring-plugin/0.log"
Aug 05 18:23:40.130737 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.130668    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w6pmt_eb0dd3de-5604-4b1a-ad04-c92457f29320/node-exporter/0.log"
Aug 05 18:23:40.156329 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.156300    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w6pmt_eb0dd3de-5604-4b1a-ad04-c92457f29320/kube-rbac-proxy/0.log"
Aug 05 18:23:40.183621 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.183594    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w6pmt_eb0dd3de-5604-4b1a-ad04-c92457f29320/init-textfile/0.log"
Aug 05 18:23:40.488753 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.488730    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-mvf8w_62ae55e4-5cb4-448a-8cd6-f05141553c84/prometheus-operator/0.log"
Aug 05 18:23:40.516702 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.516674    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-mvf8w_62ae55e4-5cb4-448a-8cd6-f05141553c84/kube-rbac-proxy/0.log"
Aug 05 18:23:40.589832 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.589794    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788447659d-pbx4n_23de5349-13d2-47d3-b5d9-e57aff2e4c1c/telemeter-client/0.log"
Aug 05 18:23:40.613765 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.613734    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788447659d-pbx4n_23de5349-13d2-47d3-b5d9-e57aff2e4c1c/reload/0.log"
Aug 05 18:23:40.642775 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.642742    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-788447659d-pbx4n_23de5349-13d2-47d3-b5d9-e57aff2e4c1c/kube-rbac-proxy/0.log"
Aug 05 18:23:40.673268 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.673241    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d68667b75-vnqdw_87cdfa10-f5cf-4140-9bf7-2f42a233530b/thanos-query/0.log"
Aug 05 18:23:40.700985 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.700952    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d68667b75-vnqdw_87cdfa10-f5cf-4140-9bf7-2f42a233530b/kube-rbac-proxy-web/0.log"
Aug 05 18:23:40.724726 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.724696    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d68667b75-vnqdw_87cdfa10-f5cf-4140-9bf7-2f42a233530b/kube-rbac-proxy/0.log"
Aug 05 18:23:40.749884 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.749764    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d68667b75-vnqdw_87cdfa10-f5cf-4140-9bf7-2f42a233530b/prom-label-proxy/0.log"
Aug 05 18:23:40.773550 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.773520    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d68667b75-vnqdw_87cdfa10-f5cf-4140-9bf7-2f42a233530b/kube-rbac-proxy-rules/0.log"
Aug 05 18:23:40.797715 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:40.797689    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d68667b75-vnqdw_87cdfa10-f5cf-4140-9bf7-2f42a233530b/kube-rbac-proxy-metrics/0.log"
Aug 05 18:23:41.986189 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:41.986161    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-546m7_0a89cb9f-1cbf-494b-9553-8141e7bce261/networking-console-plugin/0.log"
Aug 05 18:23:42.287218 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287131    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"]
Aug 05 18:23:42.287518 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287505    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73086d1-3457-4c69-92e2-f7b694d57025" containerName="revoke-keys"
Aug 05 18:23:42.287570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287518    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73086d1-3457-4c69-92e2-f7b694d57025" containerName="revoke-keys"
Aug 05 18:23:42.287570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287530    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy"
Aug 05 18:23:42.287570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287537    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy"
Aug 05 18:23:42.287570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287544    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy"
Aug 05 18:23:42.287570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287549    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy"
Aug 05 18:23:42.287570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287558    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbd1927-ae39-409b-8a40-09ca2e8b40d7" containerName="payload-pre-processing"
Aug 05 18:23:42.287570 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287564    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbd1927-ae39-409b-8a40-09ca2e8b40d7" containerName="payload-pre-processing"
Aug 05 18:23:42.287820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287626    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbd1927-ae39-409b-8a40-09ca2e8b40d7" containerName="payload-pre-processing"
Aug 05 18:23:42.287820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287634    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy"
Aug 05 18:23:42.287820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287641    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="004ee530-d727-4bad-a186-4f2e070c56c8" containerName="istio-proxy"
Aug 05 18:23:42.287820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287647    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a73086d1-3457-4c69-92e2-f7b694d57025" containerName="revoke-keys"
Aug 05 18:23:42.287820 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.287652    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb34484-76ca-45ad-ae55-177591e293cb" containerName="istio-proxy"
Aug 05 18:23:42.292406 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.292387    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.294707 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.294653    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dz5d\"/\"kube-root-ca.crt\""
Aug 05 18:23:42.294868 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.294764    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dz5d\"/\"default-dockercfg-9zj9h\""
Aug 05 18:23:42.295634 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.295615    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dz5d\"/\"openshift-service-ca.crt\""
Aug 05 18:23:42.301113 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.301088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"]
Aug 05 18:23:42.348160 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.348127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-podres\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.348160 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.348164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-sys\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.348422 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.348270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-proc\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.348422 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.348321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvm95\" (UniqueName: \"kubernetes.io/projected/31de7b07-729d-4292-b9a4-f89b576f3cc0-kube-api-access-fvm95\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.348422 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.348344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-lib-modules\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449003 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.448968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-proc\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449208 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvm95\" (UniqueName: \"kubernetes.io/projected/31de7b07-729d-4292-b9a4-f89b576f3cc0-kube-api-access-fvm95\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449208 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-proc\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449208 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-lib-modules\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449208 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-podres\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449420 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-sys\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449420 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449240    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-lib-modules\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449420 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-sys\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.449420 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.449348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/31de7b07-729d-4292-b9a4-f89b576f3cc0-podres\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.457370 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.457342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvm95\" (UniqueName: \"kubernetes.io/projected/31de7b07-729d-4292-b9a4-f89b576f3cc0-kube-api-access-fvm95\") pod \"perf-node-gather-daemonset-s8pqw\" (UID: \"31de7b07-729d-4292-b9a4-f89b576f3cc0\") " pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.603395 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.603306    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.740056 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.740021    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"]
Aug 05 18:23:42.742406 ip-10-0-138-196 kubenswrapper[2560]: W0805 18:23:42.742373    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod31de7b07_729d_4292_b9a4_f89b576f3cc0.slice/crio-5b7205b1c8d9b84e88f55d6a6149a18597b3153d24679407535ec1fb628e8b33 WatchSource:0}: Error finding container 5b7205b1c8d9b84e88f55d6a6149a18597b3153d24679407535ec1fb628e8b33: Status 404 returned error can't find the container with id 5b7205b1c8d9b84e88f55d6a6149a18597b3153d24679407535ec1fb628e8b33
Aug 05 18:23:42.911584 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.911543    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw" event={"ID":"31de7b07-729d-4292-b9a4-f89b576f3cc0","Type":"ContainerStarted","Data":"a4ad60ae542860e41f316cb012edd549727b6685c675823928b4e937a78d9fc4"}
Aug 05 18:23:42.911773 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.911684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:42.911773 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.911735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw" event={"ID":"31de7b07-729d-4292-b9a4-f89b576f3cc0","Type":"ContainerStarted","Data":"5b7205b1c8d9b84e88f55d6a6149a18597b3153d24679407535ec1fb628e8b33"}
Aug 05 18:23:42.928715 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:42.928666    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw" podStartSLOduration=0.928651351 podStartE2EDuration="928.651351ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 18:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:23:42.926926574 +0000 UTC m=+3671.411849994" watchObservedRunningTime="2026-08-05 18:23:42.928651351 +0000 UTC m=+3671.413574806"
Aug 05 18:23:43.303509 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:43.303477    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b9d5679b6-k4r7g_c77959df-33b8-426c-b0ff-ee8cc6e54b5c/console/0.log"
Aug 05 18:23:43.336784 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:43.336740    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-rdm9n_4711b734-49cd-4230-a6d6-4e0a8392afa2/download-server/0.log"
Aug 05 18:23:44.016544 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:44.016519    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-r9252_1e5aa9b2-37a3-40f5-825e-37250749fa26/volume-data-source-validator/0.log"
Aug 05 18:23:45.278250 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:45.278221    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p6dvk_81125c9f-7d7c-4f1a-833f-5d7c4e00f09e/dns/0.log"
Aug 05 18:23:45.307183 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:45.307151    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p6dvk_81125c9f-7d7c-4f1a-833f-5d7c4e00f09e/kube-rbac-proxy/0.log"
Aug 05 18:23:45.404008 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:45.403976    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zjzfb_afff50be-fdca-4346-bacd-2036a29b48e4/dns-node-resolver/0.log"
Aug 05 18:23:45.969307 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:45.969281    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-744bd668c-zhghm_b050aea2-69e0-4636-b5dd-728e4ef8fb66/registry/0.log"
Aug 05 18:23:46.047733 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:46.047694    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zzmrz_a0835e42-bf73-4bf5-8dbb-7819bd0d508f/node-ca/0.log"
Aug 05 18:23:47.256622 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:47.256588    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s85mq_20c06c53-8211-4061-88dd-91ca84d54ce5/discovery/0.log"
Aug 05 18:23:47.404959 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:47.404925    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbnj2_bab73008-0329-4e5b-8bf0-d65c1d107822/payload-pre-processing/0.log"
Aug 05 18:23:48.361341 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:48.361309    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zgzk2_19e14f0f-27a2-429c-ad0a-79f7da761469/serve-healthcheck-canary/0.log"
Aug 05 18:23:48.860544 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:48.860519    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gzxb_ae1b1592-30ae-4c06-91b1-18ba9d3cb42b/kube-rbac-proxy/0.log"
Aug 05 18:23:48.883732 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:48.883698    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gzxb_ae1b1592-30ae-4c06-91b1-18ba9d3cb42b/exporter/0.log"
Aug 05 18:23:48.906439 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:48.906416    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gzxb_ae1b1592-30ae-4c06-91b1-18ba9d3cb42b/extractor/0.log"
Aug 05 18:23:48.927470 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:48.927436    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dz5d/perf-node-gather-daemonset-s8pqw"
Aug 05 18:23:52.367691 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:52.367652    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cc69f54b9-9f9v2_496e5b22-194a-49b5-a471-9985c35d0faf/manager/0.log"
Aug 05 18:23:52.387862 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:52.387828    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cc69f54b9-9f9v2_496e5b22-194a-49b5-a471-9985c35d0faf/copy-manifests/0.log"
Aug 05 18:23:53.181712 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:53.181687    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s85mq_20c06c53-8211-4061-88dd-91ca84d54ce5/discovery/0.log"
Aug 05 18:23:53.258651 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:53.258624    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbnj2_bab73008-0329-4e5b-8bf0-d65c1d107822/payload-pre-processing/0.log"
Aug 05 18:23:53.778787 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:53.778757    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57fd6d5d59-zn598_f2a4623e-c177-464f-90b8-b484df975e5a/manager/0.log"
Aug 05 18:23:53.810427 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:53.810397    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-s86kv_87dcfad8-d5e0-4ffa-9e65-905070a0caed/openshift-lws-operator/0.log"
Aug 05 18:23:54.816575 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:54.816540    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s85mq_20c06c53-8211-4061-88dd-91ca84d54ce5/discovery/0.log"
Aug 05 18:23:54.897271 ip-10-0-138-196 kubenswrapper[2560]: I0805 18:23:54.897237    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbnj2_bab73008-0329-4e5b-8bf0-d65c1d107822/payload-pre-processing/0.log"