Jul 27 18:29:23.577512 ip-10-0-140-183 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 18:29:23.577525 ip-10-0-140-183 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 18:29:23.577532 ip-10-0-140-183 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 18:29:23.577790 ip-10-0-140-183 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 18:29:33.755339 ip-10-0-140-183 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 18:29:33.755356 ip-10-0-140-183 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0333e76f1baf4f49b2ace5ccab267766 --
Jul 27 18:31:15.121076 ip-10-0-140-183 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 18:31:15.563499 ip-10-0-140-183 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:31:15.563499 ip-10-0-140-183 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 18:31:15.563499 ip-10-0-140-183 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:31:15.563499 ip-10-0-140-183 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 18:31:15.563499 ip-10-0-140-183 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:31:15.566182 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.566093    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 18:31:15.570992 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.570971    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:15.570992 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.570991    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:15.570992 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.570995    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571001    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571005    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571009    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571012    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571015    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571018    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571021    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571023    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571026    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571029    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571031    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571034    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571037    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571039    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571042    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571050    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571052    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571055    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571057    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:15.571090 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571060    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571062    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571065    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571067    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571070    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571073    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571075    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571078    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571080    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571082    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571085    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571087    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571090    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571093    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571096    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571099    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571102    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571104    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571108    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571110    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:15.571558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571113    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571116    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571118    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571121    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571123    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571126    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571128    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571130    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571133    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571135    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571137    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571140    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571143    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571145    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571149    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571151    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571154    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571157    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571159    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:15.572061 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571162    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571164    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571166    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571169    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571171    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571174    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571176    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571179    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571181    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571184    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571187    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571191    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571194    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571197    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571199    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571202    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571206    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571209    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571212    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571214    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:15.572560 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571217    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571219    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571223    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571226    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571229    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571231    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571234    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571237    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571240    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571243    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571246    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571248    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571250    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571253    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571255    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571258    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571260    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.571263    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572038    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572046    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:15.573059 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572049    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572054    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572057    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572060    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572063    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572066    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572069    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572072    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572075    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572078    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572081    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572084    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572086    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572089    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572092    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572095    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572097    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572100    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572102    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572108    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:15.573549 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572112    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572116    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572118    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572121    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572124    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572127    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572129    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572132    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572134    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572137    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572139    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572142    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572144    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572147    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572149    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572152    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572155    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572158    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572160    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:15.574062 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572163    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572165    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572168    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572171    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572174    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572176    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572179    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572182    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572185    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572187    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572189    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572192    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572194    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572197    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572200    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572202    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572205    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572207    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572210    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572212    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:15.574519 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572215    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572217    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572219    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572222    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572224    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572226    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572229    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572231    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572234    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572236    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572239    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572242    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572245    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572247    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572250    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572252    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572255    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572257    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572260    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572262    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:15.575023 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572265    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572267    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572270    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572272    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572275    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572278    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572280    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572284    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572286    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572291    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572294    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572296    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572299    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572301    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572304    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572307    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572311    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572314    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572708    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:15.575511 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572713    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572717    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572719    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572722    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572725    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572728    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572730    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572733    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572736    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572755    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572758    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572761    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572764    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572766    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572768    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572771    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572773    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572776    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572779    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572782    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:15.575983 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572785    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572787    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572790    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572792    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572795    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572797    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572800    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572802    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572805    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572807    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572812    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572815    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572821    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572823    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572827    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572830    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572837    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572840    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572843    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:15.576462 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572846    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572849    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572851    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572854    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572857    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572859    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572863    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572866    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572870    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572874    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572878    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572881    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572884    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572886    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572889    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572892    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572894    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572896    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572899    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572902    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:15.576949 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572904    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572906    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572909    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572911    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572913    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572919    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572923    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572925    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572928    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572930    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572933    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572936    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572938    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572941    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572943    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572946    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572949    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572951    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572954    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572956    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:15.577471 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572959    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572961    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572963    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572966    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572968    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572971    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572974    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572977    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572980    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572982    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572985    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572987    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572990    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572992    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572994    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572997    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.572999    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573004    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573006    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573078    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573087    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 18:31:15.577968 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573094    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573099    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573103    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573106    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573110    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573115    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573119    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573122    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573125    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573128    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573131    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573134    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573137    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573140    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573143    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573146    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573150    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573153    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573156    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573159    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573162    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573165    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573169    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 18:31:15.578467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573172    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573175    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573178    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573181    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573183    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573188    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573191    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573195    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573198    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573201    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573204    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573207    2578 flags.go:64] FLAG: --enable-server="true"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573210    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573215    2578 flags.go:64] FLAG: --event-burst="100"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573218    2578 flags.go:64] FLAG: --event-qps="50"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573221    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573224    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573227    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573230    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573233    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573236    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573239    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573242    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573244    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573247    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 18:31:15.579035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573250    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573253    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573256    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573258    2578 flags.go:64] FLAG: --feature-gates=""
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573262    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573265    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573268    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573271    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573273    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573276    2578 flags.go:64] FLAG: --help="false"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573279    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-140-183.ec2.internal"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573282    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573286    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573289    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573293    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573296    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573299    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573302    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573304    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573307    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573310    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573313    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573316    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573319    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 18:31:15.579731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573322    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573325    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573328    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573331    2578 flags.go:64] FLAG: --lock-file=""
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573333    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573336    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573339    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573344    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573347    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573350    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573352    2578 flags.go:64] FLAG: --logging-format="text"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573356    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573359    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573361    2578 flags.go:64] FLAG: --manifest-url=""
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573364    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573368    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573371    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573375    2578 flags.go:64] FLAG: --max-pods="110"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573379    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573382    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573386    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573389    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573392    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573394    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573397    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 18:31:15.580347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573405    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573408    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573411    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573414    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573417    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573423    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573426    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573429    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573432    2578 flags.go:64] FLAG: --port="10250"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573435    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573438    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002999a21f0bc4381"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573441    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573444    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573446    2578 flags.go:64] FLAG: --register-node="true"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573450    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573453    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573456    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573459    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573461    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573465    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573468    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573471    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573473    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573476    2578 flags.go:64] FLAG: --runonce="false"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573479    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 18:31:15.581035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573483    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573486    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573490    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573492    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573495    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573498    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573501    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573504    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573507    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573509    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573512    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573515    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573518    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573521    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573527    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573529    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573532    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573536    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573538    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573541    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573544    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573546    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573549    2578 flags.go:64] FLAG: --v="2"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573553    2578 flags.go:64] FLAG: --version="false"
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573557    2578 flags.go:64] FLAG: --vmodule=""
Jul 27 18:31:15.581644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573561    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.573564    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573695    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573701    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573704    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573707    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573710    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573713    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573717    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573722    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573724    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573727    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573729    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573732    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573735    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573751    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573754    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573757    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573759    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:15.582262 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573762    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573766    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573769    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573771    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573774    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573776    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573779    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573782    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573784    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573787    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573789    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573792    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573794    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573797    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573799    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573802    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573804    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573807    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573809    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573812    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:15.582724 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573814    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573818    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573822    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573825    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573827    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573829    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573832    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573834    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573837    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573840    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573842    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573845    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573847    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573850    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573853    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573856    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573858    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573860    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573863    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573865    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:15.583229 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573868    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573870    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573873    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573875    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573878    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573880    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573882    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573885    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573887    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573890    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573892    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573895    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573897    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573900    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573904    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573906    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573909    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573912    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573914    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573917    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:15.583712 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573919    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573922    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573924    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573927    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573930    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573934    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573937    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573941    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573943    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573946    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573948    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573951    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573954    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573956    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573958    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573961    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573963    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573966    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573969    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:15.584212 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573973    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573976    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.573978    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.574580    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.581687    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.581705    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.582565    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.582577    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582646    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582652    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582655    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582658    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582661    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582664    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582667    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:15.584670 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582670    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582673    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582675    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582678    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582681    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582689    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582692    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582695    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582698    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582700    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582703    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582705    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582708    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582710    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582712    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582715    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582717    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582721    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582723    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582726    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:15.585104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582729    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582731    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582735    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582753    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582756    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582761    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582765    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582768    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582770    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582773    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582775    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582778    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582782    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582785    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582788    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582791    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582794    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582796    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582805    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:15.585588 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582807    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582810    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582812    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582814    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582817    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582820    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582823    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582825    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582828    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582830    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582832    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582834    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582837    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582839    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582842    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582845    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582848    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582850    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582853    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:15.586073 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582857    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582860    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582863    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582866    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582868    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582871    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582874    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582876    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582879    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582881    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582884    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582886    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582888    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582896    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582899    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582901    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582904    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582906    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582909    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582912    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:15.586533 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582914    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582922    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582925    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582927    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582929    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582932    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582934    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582937    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582940    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582943    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582945    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582947    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582950    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.582952    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.582958    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:31:15.587029 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583108    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583113    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583116    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583118    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583121    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583124    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583127    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583129    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583132    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583135    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583137    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583146    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583149    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583151    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583154    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583156    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583158    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583161    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583164    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583167    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:31:15.587391 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583170    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583172    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583175    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583177    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583179    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583182    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583184    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583187    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583189    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583191    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583194    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583196    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583198    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583201    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583203    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583206    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583208    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583211    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583213    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583216    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:31:15.587881 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583218    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583220    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583223    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583225    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583233    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583237    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583241    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583244    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583247    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583250    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583253    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583256    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583258    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583260    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583263    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583265    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583268    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583270    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583273    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583275    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:31:15.588348 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583277    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583280    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583282    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583286    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583289    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583292    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583295    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583297    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583300    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583302    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583305    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583307    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583309    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583312    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583314    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583316    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583319    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583326    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583329    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583331    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:31:15.588982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583333    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583336    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583339    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583341    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583343    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583346    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583348    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583351    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583353    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583355    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583358    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583360    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583362    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583365    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583367    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583370    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583373    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583376    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:31:15.589459 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:15.583378    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:31:15.589933 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.583383    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:31:15.589933 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.583506    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 18:31:15.589933 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.585905    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 18:31:15.589933 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.587301    2578 server.go:1019] "Starting client certificate rotation"
Jul 27 18:31:15.589933 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.587436    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 18:31:15.589933 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.587473    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 18:31:15.590540 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.590525    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 18:31:15.596683 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.596661    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 18:31:15.612603 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.612578    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 27 18:31:15.614917 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.614900    2578 log.go:25] "Validated CRI v1 image API"
Jul 27 18:31:15.616764 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.616723    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 18:31:15.619345 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.619319    2578 fs.go:135] Filesystem UUIDs: map[4f8c0b87-2c9c-4978-b274-726f9742b59b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b3c0e4f4-27d8-4c8f-a821-9fa446149a74:/dev/nvme0n1p3]
Jul 27 18:31:15.619463 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.619343    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 18:31:15.622590 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.622566    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 18:31:15.625065 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.624944    2578 manager.go:216] Machine: {Timestamp:2026-07-27 18:31:15.623327985 +0000 UTC m=+0.376122415 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095988 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239cf3c9eb615ad5244781ae68e5bb SystemUUID:ec239cf3-c9eb-615a-d524-4781ae68e5bb BootID:0333e76f-1baf-4f49-b2ac-e5ccab267766 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7a:5d:1b:31:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7a:5d:1b:31:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:10:c6:71:ce:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 18:31:15.625065 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.625052    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 18:31:15.625256 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.625178    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 18:31:15.629847 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.629806    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 18:31:15.630032 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.629850    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-183.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 18:31:15.630668 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.630654    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 18:31:15.630722 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.630674    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 18:31:15.630722 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.630685    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 18:31:15.631467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.631453    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 18:31:15.632699 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.632685    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 18:31:15.634785 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.634769    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 18:31:15.635118 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635103    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 18:31:15.635194 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635149    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 18:31:15.635194 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635175    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 18:31:15.635283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635197    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 18:31:15.635283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635211    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 27 18:31:15.635283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635227    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 18:31:15.635658 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635642    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 18:31:15.635763 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.635668    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 18:31:15.638814 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.638797    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 18:31:15.640817 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.640804    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 18:31:15.640858 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.640835    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 18:31:15.642517 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642505    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 18:31:15.642551 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642523    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 18:31:15.642551 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642530    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 18:31:15.642551 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642536    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 18:31:15.642551 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642544    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 18:31:15.642551 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642551    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 18:31:15.642689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642559    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 18:31:15.642689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642564    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 18:31:15.642689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642572    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 18:31:15.642689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642578    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 18:31:15.642689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642591    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 18:31:15.642689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.642597    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 18:31:15.643404 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.643389    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 18:31:15.643471 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.643408    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 18:31:15.646914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.646901    2578 server.go:1268] "Started kubelet"
Jul 27 18:31:15.647172 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.647003    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 18:31:15.647283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.647266    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 18:31:15.647834 ip-10-0-140-183 systemd[1]: Started Kubernetes Kubelet.
Jul 27 18:31:15.651867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.647825    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 18:31:15.652161 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.652144    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 18:31:15.655118 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.655103    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 18:31:15.657576 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.657557    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 18:31:15.659083 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.659063    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 18:31:15.659269 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.659255    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 18:31:15.659455 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.659442    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-183.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 18:31:15.659546 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.658629    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c639178f1a34bd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.646870717 +0000 UTC m=+0.399665129,LastTimestamp:2026-07-27 18:31:15.646870717 +0000 UTC m=+0.399665129,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.662202 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.662189    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 18:31:15.662270 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.662200    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 18:31:15.662368 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.662320    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:15.662764 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.662730    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 18:31:15.662843 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.662815    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 18:31:15.662843 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.662831    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 18:31:15.662976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.662957    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 18:31:15.662976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.662970    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 18:31:15.663117 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663005    2578 factory.go:55] Registering systemd factory
Jul 27 18:31:15.663117 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663025    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 27 18:31:15.663313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663294    2578 factory.go:153] Registering CRI-O factory
Jul 27 18:31:15.663313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663316    2578 factory.go:223] Registration of the crio container factory successfully
Jul 27 18:31:15.663450 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663367    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 18:31:15.663450 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663392    2578 factory.go:103] Registering Raw factory
Jul 27 18:31:15.663450 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663403    2578 manager.go:1196] Started watching for new ooms in manager
Jul 27 18:31:15.663774 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.663763    2578 manager.go:349] Starting recovery of all containers
Jul 27 18:31:15.670384 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.670353    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 18:31:15.670482 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.670383    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 18:31:15.674757 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.674549    2578 manager.go:354] Recovery completed
Jul 27 18:31:15.676163 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.676143    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 27 18:31:15.680428 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.680415    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:15.683601 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.683577    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:15.683654 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.683610    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:15.683654 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.683623    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:15.684156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.684139    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 18:31:15.684156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.684149    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:15.684156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.684155    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 18:31:15.684316 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.684173    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 18:31:15.684939 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.684922    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:15.685019 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.684955    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:15.685019 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.684971    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:15.686003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.685990    2578 policy_none.go:49] "None policy: Start"
Jul 27 18:31:15.686046 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.686007    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 18:31:15.686046 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.686017    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 18:31:15.687326 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.687314    2578 policy_none.go:47] "Start"
Jul 27 18:31:15.689567 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.689487    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c63917914a936b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-183.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.683595115 +0000 UTC m=+0.436389526,LastTimestamp:2026-07-27 18:31:15.683595115 +0000 UTC m=+0.436389526,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.699849 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.699780    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c63917914aeb42  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-183.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.683617602 +0000 UTC m=+0.436412014,LastTimestamp:2026-07-27 18:31:15.683617602 +0000 UTC m=+0.436412014,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.711456 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.711378    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c63917914b1111  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-183.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.683627281 +0000 UTC m=+0.436421692,LastTimestamp:2026-07-27 18:31:15.683627281 +0000 UTC m=+0.436421692,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.724989 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.724903    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-183.ec2.internal.18c63917914a936b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c63917914a936b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-183.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.683595115 +0000 UTC m=+0.436389526,LastTimestamp:2026-07-27 18:31:15.68493867 +0000 UTC m=+0.437733084,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.735342 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.735326    2578 manager.go:337] "Starting Device Plugin manager"
Jul 27 18:31:15.735431 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.735363    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 18:31:15.735431 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.735373    2578 server.go:87] "Starting device plugin registration server"
Jul 27 18:31:15.735675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.735661    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 18:31:15.735754 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.735679    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 18:31:15.735816 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.735788    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 18:31:15.735895 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.735879    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 18:31:15.735957 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.735896    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 18:31:15.736473 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.736453    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 18:31:15.736544 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.736510    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:15.740809 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.740720    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-183.ec2.internal.18c63917914aeb42\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c63917914aeb42  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-183.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.683617602 +0000 UTC m=+0.436412014,LastTimestamp:2026-07-27 18:31:15.684962368 +0000 UTC m=+0.437756780,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.756179 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.756107    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-183.ec2.internal.18c63917914b1111\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c63917914b1111  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-183.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.683627281 +0000 UTC m=+0.436421692,LastTimestamp:2026-07-27 18:31:15.684976287 +0000 UTC m=+0.437770704,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.769456 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.757104    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ff5px"
Jul 27 18:31:15.770334 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.770271    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-183.ec2.internal.18c639179542a782  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-183.ec2.internal,UID:ip-10-0-140-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-140-183.ec2.internal,},FirstTimestamp:2026-07-27 18:31:15.750184834 +0000 UTC m=+0.502979232,LastTimestamp:2026-07-27 18:31:15.750184834 +0000 UTC m=+0.502979232,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-183.ec2.internal,}"
Jul 27 18:31:15.773444 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.773426    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ff5px"
Jul 27 18:31:15.835925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.835849    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:15.837123 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.837102    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:15.837270 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.837134    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:15.837270 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.837145    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:15.837270 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.837170    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-183.ec2.internal"
Jul 27 18:31:15.837799 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.837773    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 18:31:15.839246 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.839223    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 18:31:15.839321 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.839262    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 18:31:15.839321 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.839283    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 18:31:15.839403 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.839322    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 18:31:15.846819 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.846801    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:15.856874 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.856852    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-183.ec2.internal"
Jul 27 18:31:15.856967 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.856882    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-183.ec2.internal\": node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:15.894886 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.894852    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:15.940673 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.940016    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal"]
Jul 27 18:31:15.940867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.940730    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:15.941789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.941769    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:15.941916 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.941805    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:15.941916 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.941819    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:15.943455 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.943438    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:15.943584 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.943569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:15.943629 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.943600    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:15.944260 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.944244    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:15.944260 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.944253    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:15.944406 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.944274    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:15.944406 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.944275    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:15.944406 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.944300    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:15.944406 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.944286    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:15.945780 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.945763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:15.945826 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.945804    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:15.946540 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.946523    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:15.946619 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.946548    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:15.946619 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:15.946562    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:15.969432 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.969409    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-183.ec2.internal\" not found" node="ip-10-0-140-183.ec2.internal"
Jul 27 18:31:15.973715 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.973699    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-183.ec2.internal\" not found" node="ip-10-0-140-183.ec2.internal"
Jul 27 18:31:15.995367 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:15.995343    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.064661 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.064629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c2aee42ab16174e97d7f543ff47ec8b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal\" (UID: \"7c2aee42ab16174e97d7f543ff47ec8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.064661 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.064658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c2aee42ab16174e97d7f543ff47ec8b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal\" (UID: \"7c2aee42ab16174e97d7f543ff47ec8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.064851 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.064685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/599976f5344e0a57673ed671b42428c7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-183.ec2.internal\" (UID: \"599976f5344e0a57673ed671b42428c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.096510 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.096446    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.165017 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.164974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/599976f5344e0a57673ed671b42428c7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-183.ec2.internal\" (UID: \"599976f5344e0a57673ed671b42428c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.165017 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.165019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c2aee42ab16174e97d7f543ff47ec8b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal\" (UID: \"7c2aee42ab16174e97d7f543ff47ec8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.165146 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.165035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c2aee42ab16174e97d7f543ff47ec8b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal\" (UID: \"7c2aee42ab16174e97d7f543ff47ec8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.165146 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.165078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c2aee42ab16174e97d7f543ff47ec8b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal\" (UID: \"7c2aee42ab16174e97d7f543ff47ec8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.165146 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.165091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/599976f5344e0a57673ed671b42428c7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-183.ec2.internal\" (UID: \"599976f5344e0a57673ed671b42428c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.165146 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.165136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c2aee42ab16174e97d7f543ff47ec8b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal\" (UID: \"7c2aee42ab16174e97d7f543ff47ec8b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.197132 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.197097    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.272614 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.272586    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.277880 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.277859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:16.297944 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.297909    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.398522 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.398426    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.498976 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.498951    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.586471 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.586447    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 18:31:16.587054 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.586623    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 18:31:16.599706 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.599681    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.700858 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.700787    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.777537 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.777493    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 18:26:15 +0000 UTC" deadline="2028-01-08 14:59:26.836406943 +0000 UTC"
Jul 27 18:31:16.777537 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.777533    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12716h28m10.058877145s"
Jul 27 18:31:16.801672 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.801642    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:16.819104 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:16.819061    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599976f5344e0a57673ed671b42428c7.slice/crio-d063d69383a8bc359c05a9dd6dd7528e0237c9a55fad561fbe1a4c381e06719e WatchSource:0}: Error finding container d063d69383a8bc359c05a9dd6dd7528e0237c9a55fad561fbe1a4c381e06719e: Status 404 returned error can't find the container with id d063d69383a8bc359c05a9dd6dd7528e0237c9a55fad561fbe1a4c381e06719e
Jul 27 18:31:16.826260 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.826241    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:31:16.842259 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.842234    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:31:16.842362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.842273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal" event={"ID":"7c2aee42ab16174e97d7f543ff47ec8b","Type":"ContainerStarted","Data":"853008a24371c17879c1535ac1d2167c3ad0bc68fdd8b011f17a18bb455db53d"}
Jul 27 18:31:16.843241 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.843211    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:31:16.843241 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.843242    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:31:16.843385 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.843255    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:31:16.843491 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:16.843470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal" event={"ID":"599976f5344e0a57673ed671b42428c7","Type":"ContainerStarted","Data":"d063d69383a8bc359c05a9dd6dd7528e0237c9a55fad561fbe1a4c381e06719e"}
Jul 27 18:31:16.902462 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:16.902414    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:17.003649 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.003624    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-183.ec2.internal\" not found"
Jul 27 18:31:17.055868 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.055831    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:17.079383 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.079360    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:17.144166 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.144141    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:17.162864 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.162837    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:17.174755 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.174731    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 18:31:17.176545 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.176531    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal"
Jul 27 18:31:17.191034 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.191010    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 18:31:17.636192 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.636154    2578 apiserver.go:52] "Watching apiserver"
Jul 27 18:31:17.645387 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.645359    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 18:31:17.646747 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.646718    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal","openshift-multus/multus-additional-cni-plugins-rm94j","openshift-network-diagnostics/network-check-target-mhdbk","openshift-network-operator/iptables-alerter-4fnj9","openshift-ovn-kubernetes/ovnkube-node-ch7hz","kube-system/global-pull-secret-syncer-tz4mt","kube-system/konnectivity-agent-6x5c9","kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp","openshift-cluster-node-tuning-operator/tuned-88gm4","openshift-image-registry/node-ca-l6m7b","openshift-multus/multus-94l5z","openshift-multus/network-metrics-daemon-blpjc","openshift-dns/node-resolver-rmw5t"]
Jul 27 18:31:17.648663 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.648643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:17.648804 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.648743    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:17.650066 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.650048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.651818 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.651766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.653292 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.653270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.654443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.654422    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7r7qn\""
Jul 27 18:31:17.654719 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.654691    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 18:31:17.655063 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.655042    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.655788 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.655675    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:31:17.656747 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.656728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.656864 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.656803    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:17.658526 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.658362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.660287 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.660265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.660911    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661005    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.660910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661253    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661381    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661505    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661633    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661740    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661966    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.661974    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.662248    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.662475    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8b957\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.662635    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.662729    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.663080    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.663117    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8jjp2\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.663334    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 18:31:17.663594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.663351    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 18:31:17.664347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.664156    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 18:31:17.664441 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.664421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.664582 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.664565    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xdwfh\""
Jul 27 18:31:17.665026 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.665006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.665196 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.665177    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:31:17.666128 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.666106    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jh7mt\""
Jul 27 18:31:17.666350 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.666180    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 18:31:17.666572 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.666542    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jwjqh\""
Jul 27 18:31:17.667944 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.667504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:17.667944 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.667489    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 18:31:17.667944 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.667623    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:17.669978 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.669524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.670973 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.670948    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 18:31:17.671078 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.670983    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 18:31:17.671078 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.671064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 18:31:17.671199 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.671105    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n7qqs\""
Jul 27 18:31:17.671288 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.671268    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 18:31:17.671402 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.671359    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99mjx\""
Jul 27 18:31:17.673675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.673774 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2dh\" (UniqueName: \"kubernetes.io/projected/bb04b79a-b40e-442e-a47b-305589da104b-kube-api-access-jt2dh\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.673774 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-hostroot\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.673774 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysconfig\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.673942 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea3a9c24-b881-49e5-9433-d44e6c0908f2-tmp\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.673942 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.673942 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-lib-modules\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.674094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-os-release\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.674094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-cni-binary-copy\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.674094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.673987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.674094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674022    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-multus-certs\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.674094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-slash\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.674094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-ovn\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.674094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-cni-netd\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de4b30cd-714b-41c3-b773-df50158ef8b0-dbus\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-sys\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-var-lib-kubelet\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-cni-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-kubelet\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-cni-bin\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-systemd\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-cnibin\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-cni-multus\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebe6b053-7791-4bf6-8067-1d169d968158-iptables-alerter-script\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-etc-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-modprobe-d\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5srb\" (UniqueName: \"kubernetes.io/projected/9c7f4a92-e49c-4746-9c75-456db03d8e80-kube-api-access-p5srb\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:17.674467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-kubernetes\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-etc-kubernetes\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-systemd-units\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-run-netns\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-systemd\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysctl-d\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-tuned\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8kms\" (UniqueName: \"kubernetes.io/projected/ea3a9c24-b881-49e5-9433-d44e6c0908f2-kube-api-access-x8kms\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztw8m\" (UniqueName: \"kubernetes.io/projected/ebe6b053-7791-4bf6-8067-1d169d968158-kube-api-access-ztw8m\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-var-lib-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-run-ovn-kubernetes\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-ovnkube-config\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-ovnkube-script-lib\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-host\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-system-cni-dir\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.675319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-conf-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-cni-bin\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysctl-conf\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.674992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/661a9910-3e3e-4f30-98e9-94af99114f60-agent-certs\") pod \"konnectivity-agent-6x5c9\" (UID: \"661a9910-3e3e-4f30-98e9-94af99114f60\") " pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb04b79a-b40e-442e-a47b-305589da104b-host\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-socket-dir-parent\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-k8s-cni-cncf-io\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-env-overrides\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/661a9910-3e3e-4f30-98e9-94af99114f60-konnectivity-ca\") pod \"konnectivity-agent-6x5c9\" (UID: \"661a9910-3e3e-4f30-98e9-94af99114f60\") " pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb04b79a-b40e-442e-a47b-305589da104b-serviceca\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8357e81-06b2-4de5-ab63-c892670eb034-cni-binary-copy\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-kubelet\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-log-socket\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.676210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b95b710e-6a47-4555-8a19-52cd56325a37-ovn-node-metrics-cert\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675348    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-netns\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-node-log\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-os-release\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2cj\" (UniqueName: \"kubernetes.io/projected/b95b710e-6a47-4555-8a19-52cd56325a37-kube-api-access-tt2cj\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de4b30cd-714b-41c3-b773-df50158ef8b0-kubelet-config\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-run\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpph4\" (UniqueName: \"kubernetes.io/projected/807f44ba-5281-44a2-921c-d06b877c20aa-kube-api-access-xpph4\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-system-cni-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-cnibin\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqjbd\" (UniqueName: \"kubernetes.io/projected/d8357e81-06b2-4de5-ab63-c892670eb034-kube-api-access-cqjbd\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.677075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebe6b053-7791-4bf6-8067-1d169d968158-host-slash\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.677969 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9gz\" (UniqueName: \"kubernetes.io/projected/2cf845a2-262b-48ee-9bac-2211c75c10f0-kube-api-access-jz9gz\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:17.677969 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8357e81-06b2-4de5-ab63-c892670eb034-multus-daemon-config\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.677969 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.675920    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 18:31:17.677969 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.676125    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hz5m7\""
Jul 27 18:31:17.681683 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.681661    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 18:31:17.719468 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.719443    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2krnn"
Jul 27 18:31:17.730530 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.730505    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2krnn"
Jul 27 18:31:17.764436 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.764411    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 18:31:17.776036 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-log-socket\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776036 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b95b710e-6a47-4555-8a19-52cd56325a37-ovn-node-metrics-cert\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-log-socket\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-netns\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-netns\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-node-log\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.776321    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776334    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-node-log\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-os-release\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.776411    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:18.276364545 +0000 UTC m=+3.029158962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2cj\" (UniqueName: \"kubernetes.io/projected/b95b710e-6a47-4555-8a19-52cd56325a37-kube-api-access-tt2cj\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-os-release\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de4b30cd-714b-41c3-b773-df50158ef8b0-kubelet-config\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776483    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-run\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-run\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de4b30cd-714b-41c3-b773-df50158ef8b0-kubelet-config\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/830bcb19-c11b-4ee5-937f-a73e2a9dd471-hosts-file\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpph4\" (UniqueName: \"kubernetes.io/projected/807f44ba-5281-44a2-921c-d06b877c20aa-kube-api-access-xpph4\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-system-cni-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-cnibin\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqjbd\" (UniqueName: \"kubernetes.io/projected/d8357e81-06b2-4de5-ab63-c892670eb034-kube-api-access-cqjbd\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.776938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebe6b053-7791-4bf6-8067-1d169d968158-host-slash\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-system-cni-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-cnibin\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9gz\" (UniqueName: \"kubernetes.io/projected/2cf845a2-262b-48ee-9bac-2211c75c10f0-kube-api-access-jz9gz\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebe6b053-7791-4bf6-8067-1d169d968158-host-slash\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8357e81-06b2-4de5-ab63-c892670eb034-multus-daemon-config\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2dh\" (UniqueName: \"kubernetes.io/projected/bb04b79a-b40e-442e-a47b-305589da104b-kube-api-access-jt2dh\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-hostroot\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.776982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysconfig\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea3a9c24-b881-49e5-9433-d44e6c0908f2-tmp\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/830bcb19-c11b-4ee5-937f-a73e2a9dd471-tmp-dir\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-hostroot\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-lib-modules\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-os-release\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.777904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-cni-binary-copy\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-multus-certs\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-lib-modules\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-slash\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-ovn\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-cni-netd\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de4b30cd-714b-41c3-b773-df50158ef8b0-dbus\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-sys\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-var-lib-kubelet\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-cni-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-kubelet\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8357e81-06b2-4de5-ab63-c892670eb034-multus-daemon-config\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-kubelet\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysconfig\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-cni-netd\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de4b30cd-714b-41c3-b773-df50158ef8b0-dbus\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.778756 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/807f44ba-5281-44a2-921c-d06b877c20aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-os-release\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-sys\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-ovn\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-var-lib-kubelet\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777746    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-multus-certs\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-cni-bin\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-cni-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-systemd\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-slash\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-cni-bin\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-cnibin\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-systemd\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-cnibin\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.777993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-cni-multus\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-cni-multus\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.779648 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-cni-binary-copy\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebe6b053-7791-4bf6-8067-1d169d968158-iptables-alerter-script\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-etc-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-modprobe-d\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5srb\" (UniqueName: \"kubernetes.io/projected/9c7f4a92-e49c-4746-9c75-456db03d8e80-kube-api-access-p5srb\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-kubernetes\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-etc-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-modprobe-d\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4sq9\" (UniqueName: \"kubernetes.io/projected/830bcb19-c11b-4ee5-937f-a73e2a9dd471-kube-api-access-h4sq9\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-etc-kubernetes\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-kubernetes\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-systemd-units\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-run-netns\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-systemd\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysctl-d\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.780578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-tuned\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8kms\" (UniqueName: \"kubernetes.io/projected/ea3a9c24-b881-49e5-9433-d44e6c0908f2-kube-api-access-x8kms\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztw8m\" (UniqueName: \"kubernetes.io/projected/ebe6b053-7791-4bf6-8067-1d169d968158-kube-api-access-ztw8m\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebe6b053-7791-4bf6-8067-1d169d968158-iptables-alerter-script\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-run-systemd\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-etc-kubernetes\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-systemd-units\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-run-netns\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.778939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-var-lib-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-run-ovn-kubernetes\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysctl-d\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-ovnkube-config\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-var-lib-openvswitch\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-ovnkube-script-lib\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-host\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-system-cni-dir\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.781504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-conf-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-cni-bin\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-host\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-run-ovn-kubernetes\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysctl-conf\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/661a9910-3e3e-4f30-98e9-94af99114f60-agent-certs\") pod \"konnectivity-agent-6x5c9\" (UID: \"661a9910-3e3e-4f30-98e9-94af99114f60\") " pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.779341    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb04b79a-b40e-442e-a47b-305589da104b-host\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.779394    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret podName:de4b30cd-714b-41c3-b773-df50158ef8b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:18.279374531 +0000 UTC m=+3.032168935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret") pod "global-pull-secret-syncer-tz4mt" (UID: "de4b30cd-714b-41c3-b773-df50158ef8b0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb04b79a-b40e-442e-a47b-305589da104b-host\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-socket-dir-parent\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-k8s-cni-cncf-io\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-env-overrides\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/661a9910-3e3e-4f30-98e9-94af99114f60-konnectivity-ca\") pod \"konnectivity-agent-6x5c9\" (UID: \"661a9910-3e3e-4f30-98e9-94af99114f60\") " pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-sysctl-conf\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.782318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb04b79a-b40e-442e-a47b-305589da104b-serviceca\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8357e81-06b2-4de5-ab63-c892670eb034-cni-binary-copy\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-kubelet\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-ovnkube-config\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b95b710e-6a47-4555-8a19-52cd56325a37-host-kubelet\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779729    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-socket-dir-parent\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-run-k8s-cni-cncf-io\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-system-cni-dir\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.779994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c7f4a92-e49c-4746-9c75-456db03d8e80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.780310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c7f4a92-e49c-4746-9c75-456db03d8e80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.780372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-multus-conf-dir\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.780430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8357e81-06b2-4de5-ab63-c892670eb034-host-var-lib-cni-bin\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.780560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb04b79a-b40e-442e-a47b-305589da104b-serviceca\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.781092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8357e81-06b2-4de5-ab63-c892670eb034-cni-binary-copy\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.781116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-ovnkube-script-lib\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.781234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/661a9910-3e3e-4f30-98e9-94af99114f60-konnectivity-ca\") pod \"konnectivity-agent-6x5c9\" (UID: \"661a9910-3e3e-4f30-98e9-94af99114f60\") " pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.781400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea3a9c24-b881-49e5-9433-d44e6c0908f2-tmp\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.783223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.781422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b95b710e-6a47-4555-8a19-52cd56325a37-env-overrides\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.784195 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.781703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b95b710e-6a47-4555-8a19-52cd56325a37-ovn-node-metrics-cert\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.784195 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.782027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea3a9c24-b881-49e5-9433-d44e6c0908f2-etc-tuned\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.784195 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.782586    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/661a9910-3e3e-4f30-98e9-94af99114f60-agent-certs\") pod \"konnectivity-agent-6x5c9\" (UID: \"661a9910-3e3e-4f30-98e9-94af99114f60\") " pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.789961 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.789933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2cj\" (UniqueName: \"kubernetes.io/projected/b95b710e-6a47-4555-8a19-52cd56325a37-kube-api-access-tt2cj\") pod \"ovnkube-node-ch7hz\" (UID: \"b95b710e-6a47-4555-8a19-52cd56325a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:17.790592 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.790570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpph4\" (UniqueName: \"kubernetes.io/projected/807f44ba-5281-44a2-921c-d06b877c20aa-kube-api-access-xpph4\") pod \"aws-ebs-csi-driver-node-vb2mp\" (UID: \"807f44ba-5281-44a2-921c-d06b877c20aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:17.792015 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.791989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqjbd\" (UniqueName: \"kubernetes.io/projected/d8357e81-06b2-4de5-ab63-c892670eb034-kube-api-access-cqjbd\") pod \"multus-94l5z\" (UID: \"d8357e81-06b2-4de5-ab63-c892670eb034\") " pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.792728 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.792703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2dh\" (UniqueName: \"kubernetes.io/projected/bb04b79a-b40e-442e-a47b-305589da104b-kube-api-access-jt2dh\") pod \"node-ca-l6m7b\" (UID: \"bb04b79a-b40e-442e-a47b-305589da104b\") " pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:17.797754 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.797729    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:17.797871 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.797779    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:17.797871 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.797795    2578 projected.go:196] Error preparing data for projected volume kube-api-access-chw7f for pod openshift-network-diagnostics/network-check-target-mhdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:17.798063 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:17.798021    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f podName:fd06c8e0-abb3-4cc3-86e6-3dfa60672e34 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:18.297858465 +0000 UTC m=+3.050652878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-chw7f" (UniqueName: "kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f") pod "network-check-target-mhdbk" (UID: "fd06c8e0-abb3-4cc3-86e6-3dfa60672e34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:17.799914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.799859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8kms\" (UniqueName: \"kubernetes.io/projected/ea3a9c24-b881-49e5-9433-d44e6c0908f2-kube-api-access-x8kms\") pod \"tuned-88gm4\" (UID: \"ea3a9c24-b881-49e5-9433-d44e6c0908f2\") " pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:17.801178 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.801150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9gz\" (UniqueName: \"kubernetes.io/projected/2cf845a2-262b-48ee-9bac-2211c75c10f0-kube-api-access-jz9gz\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:17.801443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.801420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztw8m\" (UniqueName: \"kubernetes.io/projected/ebe6b053-7791-4bf6-8067-1d169d968158-kube-api-access-ztw8m\") pod \"iptables-alerter-4fnj9\" (UID: \"ebe6b053-7791-4bf6-8067-1d169d968158\") " pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.802445 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.802419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5srb\" (UniqueName: \"kubernetes.io/projected/9c7f4a92-e49c-4746-9c75-456db03d8e80-kube-api-access-p5srb\") pod \"multus-additional-cni-plugins-rm94j\" (UID: \"9c7f4a92-e49c-4746-9c75-456db03d8e80\") " pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.880580 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.880546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4sq9\" (UniqueName: \"kubernetes.io/projected/830bcb19-c11b-4ee5-937f-a73e2a9dd471-kube-api-access-h4sq9\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.880819 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.880639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/830bcb19-c11b-4ee5-937f-a73e2a9dd471-hosts-file\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.880819 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.880673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/830bcb19-c11b-4ee5-937f-a73e2a9dd471-tmp-dir\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.880960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.880868    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/830bcb19-c11b-4ee5-937f-a73e2a9dd471-hosts-file\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.881050 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.881031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/830bcb19-c11b-4ee5-937f-a73e2a9dd471-tmp-dir\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.891649 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.891583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4sq9\" (UniqueName: \"kubernetes.io/projected/830bcb19-c11b-4ee5-937f-a73e2a9dd471-kube-api-access-h4sq9\") pod \"node-resolver-rmw5t\" (UID: \"830bcb19-c11b-4ee5-937f-a73e2a9dd471\") " pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:17.963865 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.963826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4fnj9"
Jul 27 18:31:17.972684 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.972659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:17.984388 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.984362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94l5z"
Jul 27 18:31:17.989554 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.989530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rm94j"
Jul 27 18:31:17.995868 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:17.995843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:18.003672 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.003643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp"
Jul 27 18:31:18.011901 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.011866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-88gm4"
Jul 27 18:31:18.019867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.019844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6m7b"
Jul 27 18:31:18.024722 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.024701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rmw5t"
Jul 27 18:31:18.083712 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.083678    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:31:18.283100 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.283014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:18.283100 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.283066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:18.283341 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.283182    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:18.283341 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.283211    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:18.283341 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.283259    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:19.283241029 +0000 UTC m=+4.036035428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:18.283341 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.283277    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret podName:de4b30cd-714b-41c3-b773-df50158ef8b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:19.283267396 +0000 UTC m=+4.036061796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret") pod "global-pull-secret-syncer-tz4mt" (UID: "de4b30cd-714b-41c3-b773-df50158ef8b0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:18.383975 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.383929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:18.384200 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.384166    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:18.384200 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.384199    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:18.384371 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.384211    2578 projected.go:196] Error preparing data for projected volume kube-api-access-chw7f for pod openshift-network-diagnostics/network-check-target-mhdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:18.384371 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.384288    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f podName:fd06c8e0-abb3-4cc3-86e6-3dfa60672e34 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:19.384264238 +0000 UTC m=+4.137058663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-chw7f" (UniqueName: "kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f") pod "network-check-target-mhdbk" (UID: "fd06c8e0-abb3-4cc3-86e6-3dfa60672e34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:18.480558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:18.480526    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7f4a92_e49c_4746_9c75_456db03d8e80.slice/crio-cf05368c17e3098c5192bae13623f1018d8d4526bff0b5cba3276104a449556e WatchSource:0}: Error finding container cf05368c17e3098c5192bae13623f1018d8d4526bff0b5cba3276104a449556e: Status 404 returned error can't find the container with id cf05368c17e3098c5192bae13623f1018d8d4526bff0b5cba3276104a449556e
Jul 27 18:31:18.495294 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:18.495266    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod661a9910_3e3e_4f30_98e9_94af99114f60.slice/crio-e1cd38a0c9ceb24f36a7cd6354ffcd5b77755d4f4158c636ba2a27d89db09e4c WatchSource:0}: Error finding container e1cd38a0c9ceb24f36a7cd6354ffcd5b77755d4f4158c636ba2a27d89db09e4c: Status 404 returned error can't find the container with id e1cd38a0c9ceb24f36a7cd6354ffcd5b77755d4f4158c636ba2a27d89db09e4c
Jul 27 18:31:18.496303 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:18.496279    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe6b053_7791_4bf6_8067_1d169d968158.slice/crio-1a963e6e45b429e39a5c1ed5d4a513e187a87ee2dca6659f18ccf8221d99504c WatchSource:0}: Error finding container 1a963e6e45b429e39a5c1ed5d4a513e187a87ee2dca6659f18ccf8221d99504c: Status 404 returned error can't find the container with id 1a963e6e45b429e39a5c1ed5d4a513e187a87ee2dca6659f18ccf8221d99504c
Jul 27 18:31:18.497169 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:18.497127    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3a9c24_b881_49e5_9433_d44e6c0908f2.slice/crio-7c126c9e8a82c8e15aa1243abf58dc084e9463ed99f17579ad9cc6fbebc10cf1 WatchSource:0}: Error finding container 7c126c9e8a82c8e15aa1243abf58dc084e9463ed99f17579ad9cc6fbebc10cf1: Status 404 returned error can't find the container with id 7c126c9e8a82c8e15aa1243abf58dc084e9463ed99f17579ad9cc6fbebc10cf1
Jul 27 18:31:18.498273 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:18.498155    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95b710e_6a47_4555_8a19_52cd56325a37.slice/crio-69971b5d593c4f512bb20902ddc18637237d7b363bd282042bdd049b04eb53cc WatchSource:0}: Error finding container 69971b5d593c4f512bb20902ddc18637237d7b363bd282042bdd049b04eb53cc: Status 404 returned error can't find the container with id 69971b5d593c4f512bb20902ddc18637237d7b363bd282042bdd049b04eb53cc
Jul 27 18:31:18.499973 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:18.499896    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830bcb19_c11b_4ee5_937f_a73e2a9dd471.slice/crio-4c96bc0b3966c5a1d0301bee2d0599bf485681af2e67f79f2525d662cea290b6 WatchSource:0}: Error finding container 4c96bc0b3966c5a1d0301bee2d0599bf485681af2e67f79f2525d662cea290b6: Status 404 returned error can't find the container with id 4c96bc0b3966c5a1d0301bee2d0599bf485681af2e67f79f2525d662cea290b6
Jul 27 18:31:18.500708 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:18.500687    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807f44ba_5281_44a2_921c_d06b877c20aa.slice/crio-84251ed79f5cd211f196b633b2dbbc16b5ba95d44184ea82c80e9887a3f303bc WatchSource:0}: Error finding container 84251ed79f5cd211f196b633b2dbbc16b5ba95d44184ea82c80e9887a3f303bc: Status 404 returned error can't find the container with id 84251ed79f5cd211f196b633b2dbbc16b5ba95d44184ea82c80e9887a3f303bc
Jul 27 18:31:18.732704 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.732595    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 18:26:17 +0000 UTC" deadline="2028-02-26 20:15:55.70781538 +0000 UTC"
Jul 27 18:31:18.732704 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.732652    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13897h44m36.975166745s"
Jul 27 18:31:18.840580 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.840501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:18.840723 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:18.840620    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:18.849995 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.849951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp" event={"ID":"807f44ba-5281-44a2-921c-d06b877c20aa","Type":"ContainerStarted","Data":"84251ed79f5cd211f196b633b2dbbc16b5ba95d44184ea82c80e9887a3f303bc"}
Jul 27 18:31:18.851243 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.851180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rmw5t" event={"ID":"830bcb19-c11b-4ee5-937f-a73e2a9dd471","Type":"ContainerStarted","Data":"4c96bc0b3966c5a1d0301bee2d0599bf485681af2e67f79f2525d662cea290b6"}
Jul 27 18:31:18.852575 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.852551    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6m7b" event={"ID":"bb04b79a-b40e-442e-a47b-305589da104b","Type":"ContainerStarted","Data":"4714e29b189ba0301162936044501994bc131561eb0802aba2aff09452159d2a"}
Jul 27 18:31:18.853820 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.853784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"69971b5d593c4f512bb20902ddc18637237d7b363bd282042bdd049b04eb53cc"}
Jul 27 18:31:18.855290 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.855264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88gm4" event={"ID":"ea3a9c24-b881-49e5-9433-d44e6c0908f2","Type":"ContainerStarted","Data":"7c126c9e8a82c8e15aa1243abf58dc084e9463ed99f17579ad9cc6fbebc10cf1"}
Jul 27 18:31:18.858490 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.858456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4fnj9" event={"ID":"ebe6b053-7791-4bf6-8067-1d169d968158","Type":"ContainerStarted","Data":"1a963e6e45b429e39a5c1ed5d4a513e187a87ee2dca6659f18ccf8221d99504c"}
Jul 27 18:31:18.860960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.860934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal" event={"ID":"599976f5344e0a57673ed671b42428c7","Type":"ContainerStarted","Data":"581415d344a916785f109fedbc98024eb3f7b83538c6c879fcce1fc668130f55"}
Jul 27 18:31:18.862326 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.862283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94l5z" event={"ID":"d8357e81-06b2-4de5-ab63-c892670eb034","Type":"ContainerStarted","Data":"410dfcc169a2d66a90a1534756c79925b595a6049ac5fbc2e072efdc1c2f9340"}
Jul 27 18:31:18.864498 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.864451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6x5c9" event={"ID":"661a9910-3e3e-4f30-98e9-94af99114f60","Type":"ContainerStarted","Data":"e1cd38a0c9ceb24f36a7cd6354ffcd5b77755d4f4158c636ba2a27d89db09e4c"}
Jul 27 18:31:18.866199 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.866173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerStarted","Data":"cf05368c17e3098c5192bae13623f1018d8d4526bff0b5cba3276104a449556e"}
Jul 27 18:31:18.877399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:18.877346    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-183.ec2.internal" podStartSLOduration=1.8773283649999999 podStartE2EDuration="1.877328365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:18.876480084 +0000 UTC m=+3.629274505" watchObservedRunningTime="2026-07-27 18:31:18.877328365 +0000 UTC m=+3.630122786"
Jul 27 18:31:19.294094 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:19.294050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:19.294283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:19.294107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:19.294283 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.294207    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:19.294283 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.294250    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:19.294283 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.294283    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret podName:de4b30cd-714b-41c3-b773-df50158ef8b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:21.294263851 +0000 UTC m=+6.047058249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret") pod "global-pull-secret-syncer-tz4mt" (UID: "de4b30cd-714b-41c3-b773-df50158ef8b0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:19.294478 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.294306    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:21.29428953 +0000 UTC m=+6.047083931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:19.395352 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:19.395311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:19.395551 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.395510    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:19.395551 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.395525    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:19.395551 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.395535    2578 projected.go:196] Error preparing data for projected volume kube-api-access-chw7f for pod openshift-network-diagnostics/network-check-target-mhdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:19.395715 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.395579    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f podName:fd06c8e0-abb3-4cc3-86e6-3dfa60672e34 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:21.395567125 +0000 UTC m=+6.148361523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-chw7f" (UniqueName: "kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f") pod "network-check-target-mhdbk" (UID: "fd06c8e0-abb3-4cc3-86e6-3dfa60672e34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:19.733372 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:19.733312    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 18:26:17 +0000 UTC" deadline="2028-04-20 03:32:25.556835584 +0000 UTC"
Jul 27 18:31:19.733372 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:19.733352    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15177h1m5.823488131s"
Jul 27 18:31:19.841181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:19.840665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:19.841181 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.840812    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:19.841181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:19.840849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:19.841181 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:19.840966    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:20.840590 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:20.840504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:20.841146 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:20.840655    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:20.880423 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:20.880378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal" event={"ID":"7c2aee42ab16174e97d7f543ff47ec8b","Type":"ContainerStarted","Data":"6b99fadfa5f8a912e9d457936d72ea057fb17e67cb7dabd15976ac7e254ee415"}
Jul 27 18:31:21.313432 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:21.313347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:21.313432 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:21.313407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:21.313656 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.313545    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:21.313656 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.313605    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:25.313587467 +0000 UTC m=+10.066381868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:21.314029 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.314010    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:21.314126 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.314067    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret podName:de4b30cd-714b-41c3-b773-df50158ef8b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:25.314052954 +0000 UTC m=+10.066847355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret") pod "global-pull-secret-syncer-tz4mt" (UID: "de4b30cd-714b-41c3-b773-df50158ef8b0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:21.413873 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:21.413837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:21.414046 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.414026    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:21.414122 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.414055    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:21.414122 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.414068    2578 projected.go:196] Error preparing data for projected volume kube-api-access-chw7f for pod openshift-network-diagnostics/network-check-target-mhdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:21.414216 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.414131    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f podName:fd06c8e0-abb3-4cc3-86e6-3dfa60672e34 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:25.414110276 +0000 UTC m=+10.166904678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-chw7f" (UniqueName: "kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f") pod "network-check-target-mhdbk" (UID: "fd06c8e0-abb3-4cc3-86e6-3dfa60672e34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:21.842762 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:21.842716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:21.843195 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.842866    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:21.843276 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:21.843236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:21.843350 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:21.843319    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:22.840546 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:22.840486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:22.840779 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:22.840640    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:22.890812 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:22.890773    2578 generic.go:356] "Generic (PLEG): container finished" podID="7c2aee42ab16174e97d7f543ff47ec8b" containerID="6b99fadfa5f8a912e9d457936d72ea057fb17e67cb7dabd15976ac7e254ee415" exitCode=0
Jul 27 18:31:22.891189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:22.890836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal" event={"ID":"7c2aee42ab16174e97d7f543ff47ec8b","Type":"ContainerDied","Data":"6b99fadfa5f8a912e9d457936d72ea057fb17e67cb7dabd15976ac7e254ee415"}
Jul 27 18:31:23.840884 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:23.840840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:23.841045 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:23.840984    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:23.841382 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:23.841326    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:23.841461 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:23.841433    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:24.840134 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:24.840096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:24.840613 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:24.840224    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:25.344901 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:25.344864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:25.345065 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:25.344969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:25.345140 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.345086    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:25.345204 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.345149    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret podName:de4b30cd-714b-41c3-b773-df50158ef8b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:33.345130803 +0000 UTC m=+18.097925208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret") pod "global-pull-secret-syncer-tz4mt" (UID: "de4b30cd-714b-41c3-b773-df50158ef8b0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:25.345265 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.345213    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:25.345265 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.345245    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:33.345233378 +0000 UTC m=+18.098027778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:25.445676 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:25.445639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:25.445892 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.445868    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:25.445892 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.445891    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:25.445999 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.445905    2578 projected.go:196] Error preparing data for projected volume kube-api-access-chw7f for pod openshift-network-diagnostics/network-check-target-mhdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:25.445999 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.445974    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f podName:fd06c8e0-abb3-4cc3-86e6-3dfa60672e34 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:33.445954914 +0000 UTC m=+18.198749326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-chw7f" (UniqueName: "kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f") pod "network-check-target-mhdbk" (UID: "fd06c8e0-abb3-4cc3-86e6-3dfa60672e34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:25.841423 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:25.840862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:25.841423 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:25.840986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:25.841423 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.840994    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:25.842126 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:25.842075    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:26.840227 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:26.840191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:26.840423 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:26.840335    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:27.839940 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:27.839905    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:27.840391 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:27.839949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:27.840391 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:27.840043    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:27.840391 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:27.840188    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:28.840458 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:28.840414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:28.840972 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:28.840583    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:29.839572 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:29.839489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:29.839727 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:29.839489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:29.839727 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:29.839625    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:29.839727 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:29.839682    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:30.839484 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:30.839453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:30.839940 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:30.839583    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:31.840252 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:31.840214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:31.840690 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:31.840354    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:31.840690 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:31.840406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:31.840690 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:31.840515    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:32.839731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:32.839692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:32.839995 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:32.839853    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:33.410397 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:33.410364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:33.410397 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:33.410408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:33.410860 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.410521    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:33.410860 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.410521    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:33.410860 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.410585    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:49.410569227 +0000 UTC m=+34.163363625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:33.410860 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.410599    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret podName:de4b30cd-714b-41c3-b773-df50158ef8b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:49.410593267 +0000 UTC m=+34.163387665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret") pod "global-pull-secret-syncer-tz4mt" (UID: "de4b30cd-714b-41c3-b773-df50158ef8b0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:33.510963 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:33.510920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:33.511143 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.511107    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:33.511143 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.511134    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:33.511265 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.511150    2578 projected.go:196] Error preparing data for projected volume kube-api-access-chw7f for pod openshift-network-diagnostics/network-check-target-mhdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:33.511265 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.511210    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f podName:fd06c8e0-abb3-4cc3-86e6-3dfa60672e34 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:49.51118989 +0000 UTC m=+34.263984294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-chw7f" (UniqueName: "kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f") pod "network-check-target-mhdbk" (UID: "fd06c8e0-abb3-4cc3-86e6-3dfa60672e34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:33.839875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:33.839838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:33.839875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:33.839865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:33.840105 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.839971    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:33.840105 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:33.840091    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:34.840099 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:34.840061    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:34.840570 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:34.840201    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:35.840586 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:35.840545    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:35.841035 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:35.840669    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:35.841035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:35.840711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:35.841035 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:35.840830    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:36.840397 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:36.840364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:36.840550 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:36.840491    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:37.839897 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.839555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:37.840811 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.839564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:37.840811 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:37.840000    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:37.840811 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:37.840128    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:37.919665 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.919579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal" event={"ID":"7c2aee42ab16174e97d7f543ff47ec8b","Type":"ContainerStarted","Data":"ee243b3783f5446ddcef2c03bf33693fef678c672d67bd0039e49f512fa5ddda"}
Jul 27 18:31:37.921204 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.921028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp" event={"ID":"807f44ba-5281-44a2-921c-d06b877c20aa","Type":"ContainerStarted","Data":"76ef79e1c0ac1c36af430e9f3fa6d896940d582b2aa0adc928af55d89b731476"}
Jul 27 18:31:37.922675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.922654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rmw5t" event={"ID":"830bcb19-c11b-4ee5-937f-a73e2a9dd471","Type":"ContainerStarted","Data":"5fc74f880a706867ca5613ad965f3da7c46a19314556d638b994a1fe90a6fc1d"}
Jul 27 18:31:37.924264 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.924240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6m7b" event={"ID":"bb04b79a-b40e-442e-a47b-305589da104b","Type":"ContainerStarted","Data":"790e84fe56937ccf2d4c799107a12fa36499b9392426397855981688a5e22a58"}
Jul 27 18:31:37.926637 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.926613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"66a7e9979b2e1c3f20bce1284f610379e4be5bf33a241c8cdd2ab835048da1c0"}
Jul 27 18:31:37.926766 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.926687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"8c893a9f0e16c901dbfc188b7a15a20f303fb611e56bfde12e55943a132351f6"}
Jul 27 18:31:37.926766 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.926735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"45000d856c23d1af2b82847cf6bf257cc27d8aabc154be3a2a2be36613eb14d2"}
Jul 27 18:31:37.926850 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.926786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"ae07ba3f1a73c5a238e39595ed67aee90791a318972da4ef0594de8abab2616f"}
Jul 27 18:31:37.928021 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.927997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-88gm4" event={"ID":"ea3a9c24-b881-49e5-9433-d44e6c0908f2","Type":"ContainerStarted","Data":"d31d6f8358ae6d36d8895cceef5883c4ecbe3cbbcd98126766ccde65dd6976f3"}
Jul 27 18:31:37.929191 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.929171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94l5z" event={"ID":"d8357e81-06b2-4de5-ab63-c892670eb034","Type":"ContainerStarted","Data":"418680816baeb0cbd8601c9f76cc5e987f40456b1c7a73293cae4dd950aee5fb"}
Jul 27 18:31:37.930609 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.930589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6x5c9" event={"ID":"661a9910-3e3e-4f30-98e9-94af99114f60","Type":"ContainerStarted","Data":"bba43930fa82083e30304d0de5c33c348be899ccc2b7e846c624d4b16550e4d3"}
Jul 27 18:31:37.931923 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.931903    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c7f4a92-e49c-4746-9c75-456db03d8e80" containerID="982979bdf7af13398c273132fed953eb4ba913515d893bae4642a682445d2bf6" exitCode=0
Jul 27 18:31:37.932007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.931933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerDied","Data":"982979bdf7af13398c273132fed953eb4ba913515d893bae4642a682445d2bf6"}
Jul 27 18:31:37.939164 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.939124    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-183.ec2.internal" podStartSLOduration=20.939112992 podStartE2EDuration="20.939112992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:37.939086654 +0000 UTC m=+22.691881084" watchObservedRunningTime="2026-07-27 18:31:37.939112992 +0000 UTC m=+22.691907411"
Jul 27 18:31:37.977884 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:37.977847    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l6m7b" podStartSLOduration=3.057152703 podStartE2EDuration="21.977831432s" totalImagesPullingTime="18.920678729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:37.977479208 +0000 UTC m=+22.730273642" watchObservedRunningTime="2026-07-27 18:31:37.977831432 +0000 UTC m=+22.730625851"
Jul 27 18:31:38.023537 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.023492    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-88gm4" podStartSLOduration=3.095203226 podStartE2EDuration="22.023477207s" totalImagesPullingTime="18.928273981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:38.023124682 +0000 UTC m=+22.775919114" watchObservedRunningTime="2026-07-27 18:31:38.023477207 +0000 UTC m=+22.776271626"
Jul 27 18:31:38.023735 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.023715    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rmw5t" podStartSLOduration=3.100743246 podStartE2EDuration="22.023709214s" totalImagesPullingTime="18.922965968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:37.994163931 +0000 UTC m=+22.746958350" watchObservedRunningTime="2026-07-27 18:31:38.023709214 +0000 UTC m=+22.776503670"
Jul 27 18:31:38.055314 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.055266    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-94l5z" podStartSLOduration=3.077535912 podStartE2EDuration="22.055250946s" totalImagesPullingTime="18.977715034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:38.054770349 +0000 UTC m=+22.807564765" watchObservedRunningTime="2026-07-27 18:31:38.055250946 +0000 UTC m=+22.808045364"
Jul 27 18:31:38.098939 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.098878    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6x5c9" podStartSLOduration=7.285335717 podStartE2EDuration="22.098855896s" totalImagesPullingTime="14.813520179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:38.098855288 +0000 UTC m=+22.851649707" watchObservedRunningTime="2026-07-27 18:31:38.098855896 +0000 UTC m=+22.851650317"
Jul 27 18:31:38.839615 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.839534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:38.839817 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:38.839643    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:38.938560 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.938520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"238081cff1ea38dbd5fbbc6f9734a51ea51aa72c277d27cd8af0fda2ddd908c7"}
Jul 27 18:31:38.938966 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.938619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"cbf4c57224548c6e1f5fe51edb4817520fd077d3d013458f8b1767048d61beda"}
Jul 27 18:31:38.940231 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.940197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4fnj9" event={"ID":"ebe6b053-7791-4bf6-8067-1d169d968158","Type":"ContainerStarted","Data":"eb6c891b3957bc2ae9b908be40d820b5a067f6279bd68c0a7605ace623d80d26"}
Jul 27 18:31:38.957691 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:38.957635    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4fnj9" podStartSLOduration=5.035052901 podStartE2EDuration="23.95761541s" totalImagesPullingTime="18.922562509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:38.957000175 +0000 UTC m=+23.709794599" watchObservedRunningTime="2026-07-27 18:31:38.95761541 +0000 UTC m=+23.710409831"
Jul 27 18:31:39.840569 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:39.840533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:39.840767 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:39.840594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:39.840840 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:39.840763    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:39.840918 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:39.840890    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:40.098987 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:40.098911    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 18:31:40.753866 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:40.753681    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T18:31:40.098926281Z","UUID":"0d715047-6ddf-4db6-87fb-496641d8f748","Handler":null,"Name":"","Endpoint":""}
Jul 27 18:31:40.755474 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:40.755275    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 18:31:40.755604 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:40.755502    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 18:31:40.839999 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:40.839965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:40.840161 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:40.840097    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:40.948064 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:40.948023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp" event={"ID":"807f44ba-5281-44a2-921c-d06b877c20aa","Type":"ContainerStarted","Data":"65b4afa8684c9278ea344a07da2e9329cbc1fa10c1e5bbe615651e3390fe70cc"}
Jul 27 18:31:40.951947 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:40.951918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"b0352258527347b8e2d42c9c2814d8bb8d694573409ad3c17ff7885acd857a82"}
Jul 27 18:31:41.541470 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:41.541432    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:41.542166 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:41.542146    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:41.843440 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:41.843371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:41.843440 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:41.843382    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:41.843705 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:41.843487    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:41.843897 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:41.843875    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:41.954570 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:41.954317    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:41.954867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:41.954845    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6x5c9"
Jul 27 18:31:42.839773 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.839512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:42.840215 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:42.839797    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:42.961888 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.961842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" event={"ID":"b95b710e-6a47-4555-8a19-52cd56325a37","Type":"ContainerStarted","Data":"055a6f36dd891296f62bebce4780b590c4cfe06adfc4a7cefd33d1e82a459708"}
Jul 27 18:31:42.962448 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.962417    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:42.962573 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.962509    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:42.962573 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.962560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:42.964212 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.964179    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c7f4a92-e49c-4746-9c75-456db03d8e80" containerID="d60441ffbfd19de1c0735b5ca4fbfb18ea5b850732025e93556436a5134277fc" exitCode=0
Jul 27 18:31:42.964599 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.964579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerDied","Data":"d60441ffbfd19de1c0735b5ca4fbfb18ea5b850732025e93556436a5134277fc"}
Jul 27 18:31:42.984585 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.984556    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:42.984733 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.984689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:31:42.992901 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:42.992860    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz" podStartSLOduration=8.008338874 podStartE2EDuration="26.992846562s" totalImagesPullingTime="18.984507688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:42.991647138 +0000 UTC m=+27.744441556" watchObservedRunningTime="2026-07-27 18:31:42.992846562 +0000 UTC m=+27.745640995"
Jul 27 18:31:43.840947 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:43.840576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:43.840947 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:43.840711    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:43.840947 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:43.840577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:43.840947 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:43.840834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:43.968445 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:43.968411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp" event={"ID":"807f44ba-5281-44a2-921c-d06b877c20aa","Type":"ContainerStarted","Data":"70b586f4ff42ddf5d7a4685ba8ec8ab739b09c94a1c9da2b5b4e178282efb882"}
Jul 27 18:31:43.989800 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:43.989710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mp" podStartSLOduration=3.529768227 podStartE2EDuration="27.989694694s" totalImagesPullingTime="24.459926467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:43.989266009 +0000 UTC m=+28.742060430" watchObservedRunningTime="2026-07-27 18:31:43.989694694 +0000 UTC m=+28.742489115"
Jul 27 18:31:44.634428 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:44.633883    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tz4mt"]
Jul 27 18:31:44.634428 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:44.633991    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:44.634428 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:44.634097    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:44.636397 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:44.636367    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhdbk"]
Jul 27 18:31:44.636571 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:44.636470    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:44.636640 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:44.636568    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:44.640444 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:44.640416    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-blpjc"]
Jul 27 18:31:44.640561 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:44.640550    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:44.640715 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:44.640669    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:45.841223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:45.841188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:45.841608 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:45.841282    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:45.978532 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:45.978497    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c7f4a92-e49c-4746-9c75-456db03d8e80" containerID="9ed47eaefefc347ac958c035ee3ecb08652b016d1e311d77bb2fee78d7c33899" exitCode=0
Jul 27 18:31:45.978705 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:45.978540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerDied","Data":"9ed47eaefefc347ac958c035ee3ecb08652b016d1e311d77bb2fee78d7c33899"}
Jul 27 18:31:46.839930 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:46.839901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:46.840109 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:46.839900    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:46.840109 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:46.840020    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:46.840109 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:46.840091    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:47.843285 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:47.843115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:47.843835 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:47.843360    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:47.985862 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:47.985822    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c7f4a92-e49c-4746-9c75-456db03d8e80" containerID="f491112c337731e2712080559c1b6e49532cd42f9c44c792e38a3630f856178e" exitCode=0
Jul 27 18:31:47.986021 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:47.985882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerDied","Data":"f491112c337731e2712080559c1b6e49532cd42f9c44c792e38a3630f856178e"}
Jul 27 18:31:48.839842 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:48.839810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:48.840060 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:48.839814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:48.840060 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:48.839939    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhdbk" podUID="fd06c8e0-abb3-4cc3-86e6-3dfa60672e34"
Jul 27 18:31:48.840060 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:48.840019    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tz4mt" podUID="de4b30cd-714b-41c3-b773-df50158ef8b0"
Jul 27 18:31:49.431145 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:49.431106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:49.431618 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:49.431223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:49.431618 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.431309    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:49.431618 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.431321    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:49.431618 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.431388    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:21.431366164 +0000 UTC m=+66.184160564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:31:49.431618 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.431410    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret podName:de4b30cd-714b-41c3-b773-df50158ef8b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:21.431399912 +0000 UTC m=+66.184194310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret") pod "global-pull-secret-syncer-tz4mt" (UID: "de4b30cd-714b-41c3-b773-df50158ef8b0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:31:49.531554 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:49.531519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:49.531728 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.531692    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:31:49.531728 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.531720    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:31:49.531879 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.531734    2578 projected.go:196] Error preparing data for projected volume kube-api-access-chw7f for pod openshift-network-diagnostics/network-check-target-mhdbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:49.531879 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.531814    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f podName:fd06c8e0-abb3-4cc3-86e6-3dfa60672e34 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:21.531795851 +0000 UTC m=+66.284590259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-chw7f" (UniqueName: "kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f") pod "network-check-target-mhdbk" (UID: "fd06c8e0-abb3-4cc3-86e6-3dfa60672e34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:31:49.840131 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:49.839725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:49.840131 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:49.839883    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-blpjc" podUID="2cf845a2-262b-48ee-9bac-2211c75c10f0"
Jul 27 18:31:50.054836 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.054805    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-183.ec2.internal" event="NodeReady"
Jul 27 18:31:50.055009 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.054957    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 18:31:50.102492 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.102413    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79485dbbb7-ls6nn"]
Jul 27 18:31:50.104297 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.104277    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.112512 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.111623    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 18:31:50.112512 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.111906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 18:31:50.112512 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.112350    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 18:31:50.112512 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.112440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dvhzg\""
Jul 27 18:31:50.118560 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.118539    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 18:31:50.137133 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.136215    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xkv5j"]
Jul 27 18:31:50.139976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.139951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79485dbbb7-ls6nn"]
Jul 27 18:31:50.140108 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.140088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.143416 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.143297    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 18:31:50.143416 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.143368    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m8x25\""
Jul 27 18:31:50.143812 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.143791    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 18:31:50.170389 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.170356    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-52gct"]
Jul 27 18:31:50.172289 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.172269    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.183903 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.183879    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 18:31:50.184102 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.184084    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 18:31:50.236433 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-installation-pull-secrets\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.236598 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c696d\" (UniqueName: \"kubernetes.io/projected/9df4217e-b5e2-4b6d-8238-628f5f776e02-kube-api-access-c696d\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.236598 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.236598 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-bound-sa-token\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.236801 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9df4217e-b5e2-4b6d-8238-628f5f776e02-config-volume\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.236801 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-image-registry-private-configuration\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.236801 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.236937 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337679c5-c2a4-4a33-802b-82cbdf0ba04f-ca-trust-extracted\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.236937 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-certificates\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.236937 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df4217e-b5e2-4b6d-8238-628f5f776e02-tmp-dir\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.236937 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-kube-api-access-g26w9\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.236937 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.236919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-trusted-ca\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.246077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.246049    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 18:31:50.246222 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.246118    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bghlc\""
Jul 27 18:31:50.247067 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.247044    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xkv5j"]
Jul 27 18:31:50.248034 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.248014    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-52gct"]
Jul 27 18:31:50.337961 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.337919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9df4217e-b5e2-4b6d-8238-628f5f776e02-config-volume\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.337976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-image-registry-private-configuration\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqmt6\" (UniqueName: \"kubernetes.io/projected/0643253c-9b39-4111-889a-784b29c45810-kube-api-access-sqmt6\") pod \"ingress-canary-52gct\" (UID: \"0643253c-9b39-4111-889a-784b29c45810\") " pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337679c5-c2a4-4a33-802b-82cbdf0ba04f-ca-trust-extracted\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-certificates\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0643253c-9b39-4111-889a-784b29c45810-cert\") pod \"ingress-canary-52gct\" (UID: \"0643253c-9b39-4111-889a-784b29c45810\") " pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df4217e-b5e2-4b6d-8238-628f5f776e02-tmp-dir\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.338151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-kube-api-access-g26w9\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.338422 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-trusted-ca\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.338422 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-installation-pull-secrets\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.338422 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c696d\" (UniqueName: \"kubernetes.io/projected/9df4217e-b5e2-4b6d-8238-628f5f776e02-kube-api-access-c696d\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.338422 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.338422 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.338289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-bound-sa-token\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.339144 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.339107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337679c5-c2a4-4a33-802b-82cbdf0ba04f-ca-trust-extracted\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.339276 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.339205    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:31:50.339276 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.339230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df4217e-b5e2-4b6d-8238-628f5f776e02-tmp-dir\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.339276 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.339268    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls podName:9df4217e-b5e2-4b6d-8238-628f5f776e02 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:50.839249459 +0000 UTC m=+35.592043856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls") pod "dns-default-xkv5j" (UID: "9df4217e-b5e2-4b6d-8238-628f5f776e02") : secret "dns-default-metrics-tls" not found
Jul 27 18:31:50.339447 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.339308    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:31:50.339447 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.339317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-certificates\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.339447 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.339335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9df4217e-b5e2-4b6d-8238-628f5f776e02-config-volume\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.339447 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.339323    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485dbbb7-ls6nn: secret "image-registry-tls" not found
Jul 27 18:31:50.339447 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.339390    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls podName:337679c5-c2a4-4a33-802b-82cbdf0ba04f nodeName:}" failed. No retries permitted until 2026-07-27 18:31:50.839375399 +0000 UTC m=+35.592169800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls") pod "image-registry-79485dbbb7-ls6nn" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f") : secret "image-registry-tls" not found
Jul 27 18:31:50.339794 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.339775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-trusted-ca\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.343486 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.343467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-installation-pull-secrets\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.343623 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.343500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-image-registry-private-configuration\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.353058 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.352983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c696d\" (UniqueName: \"kubernetes.io/projected/9df4217e-b5e2-4b6d-8238-628f5f776e02-kube-api-access-c696d\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.353679 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.353308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-bound-sa-token\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.353679 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.353644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-kube-api-access-g26w9\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.392191 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.392152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:50.439528 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.439493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqmt6\" (UniqueName: \"kubernetes.io/projected/0643253c-9b39-4111-889a-784b29c45810-kube-api-access-sqmt6\") pod \"ingress-canary-52gct\" (UID: \"0643253c-9b39-4111-889a-784b29c45810\") " pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.440080 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.439539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0643253c-9b39-4111-889a-784b29c45810-cert\") pod \"ingress-canary-52gct\" (UID: \"0643253c-9b39-4111-889a-784b29c45810\") " pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.442442 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.442376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0643253c-9b39-4111-889a-784b29c45810-cert\") pod \"ingress-canary-52gct\" (UID: \"0643253c-9b39-4111-889a-784b29c45810\") " pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.451862 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.451829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqmt6\" (UniqueName: \"kubernetes.io/projected/0643253c-9b39-4111-889a-784b29c45810-kube-api-access-sqmt6\") pod \"ingress-canary-52gct\" (UID: \"0643253c-9b39-4111-889a-784b29c45810\") " pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.482571 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.482532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-52gct"
Jul 27 18:31:50.508067 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.508024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:50.633504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.633301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-52gct"]
Jul 27 18:31:50.840236 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.840201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:31:50.840430 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.840220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:31:50.843031 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.842998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:50.843161 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.843103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:50.843218 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.843164    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:31:50.843281 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.843232    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls podName:9df4217e-b5e2-4b6d-8238-628f5f776e02 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:51.843211074 +0000 UTC m=+36.596005482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls") pod "dns-default-xkv5j" (UID: "9df4217e-b5e2-4b6d-8238-628f5f776e02") : secret "dns-default-metrics-tls" not found
Jul 27 18:31:50.843281 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.843252    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:31:50.843281 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.843268    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485dbbb7-ls6nn: secret "image-registry-tls" not found
Jul 27 18:31:50.843443 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:50.843313    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls podName:337679c5-c2a4-4a33-802b-82cbdf0ba04f nodeName:}" failed. No retries permitted until 2026-07-27 18:31:51.843301085 +0000 UTC m=+36.596095483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls") pod "image-registry-79485dbbb7-ls6nn" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f") : secret "image-registry-tls" not found
Jul 27 18:31:50.845904 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.845880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 18:31:50.846031 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.846018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 18:31:50.846092 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.846059    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv59m\""
Jul 27 18:31:50.846161 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:50.846144    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 18:31:51.839986 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:51.839950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:31:51.842894 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:51.842854    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 18:31:51.843021 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:51.842863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wf8\""
Jul 27 18:31:51.852178 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:51.852152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:51.852313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:51.852241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:51.852313 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:51.852306    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:31:51.852420 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:51.852377    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:31:51.852420 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:51.852391    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485dbbb7-ls6nn: secret "image-registry-tls" not found
Jul 27 18:31:51.852521 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:51.852380    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls podName:9df4217e-b5e2-4b6d-8238-628f5f776e02 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:53.85235769 +0000 UTC m=+38.605152102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls") pod "dns-default-xkv5j" (UID: "9df4217e-b5e2-4b6d-8238-628f5f776e02") : secret "dns-default-metrics-tls" not found
Jul 27 18:31:51.852521 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:51.852482    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls podName:337679c5-c2a4-4a33-802b-82cbdf0ba04f nodeName:}" failed. No retries permitted until 2026-07-27 18:31:53.852456416 +0000 UTC m=+38.605250817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls") pod "image-registry-79485dbbb7-ls6nn" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f") : secret "image-registry-tls" not found
Jul 27 18:31:52.024923 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:31:52.024886    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0643253c_9b39_4111_889a_784b29c45810.slice/crio-1b44fd56a5fc7a676ca3baa20b86ed6c47d3a7c80878249771aa48086ae3473b WatchSource:0}: Error finding container 1b44fd56a5fc7a676ca3baa20b86ed6c47d3a7c80878249771aa48086ae3473b: Status 404 returned error can't find the container with id 1b44fd56a5fc7a676ca3baa20b86ed6c47d3a7c80878249771aa48086ae3473b
Jul 27 18:31:53.000673 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:53.000643    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c7f4a92-e49c-4746-9c75-456db03d8e80" containerID="461455003fca3b534ea8c012f1670dc2bc5cec1283fff4d2d2def0747e69b04f" exitCode=0
Jul 27 18:31:53.001196 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:53.000730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerDied","Data":"461455003fca3b534ea8c012f1670dc2bc5cec1283fff4d2d2def0747e69b04f"}
Jul 27 18:31:53.002055 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:53.002016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-52gct" event={"ID":"0643253c-9b39-4111-889a-784b29c45810","Type":"ContainerStarted","Data":"1b44fd56a5fc7a676ca3baa20b86ed6c47d3a7c80878249771aa48086ae3473b"}
Jul 27 18:31:53.868542 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:53.868508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:53.868726 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:53.868598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:53.868833 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:53.868663    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:31:53.868888 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:53.868849    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485dbbb7-ls6nn: secret "image-registry-tls" not found
Jul 27 18:31:53.868934 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:53.868906    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls podName:337679c5-c2a4-4a33-802b-82cbdf0ba04f nodeName:}" failed. No retries permitted until 2026-07-27 18:31:57.868888988 +0000 UTC m=+42.621683386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls") pod "image-registry-79485dbbb7-ls6nn" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f") : secret "image-registry-tls" not found
Jul 27 18:31:53.868934 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:53.868711    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:31:53.869031 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:53.868987    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls podName:9df4217e-b5e2-4b6d-8238-628f5f776e02 nodeName:}" failed. No retries permitted until 2026-07-27 18:31:57.868964381 +0000 UTC m=+42.621758796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls") pod "dns-default-xkv5j" (UID: "9df4217e-b5e2-4b6d-8238-628f5f776e02") : secret "dns-default-metrics-tls" not found
Jul 27 18:31:54.008053 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:54.008018    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c7f4a92-e49c-4746-9c75-456db03d8e80" containerID="2478dc8ff5f20f0a13327f642a65aeb364e1959a96a52c74adfe0ce1f2d3a553" exitCode=0
Jul 27 18:31:54.008451 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:54.008076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerDied","Data":"2478dc8ff5f20f0a13327f642a65aeb364e1959a96a52c74adfe0ce1f2d3a553"}
Jul 27 18:31:54.957502 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:54.957298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:55.013471 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.013434    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rm94j" event={"ID":"9c7f4a92-e49c-4746-9c75-456db03d8e80","Type":"ContainerStarted","Data":"0b015d7ac32c450c2f8b5d19543023dd2488ab8a01abda48df022d78412ab47d"}
Jul 27 18:31:55.014924 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.014894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-52gct" event={"ID":"0643253c-9b39-4111-889a-784b29c45810","Type":"ContainerStarted","Data":"46b7090ef2af678577090cb60dcd65470ed4e67eb9f584e711a837c381848716"}
Jul 27 18:31:55.041158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.041078    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rm94j" podStartSLOduration=12.064024698 podStartE2EDuration="39.041060132s" totalImagesPullingTime="26.977035434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:55.039710984 +0000 UTC m=+39.792505428" watchObservedRunningTime="2026-07-27 18:31:55.041060132 +0000 UTC m=+39.793854555"
Jul 27 18:31:55.042318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.042283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:55.061370 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.061326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-52gct" podStartSLOduration=2.468525922 podStartE2EDuration="5.061312057s" totalImagesPullingTime="2.592786135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:55.060973973 +0000 UTC m=+39.813768416" watchObservedRunningTime="2026-07-27 18:31:55.061312057 +0000 UTC m=+39.814106477"
Jul 27 18:31:55.188445 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.188412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:55.290696 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.290614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:55.393103 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.393067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:55.495177 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.495131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:55.789087 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.789053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:55.875028 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:55.874981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:56.183666 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:56.183629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:56.519278 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:56.519170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:56.619374 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:56.619333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:31:57.900428 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:57.900395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:31:57.900804 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:31:57.900468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:31:57.900804 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:57.900568    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:31:57.900804 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:57.900574    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:31:57.900804 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:57.900590    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485dbbb7-ls6nn: secret "image-registry-tls" not found
Jul 27 18:31:57.900804 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:57.900637    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls podName:337679c5-c2a4-4a33-802b-82cbdf0ba04f nodeName:}" failed. No retries permitted until 2026-07-27 18:32:05.900619771 +0000 UTC m=+50.653414182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls") pod "image-registry-79485dbbb7-ls6nn" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f") : secret "image-registry-tls" not found
Jul 27 18:31:57.900804 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:31:57.900652    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls podName:9df4217e-b5e2-4b6d-8238-628f5f776e02 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:05.900644118 +0000 UTC m=+50.653438522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls") pod "dns-default-xkv5j" (UID: "9df4217e-b5e2-4b6d-8238-628f5f776e02") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:00.189558 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:00.189529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:04.719342 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:04.719310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:04.784259 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:04.784218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:04.884963 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:04.884929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:04.985038 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:04.984956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:05.766171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:05.766136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:05.870988 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:05.870948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:05.960545 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:05.960510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:32:05.960694 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:05.960576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:32:05.960694 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:05.960657    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:05.960694 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:05.960679    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:32:05.960694 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:05.960692    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485dbbb7-ls6nn: secret "image-registry-tls" not found
Jul 27 18:32:05.960865 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:05.960723    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls podName:9df4217e-b5e2-4b6d-8238-628f5f776e02 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:21.960707162 +0000 UTC m=+66.713501562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls") pod "dns-default-xkv5j" (UID: "9df4217e-b5e2-4b6d-8238-628f5f776e02") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:05.960865 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:05.960757    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls podName:337679c5-c2a4-4a33-802b-82cbdf0ba04f nodeName:}" failed. No retries permitted until 2026-07-27 18:32:21.960732781 +0000 UTC m=+66.713527178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls") pod "image-registry-79485dbbb7-ls6nn" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f") : secret "image-registry-tls" not found
Jul 27 18:32:07.553887 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:07.553851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:07.624681 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:07.624638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:08.713572 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:08.713544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:12.393803 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:12.393727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:12.472487 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:12.472450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:14.981547 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:14.981521    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ch7hz"
Jul 27 18:32:15.130466 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:15.130427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:15.191324 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:15.191287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:17.976078 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:17.976045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:18.032791 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:18.032735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:20.884240 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:20.884204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:21.003098 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.003049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:21.103710 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.103671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:21.475778 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.475724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:32:21.475959 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.475794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:32:21.478480 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.478458    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 18:32:21.479303 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.479288    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 18:32:21.486203 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:21.486185    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 18:32:21.486287 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:21.486248    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs podName:2cf845a2-262b-48ee-9bac-2211c75c10f0 nodeName:}" failed. No retries permitted until 2026-07-27 18:33:25.486231718 +0000 UTC m=+130.239026116 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs") pod "network-metrics-daemon-blpjc" (UID: "2cf845a2-262b-48ee-9bac-2211c75c10f0") : secret "metrics-daemon-secret" not found
Jul 27 18:32:21.490000 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.489981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de4b30cd-714b-41c3-b773-df50158ef8b0-original-pull-secret\") pod \"global-pull-secret-syncer-tz4mt\" (UID: \"de4b30cd-714b-41c3-b773-df50158ef8b0\") " pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:32:21.576610 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.576553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:32:21.579486 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.579465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 18:32:21.590163 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.590139    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 18:32:21.600987 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.600959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chw7f\" (UniqueName: \"kubernetes.io/projected/fd06c8e0-abb3-4cc3-86e6-3dfa60672e34-kube-api-access-chw7f\") pod \"network-check-target-mhdbk\" (UID: \"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34\") " pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:32:21.753513 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.753417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tz4mt"
Jul 27 18:32:21.762343 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.762320    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv59m\""
Jul 27 18:32:21.769590 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.769560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:32:21.907411 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.907381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tz4mt"]
Jul 27 18:32:21.911187 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:32:21.911152    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4b30cd_714b_41c3_b773_df50158ef8b0.slice/crio-aea4be146a3ca9cca6d9efd72d1f1867e48fab429086a027f5a542bcb0284498 WatchSource:0}: Error finding container aea4be146a3ca9cca6d9efd72d1f1867e48fab429086a027f5a542bcb0284498: Status 404 returned error can't find the container with id aea4be146a3ca9cca6d9efd72d1f1867e48fab429086a027f5a542bcb0284498
Jul 27 18:32:21.926729 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.926691    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhdbk"]
Jul 27 18:32:21.932478 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:32:21.932452    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd06c8e0_abb3_4cc3_86e6_3dfa60672e34.slice/crio-9896bad248826a9ed6ce29f42df6ee115c9f3563833b0051a8f95e937051335f WatchSource:0}: Error finding container 9896bad248826a9ed6ce29f42df6ee115c9f3563833b0051a8f95e937051335f: Status 404 returned error can't find the container with id 9896bad248826a9ed6ce29f42df6ee115c9f3563833b0051a8f95e937051335f
Jul 27 18:32:21.979565 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.979531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:32:21.979693 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:21.979597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:32:21.979733 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:21.979684    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:32:21.979733 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:21.979706    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79485dbbb7-ls6nn: secret "image-registry-tls" not found
Jul 27 18:32:21.979830 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:21.979781    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls podName:337679c5-c2a4-4a33-802b-82cbdf0ba04f nodeName:}" failed. No retries permitted until 2026-07-27 18:32:53.979758162 +0000 UTC m=+98.732552573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls") pod "image-registry-79485dbbb7-ls6nn" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f") : secret "image-registry-tls" not found
Jul 27 18:32:21.979830 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:21.979686    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:32:21.979896 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:21.979836    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls podName:9df4217e-b5e2-4b6d-8238-628f5f776e02 nodeName:}" failed. No retries permitted until 2026-07-27 18:32:53.979824358 +0000 UTC m=+98.732618756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls") pod "dns-default-xkv5j" (UID: "9df4217e-b5e2-4b6d-8238-628f5f776e02") : secret "dns-default-metrics-tls" not found
Jul 27 18:32:22.077287 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:22.077200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tz4mt" event={"ID":"de4b30cd-714b-41c3-b773-df50158ef8b0","Type":"ContainerStarted","Data":"aea4be146a3ca9cca6d9efd72d1f1867e48fab429086a027f5a542bcb0284498"}
Jul 27 18:32:22.078338 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:22.078312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhdbk" event={"ID":"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34","Type":"ContainerStarted","Data":"9896bad248826a9ed6ce29f42df6ee115c9f3563833b0051a8f95e937051335f"}
Jul 27 18:32:27.092054 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:27.092011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tz4mt" event={"ID":"de4b30cd-714b-41c3-b773-df50158ef8b0","Type":"ContainerStarted","Data":"119aeebdfc0a71c05d61887f30a0ab1f711baea1de78b1c721a9818ee323ae6d"}
Jul 27 18:32:27.093492 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:27.093464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhdbk" event={"ID":"fd06c8e0-abb3-4cc3-86e6-3dfa60672e34","Type":"ContainerStarted","Data":"c55f6338d04541227e1acc73d4975e61e90f4e9c1ee26d05277ba8414bf14df3"}
Jul 27 18:32:27.093611 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:27.093533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:32:27.107293 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:27.107237    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tz4mt" podStartSLOduration=66.451124683 podStartE2EDuration="1m11.107223247s" totalImagesPullingTime="4.656098564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:27.106773013 +0000 UTC m=+71.859567457" watchObservedRunningTime="2026-07-27 18:32:27.107223247 +0000 UTC m=+71.860017666"
Jul 27 18:32:27.123274 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:27.123224    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mhdbk" podStartSLOduration=67.49328148 podStartE2EDuration="1m12.123206785s" totalImagesPullingTime="4.629925305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:27.122807629 +0000 UTC m=+71.875602070" watchObservedRunningTime="2026-07-27 18:32:27.123206785 +0000 UTC m=+71.876001206"
Jul 27 18:32:33.269417 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:33.269381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:33.386175 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:33.386118    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:38.494350 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.494240    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"]
Jul 27 18:32:38.496954 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.496929    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.499536 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.499518    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 18:32:38.499844 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.499816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 18:32:38.499970 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.499953    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fcv4q\""
Jul 27 18:32:38.502508 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.502485    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 18:32:38.504418 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.504399    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"]
Jul 27 18:32:38.504572 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.504548    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:32:38.506256 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.506240    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"
Jul 27 18:32:38.509260 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.509244    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4fptf\""
Jul 27 18:32:38.509348 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.509319    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:32:38.513092 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.513076    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 18:32:38.524544 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.524517    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"]
Jul 27 18:32:38.530151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.530127    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"]
Jul 27 18:32:38.530589 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.530567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:38.531156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.531132    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"]
Jul 27 18:32:38.534713 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.534693    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:32:38.534941 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.534920    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xk6gs\""
Jul 27 18:32:38.535520 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.535507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 18:32:38.535703 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.535691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 18:32:38.562948 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.562919    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"]
Jul 27 18:32:38.597700 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.597665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:38.597700 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.597704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b58bec9-93ad-4185-b0bd-04cb45a93568-config\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.597960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.597728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gpv9\" (UniqueName: \"kubernetes.io/projected/8a4246af-5408-48ea-b7a9-e5b279467391-kube-api-access-2gpv9\") pod \"volume-data-source-validator-549c6d54cf-6km22\" (UID: \"8a4246af-5408-48ea-b7a9-e5b279467391\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"
Jul 27 18:32:38.597960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.597845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b58bec9-93ad-4185-b0bd-04cb45a93568-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.597960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.597878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzp85\" (UniqueName: \"kubernetes.io/projected/0b58bec9-93ad-4185-b0bd-04cb45a93568-kube-api-access-rzp85\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.597960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.597900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqrt\" (UniqueName: \"kubernetes.io/projected/6e86a4e6-420f-4283-9360-d7e11df22dcf-kube-api-access-njqrt\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:38.699126 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.699091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:38.699126 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.699128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b58bec9-93ad-4185-b0bd-04cb45a93568-config\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.699345 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.699152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gpv9\" (UniqueName: \"kubernetes.io/projected/8a4246af-5408-48ea-b7a9-e5b279467391-kube-api-access-2gpv9\") pod \"volume-data-source-validator-549c6d54cf-6km22\" (UID: \"8a4246af-5408-48ea-b7a9-e5b279467391\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"
Jul 27 18:32:38.699345 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.699204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b58bec9-93ad-4185-b0bd-04cb45a93568-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.699345 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.699222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzp85\" (UniqueName: \"kubernetes.io/projected/0b58bec9-93ad-4185-b0bd-04cb45a93568-kube-api-access-rzp85\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.699345 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.699240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqrt\" (UniqueName: \"kubernetes.io/projected/6e86a4e6-420f-4283-9360-d7e11df22dcf-kube-api-access-njqrt\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:38.699345 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:38.699249    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 18:32:38.699345 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:38.699318    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls podName:6e86a4e6-420f-4283-9360-d7e11df22dcf nodeName:}" failed. No retries permitted until 2026-07-27 18:32:39.199295861 +0000 UTC m=+83.952090260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls") pod "cluster-samples-operator-6748489656-8j2wk" (UID: "6e86a4e6-420f-4283-9360-d7e11df22dcf") : secret "samples-operator-tls" not found
Jul 27 18:32:38.699785 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.699762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b58bec9-93ad-4185-b0bd-04cb45a93568-config\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.701621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.701601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b58bec9-93ad-4185-b0bd-04cb45a93568-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.711393 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.711364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqrt\" (UniqueName: \"kubernetes.io/projected/6e86a4e6-420f-4283-9360-d7e11df22dcf-kube-api-access-njqrt\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:38.712276 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.712253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gpv9\" (UniqueName: \"kubernetes.io/projected/8a4246af-5408-48ea-b7a9-e5b279467391-kube-api-access-2gpv9\") pod \"volume-data-source-validator-549c6d54cf-6km22\" (UID: \"8a4246af-5408-48ea-b7a9-e5b279467391\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"
Jul 27 18:32:38.712572 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.712555    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzp85\" (UniqueName: \"kubernetes.io/projected/0b58bec9-93ad-4185-b0bd-04cb45a93568-kube-api-access-rzp85\") pod \"service-ca-operator-5d6c75f84f-fvlwr\" (UID: \"0b58bec9-93ad-4185-b0bd-04cb45a93568\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.755331 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.755243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:38.805554 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.805522    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"
Jul 27 18:32:38.814675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.814647    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"
Jul 27 18:32:38.885807 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.885776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:38.940607 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.940562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr"]
Jul 27 18:32:38.944143 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:32:38.944119    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b58bec9_93ad_4185_b0bd_04cb45a93568.slice/crio-600319c4830e8d2eb43eb98c885bed6896425e260c5a11236ed3d32e40998d9b WatchSource:0}: Error finding container 600319c4830e8d2eb43eb98c885bed6896425e260c5a11236ed3d32e40998d9b: Status 404 returned error can't find the container with id 600319c4830e8d2eb43eb98c885bed6896425e260c5a11236ed3d32e40998d9b
Jul 27 18:32:38.957819 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:38.957794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22"]
Jul 27 18:32:38.960558 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:32:38.960536    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4246af_5408_48ea_b7a9_e5b279467391.slice/crio-02c94adc3daf0068b594068162a33028974386b5eb633140069eec8345b5acd3 WatchSource:0}: Error finding container 02c94adc3daf0068b594068162a33028974386b5eb633140069eec8345b5acd3: Status 404 returned error can't find the container with id 02c94adc3daf0068b594068162a33028974386b5eb633140069eec8345b5acd3
Jul 27 18:32:39.124901 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:39.124815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr" event={"ID":"0b58bec9-93ad-4185-b0bd-04cb45a93568","Type":"ContainerStarted","Data":"600319c4830e8d2eb43eb98c885bed6896425e260c5a11236ed3d32e40998d9b"}
Jul 27 18:32:39.125820 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:39.125796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22" event={"ID":"8a4246af-5408-48ea-b7a9-e5b279467391","Type":"ContainerStarted","Data":"02c94adc3daf0068b594068162a33028974386b5eb633140069eec8345b5acd3"}
Jul 27 18:32:39.202176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:39.202142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:39.202345 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:39.202326    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 18:32:39.202416 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:39.202408    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls podName:6e86a4e6-420f-4283-9360-d7e11df22dcf nodeName:}" failed. No retries permitted until 2026-07-27 18:32:40.202387122 +0000 UTC m=+84.955181536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls") pod "cluster-samples-operator-6748489656-8j2wk" (UID: "6e86a4e6-420f-4283-9360-d7e11df22dcf") : secret "samples-operator-tls" not found
Jul 27 18:32:40.209576 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:40.209530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:40.210028 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:40.209665    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 18:32:40.210028 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:40.209737    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls podName:6e86a4e6-420f-4283-9360-d7e11df22dcf nodeName:}" failed. No retries permitted until 2026-07-27 18:32:42.209718612 +0000 UTC m=+86.962513009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls") pod "cluster-samples-operator-6748489656-8j2wk" (UID: "6e86a4e6-420f-4283-9360-d7e11df22dcf") : secret "samples-operator-tls" not found
Jul 27 18:32:41.133854 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:41.133573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr" event={"ID":"0b58bec9-93ad-4185-b0bd-04cb45a93568","Type":"ContainerStarted","Data":"4632af68df7cb13eec5c9302863a7fb54422ac6c5d03d5feab7f7d5a64f82378"}
Jul 27 18:32:41.135656 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:41.135625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22" event={"ID":"8a4246af-5408-48ea-b7a9-e5b279467391","Type":"ContainerStarted","Data":"90d0f3798120dc55db63b30eb00753cb93566aa94f356f425f8ce5e92c04969a"}
Jul 27 18:32:41.152155 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:41.152109    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr" podStartSLOduration=1.074030317 podStartE2EDuration="3.152093563s" totalImagesPullingTime="2.078063246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:41.151687414 +0000 UTC m=+85.904481854" watchObservedRunningTime="2026-07-27 18:32:41.152093563 +0000 UTC m=+85.904887983"
Jul 27 18:32:41.275920 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:41.275815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.188412 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.188381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.225555 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.225518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:42.225695 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:42.225652    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 18:32:42.225820 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:42.225804    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls podName:6e86a4e6-420f-4283-9360-d7e11df22dcf nodeName:}" failed. No retries permitted until 2026-07-27 18:32:46.225777849 +0000 UTC m=+90.978572266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls") pod "cluster-samples-operator-6748489656-8j2wk" (UID: "6e86a4e6-420f-4283-9360-d7e11df22dcf") : secret "samples-operator-tls" not found
Jul 27 18:32:42.277964 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.277937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.535221 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.535134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.560148 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.560002    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6km22" podStartSLOduration=3.240127016 podStartE2EDuration="4.559987045s" totalImagesPullingTime="1.319860029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:41.17576302 +0000 UTC m=+85.928557437" watchObservedRunningTime="2026-07-27 18:32:42.559987045 +0000 UTC m=+87.312781466"
Jul 27 18:32:42.560823 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.560805    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"]
Jul 27 18:32:42.563090 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.563077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"
Jul 27 18:32:42.565777 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.565725    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 18:32:42.565777 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.565771    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pffz7\""
Jul 27 18:32:42.566722 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.566707    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 18:32:42.623003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.622972    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"]
Jul 27 18:32:42.627790 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.627760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.628605 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.628588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f26t\" (UniqueName: \"kubernetes.io/projected/c65f77d4-a224-40cc-8408-95a68a6b5f2e-kube-api-access-7f26t\") pod \"migrator-6865c9967-bpws7\" (UID: \"c65f77d4-a224-40cc-8408-95a68a6b5f2e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"
Jul 27 18:32:42.729941 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.729900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f26t\" (UniqueName: \"kubernetes.io/projected/c65f77d4-a224-40cc-8408-95a68a6b5f2e-kube-api-access-7f26t\") pod \"migrator-6865c9967-bpws7\" (UID: \"c65f77d4-a224-40cc-8408-95a68a6b5f2e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"
Jul 27 18:32:42.740066 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.740038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f26t\" (UniqueName: \"kubernetes.io/projected/c65f77d4-a224-40cc-8408-95a68a6b5f2e-kube-api-access-7f26t\") pod \"migrator-6865c9967-bpws7\" (UID: \"c65f77d4-a224-40cc-8408-95a68a6b5f2e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"
Jul 27 18:32:42.792448 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.792369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.872099 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.872062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"
Jul 27 18:32:42.888431 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.888398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.991812 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.991778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:42.999478 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:42.999453    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7"]
Jul 27 18:32:43.003981 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:32:43.003950    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65f77d4_a224_40cc_8408_95a68a6b5f2e.slice/crio-a9191d49e23900fde51ac21a8f0b6d509c7f384ddb31220a5f1ede2ed99c822a WatchSource:0}: Error finding container a9191d49e23900fde51ac21a8f0b6d509c7f384ddb31220a5f1ede2ed99c822a: Status 404 returned error can't find the container with id a9191d49e23900fde51ac21a8f0b6d509c7f384ddb31220a5f1ede2ed99c822a
Jul 27 18:32:43.142120 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:43.142083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7" event={"ID":"c65f77d4-a224-40cc-8408-95a68a6b5f2e","Type":"ContainerStarted","Data":"a9191d49e23900fde51ac21a8f0b6d509c7f384ddb31220a5f1ede2ed99c822a"}
Jul 27 18:32:44.542732 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:44.542692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:44.646012 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:44.645983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:45.151285 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:45.151249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7" event={"ID":"c65f77d4-a224-40cc-8408-95a68a6b5f2e","Type":"ContainerStarted","Data":"4c8920a0801bb03e92f2d53f2c7bc977f7efb743f9010225518b024c0a666b63"}
Jul 27 18:32:45.151490 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:45.151317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7" event={"ID":"c65f77d4-a224-40cc-8408-95a68a6b5f2e","Type":"ContainerStarted","Data":"f2018169daf66653a30a3e26e38864d651d0fcdd2e87c8e08abc970a4af8865f"}
Jul 27 18:32:45.810321 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:45.810280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:45.929422 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:45.929384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:46.034264 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:46.034213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:46.259316 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:46.259283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:46.259484 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:46.259392    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 18:32:46.259484 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:32:46.259446    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls podName:6e86a4e6-420f-4283-9360-d7e11df22dcf nodeName:}" failed. No retries permitted until 2026-07-27 18:32:54.25943302 +0000 UTC m=+99.012227418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls") pod "cluster-samples-operator-6748489656-8j2wk" (UID: "6e86a4e6-420f-4283-9360-d7e11df22dcf") : secret "samples-operator-tls" not found
Jul 27 18:32:48.736000 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:48.735973    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rmw5t_830bcb19-c11b-4ee5-937f-a73e2a9dd471/dns-node-resolver/0.log"
Jul 27 18:32:48.805136 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:48.805074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:48.907544 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:48.907499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:49.015119 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:49.015028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:49.113264 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:49.113226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:49.177246 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:49.177216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:49.733093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:49.733067    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6m7b_bb04b79a-b40e-442e-a47b-305589da104b/node-ca/0.log"
Jul 27 18:32:49.891381 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:49.891341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:50.097014 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:50.096910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:50.134914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:50.134884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-52gct_0643253c-9b39-4111-889a-784b29c45810/serve-healthcheck-canary/0.log"
Jul 27 18:32:50.707034 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:50.707002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:50.734465 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:50.734440    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bpws7_c65f77d4-a224-40cc-8408-95a68a6b5f2e/migrator/0.log"
Jul 27 18:32:50.937464 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:50.937430    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bpws7_c65f77d4-a224-40cc-8408-95a68a6b5f2e/graceful-termination/0.log"
Jul 27 18:32:51.237708 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:51.237661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:51.406640 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:51.406600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:51.507571 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:51.507486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:51.694424 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:51.694394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:52.088350 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:52.088316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:52.514841 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:52.514805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:52.961236 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:52.961208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:53.061290 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:53.061252    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:53.400545 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:53.400517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:53.501979 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:53.501951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:53.575203 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:53.575173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:53.689858 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:53.689771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:53.917481 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:53.917449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:54.016217 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.016124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:32:54.016217 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.016180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:32:54.018599 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.018564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df4217e-b5e2-4b6d-8238-628f5f776e02-metrics-tls\") pod \"dns-default-xkv5j\" (UID: \"9df4217e-b5e2-4b6d-8238-628f5f776e02\") " pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:32:54.018834 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.018814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"image-registry-79485dbbb7-ls6nn\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") " pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:32:54.053914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.053887    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m8x25\""
Jul 27 18:32:54.062052 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.062028    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:32:54.190958 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.190897    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bpws7" podStartSLOduration=10.897668411 podStartE2EDuration="12.190874335s" totalImagesPullingTime="1.293205924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:45.177522949 +0000 UTC m=+89.930317370" watchObservedRunningTime="2026-07-27 18:32:54.190874335 +0000 UTC m=+98.943668760"
Jul 27 18:32:54.191925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.191899    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xkv5j"]
Jul 27 18:32:54.195700 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:32:54.195672    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df4217e_b5e2_4b6d_8238_628f5f776e02.slice/crio-741ddd4e0be13c09103ffd9eaabc9c6596f9bdcef1f0b495f28eb3f09197dfc5 WatchSource:0}: Error finding container 741ddd4e0be13c09103ffd9eaabc9c6596f9bdcef1f0b495f28eb3f09197dfc5: Status 404 returned error can't find the container with id 741ddd4e0be13c09103ffd9eaabc9c6596f9bdcef1f0b495f28eb3f09197dfc5
Jul 27 18:32:54.317888 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.317802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dvhzg\""
Jul 27 18:32:54.320031 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.320011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:54.322467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.322449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e86a4e6-420f-4283-9360-d7e11df22dcf-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8j2wk\" (UID: \"6e86a4e6-420f-4283-9360-d7e11df22dcf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:54.325324 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.325305    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:32:54.439822 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.439793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"
Jul 27 18:32:54.455638 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.455614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79485dbbb7-ls6nn"]
Jul 27 18:32:54.457709 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:32:54.457683    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337679c5_c2a4_4a33_802b_82cbdf0ba04f.slice/crio-2ffcd29e600915d2dad6c40b0891ed65dd5683d6198348548223b8ff8b968d1f WatchSource:0}: Error finding container 2ffcd29e600915d2dad6c40b0891ed65dd5683d6198348548223b8ff8b968d1f: Status 404 returned error can't find the container with id 2ffcd29e600915d2dad6c40b0891ed65dd5683d6198348548223b8ff8b968d1f
Jul 27 18:32:54.576786 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.576677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk"]
Jul 27 18:32:54.691579 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:54.691537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:55.081462 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.081428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:55.182680 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.182645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:55.183704 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.183645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn" event={"ID":"337679c5-c2a4-4a33-802b-82cbdf0ba04f","Type":"ContainerStarted","Data":"e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092"}
Jul 27 18:32:55.183862 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.183713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn" event={"ID":"337679c5-c2a4-4a33-802b-82cbdf0ba04f","Type":"ContainerStarted","Data":"2ffcd29e600915d2dad6c40b0891ed65dd5683d6198348548223b8ff8b968d1f"}
Jul 27 18:32:55.184019 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.183968    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:32:55.185285 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.185257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk" event={"ID":"6e86a4e6-420f-4283-9360-d7e11df22dcf","Type":"ContainerStarted","Data":"5ae9ef51b717bd786eb6a293d4e31b0085a3c348540940aaa330fbf271d5daa1"}
Jul 27 18:32:55.186546 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.186525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xkv5j" event={"ID":"9df4217e-b5e2-4b6d-8238-628f5f776e02","Type":"ContainerStarted","Data":"741ddd4e0be13c09103ffd9eaabc9c6596f9bdcef1f0b495f28eb3f09197dfc5"}
Jul 27 18:32:55.205057 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.205007    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn" podStartSLOduration=99.204994184 podStartE2EDuration="1m39.204994184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:55.204838354 +0000 UTC m=+99.957632787" watchObservedRunningTime="2026-07-27 18:32:55.204994184 +0000 UTC m=+99.957788604"
Jul 27 18:32:55.376104 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.376016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:55.500284 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.500250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:55.691598 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.691549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:55.913180 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.913149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:55.991788 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:55.991679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:56.192837 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:56.192785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xkv5j" event={"ID":"9df4217e-b5e2-4b6d-8238-628f5f776e02","Type":"ContainerStarted","Data":"0214d525f24767ad3bedb0dad8783eeff2cc5d35694bb78059fe22e6a1846f12"}
Jul 27 18:32:56.193009 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:56.192864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xkv5j" event={"ID":"9df4217e-b5e2-4b6d-8238-628f5f776e02","Type":"ContainerStarted","Data":"2b0a1453392a308ca857e293d61b608bb1e07c77ef8541036d0ebd97f431f77c"}
Jul 27 18:32:56.212318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:56.212261    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xkv5j" podStartSLOduration=64.707219489 podStartE2EDuration="1m6.212246166s" totalImagesPullingTime="1.505026677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:56.211434007 +0000 UTC m=+100.964228450" watchObservedRunningTime="2026-07-27 18:32:56.212246166 +0000 UTC m=+100.965040564"
Jul 27 18:32:56.296102 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:56.296009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:56.730937 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:56.730903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:56.963037 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:56.963006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:57.089198 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:57.089167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:57.197906 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:57.197862    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk" event={"ID":"6e86a4e6-420f-4283-9360-d7e11df22dcf","Type":"ContainerStarted","Data":"b1f8ceada94240a6490f8311e70cdb477dd8b85e3a21ced1b3d821f8e3df09af"}
Jul 27 18:32:57.198075 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:57.197931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk" event={"ID":"6e86a4e6-420f-4283-9360-d7e11df22dcf","Type":"ContainerStarted","Data":"c5e936a48d37442b4df6887aad265d75313f4f7f1d2c3ab81b972beb3bab97d7"}
Jul 27 18:32:57.198123 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:57.198101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:32:57.218170 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:57.218084    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8j2wk" podStartSLOduration=17.480790627 podStartE2EDuration="19.218069495s" totalImagesPullingTime="1.737278868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:32:57.217424058 +0000 UTC m=+101.970218492" watchObservedRunningTime="2026-07-27 18:32:57.218069495 +0000 UTC m=+101.970863952"
Jul 27 18:32:57.516266 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:57.516173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:57.721558 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:57.721524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:58.098887 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:58.098850    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mhdbk"
Jul 27 18:32:58.588046 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:58.587997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:58.719025 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:58.718985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:59.107632 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:59.107593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:59.301793 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:59.301729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:32:59.531642 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:32:59.531599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:07.203299 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:07.203270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xkv5j"
Jul 27 18:33:10.689065 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.689027    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cknmb"]
Jul 27 18:33:10.696138 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.696119    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.700050 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.700027    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 18:33:10.700050 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.700040    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-blrxc\""
Jul 27 18:33:10.700234 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.700028    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 18:33:10.700333 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.700320    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 18:33:10.700435 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.700382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 18:33:10.717599 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.717574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cknmb"]
Jul 27 18:33:10.803924 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.803890    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"]
Jul 27 18:33:10.808815 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.808792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:10.812542 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.812521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2hs7x\""
Jul 27 18:33:10.812542 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.812533    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 18:33:10.813057 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.813040    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 18:33:10.813195 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.813096    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 18:33:10.813195 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.813138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 18:33:10.843752 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.843712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c727ac3-12c3-4601-ac01-2de59f4e13e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.843898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.843766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c727ac3-12c3-4601-ac01-2de59f4e13e0-crio-socket\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.843898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.843790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c727ac3-12c3-4601-ac01-2de59f4e13e0-data-volume\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.843898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.843853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c727ac3-12c3-4601-ac01-2de59f4e13e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.844003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.843905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jjms\" (UniqueName: \"kubernetes.io/projected/6c727ac3-12c3-4601-ac01-2de59f4e13e0-kube-api-access-6jjms\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.885900 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.885861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:10.908524 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.908489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"]
Jul 27 18:33:10.944514 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa9a6ad3-2488-4818-82de-2cea4140e79a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv\" (UID: \"fa9a6ad3-2488-4818-82de-2cea4140e79a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:10.944514 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c727ac3-12c3-4601-ac01-2de59f4e13e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.944734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c727ac3-12c3-4601-ac01-2de59f4e13e0-crio-socket\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.944734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c727ac3-12c3-4601-ac01-2de59f4e13e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.944734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jjms\" (UniqueName: \"kubernetes.io/projected/6c727ac3-12c3-4601-ac01-2de59f4e13e0-kube-api-access-6jjms\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.944734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7dpt\" (UniqueName: \"kubernetes.io/projected/fa9a6ad3-2488-4818-82de-2cea4140e79a-kube-api-access-f7dpt\") pod \"managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv\" (UID: \"fa9a6ad3-2488-4818-82de-2cea4140e79a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:10.944734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c727ac3-12c3-4601-ac01-2de59f4e13e0-data-volume\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.944734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.944708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c727ac3-12c3-4601-ac01-2de59f4e13e0-crio-socket\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.945081 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.945047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c727ac3-12c3-4601-ac01-2de59f4e13e0-data-volume\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.945138 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.945104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c727ac3-12c3-4601-ac01-2de59f4e13e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.947293 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.947258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c727ac3-12c3-4601-ac01-2de59f4e13e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:10.962555 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:10.962524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jjms\" (UniqueName: \"kubernetes.io/projected/6c727ac3-12c3-4601-ac01-2de59f4e13e0-kube-api-access-6jjms\") pod \"insights-runtime-extractor-cknmb\" (UID: \"6c727ac3-12c3-4601-ac01-2de59f4e13e0\") " pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:11.005729 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.005687    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cknmb"
Jul 27 18:33:11.045359 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.045319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7dpt\" (UniqueName: \"kubernetes.io/projected/fa9a6ad3-2488-4818-82de-2cea4140e79a-kube-api-access-f7dpt\") pod \"managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv\" (UID: \"fa9a6ad3-2488-4818-82de-2cea4140e79a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:11.045516 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.045368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa9a6ad3-2488-4818-82de-2cea4140e79a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv\" (UID: \"fa9a6ad3-2488-4818-82de-2cea4140e79a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:11.048002 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.047977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa9a6ad3-2488-4818-82de-2cea4140e79a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv\" (UID: \"fa9a6ad3-2488-4818-82de-2cea4140e79a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:11.068384 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.068317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7dpt\" (UniqueName: \"kubernetes.io/projected/fa9a6ad3-2488-4818-82de-2cea4140e79a-kube-api-access-f7dpt\") pod \"managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv\" (UID: \"fa9a6ad3-2488-4818-82de-2cea4140e79a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:11.129208 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.129176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"
Jul 27 18:33:11.180326 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.180301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cknmb"]
Jul 27 18:33:11.182886 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:33:11.182851    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c727ac3_12c3_4601_ac01_2de59f4e13e0.slice/crio-b33779bda1eb1146ef5e76fc2038c1755903addcc2c732042f01b59f22f08ae3 WatchSource:0}: Error finding container b33779bda1eb1146ef5e76fc2038c1755903addcc2c732042f01b59f22f08ae3: Status 404 returned error can't find the container with id b33779bda1eb1146ef5e76fc2038c1755903addcc2c732042f01b59f22f08ae3
Jul 27 18:33:11.247788 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.247705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cknmb" event={"ID":"6c727ac3-12c3-4601-ac01-2de59f4e13e0","Type":"ContainerStarted","Data":"b33779bda1eb1146ef5e76fc2038c1755903addcc2c732042f01b59f22f08ae3"}
Jul 27 18:33:11.271474 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.271326    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv"]
Jul 27 18:33:11.273892 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:33:11.273869    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa9a6ad3_2488_4818_82de_2cea4140e79a.slice/crio-bc1a95ef62674b28b1e97cb66353616771ae3c086812e3629942938b876f46ee WatchSource:0}: Error finding container bc1a95ef62674b28b1e97cb66353616771ae3c086812e3629942938b876f46ee: Status 404 returned error can't find the container with id bc1a95ef62674b28b1e97cb66353616771ae3c086812e3629942938b876f46ee
Jul 27 18:33:11.519997 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:11.519912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:12.255163 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:12.254867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv" event={"ID":"fa9a6ad3-2488-4818-82de-2cea4140e79a","Type":"ContainerStarted","Data":"bc1a95ef62674b28b1e97cb66353616771ae3c086812e3629942938b876f46ee"}
Jul 27 18:33:13.792804 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:13.792770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:14.000069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.000033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:14.104144 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.104058    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"]
Jul 27 18:33:14.106429 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.106409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:14.112164 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.112139    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kjjgp\""
Jul 27 18:33:14.112316 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.112245    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 18:33:14.125470 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.125444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"]
Jul 27 18:33:14.273607 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.273566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e801566-d2c6-4032-8673-3d3585d3e5b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-s6v72\" (UID: \"7e801566-d2c6-4032-8673-3d3585d3e5b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:14.330565 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.330528    2578 patch_prober.go:28] interesting pod/image-registry-79485dbbb7-ls6nn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 18:33:14.330758 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.330593    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn" podUID="337679c5-c2a4-4a33-802b-82cbdf0ba04f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:33:14.374925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.374855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e801566-d2c6-4032-8673-3d3585d3e5b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-s6v72\" (UID: \"7e801566-d2c6-4032-8673-3d3585d3e5b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:14.375079 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:33:14.374989    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 18:33:14.375079 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:33:14.375058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e801566-d2c6-4032-8673-3d3585d3e5b0-tls-certificates podName:7e801566-d2c6-4032-8673-3d3585d3e5b0 nodeName:}" failed. No retries permitted until 2026-07-27 18:33:14.875043228 +0000 UTC m=+119.627837627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7e801566-d2c6-4032-8673-3d3585d3e5b0-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-s6v72" (UID: "7e801566-d2c6-4032-8673-3d3585d3e5b0") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 18:33:14.544878 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.544837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:14.677324 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.677279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:14.878621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.878586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e801566-d2c6-4032-8673-3d3585d3e5b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-s6v72\" (UID: \"7e801566-d2c6-4032-8673-3d3585d3e5b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:14.881543 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:14.881512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e801566-d2c6-4032-8673-3d3585d3e5b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-s6v72\" (UID: \"7e801566-d2c6-4032-8673-3d3585d3e5b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:15.016614 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:15.016528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:16.197965 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:16.197932    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:33:16.489817 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:16.489772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:16.563528 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:16.563493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:16.897138 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:33:16.897105    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e801566_d2c6_4032_8673_3d3585d3e5b0.slice/crio-ccdd97ba34c9a43e90ed878483c5000d6b5c99d143f7e320a20f7efe33b012bf WatchSource:0}: Error finding container ccdd97ba34c9a43e90ed878483c5000d6b5c99d143f7e320a20f7efe33b012bf: Status 404 returned error can't find the container with id ccdd97ba34c9a43e90ed878483c5000d6b5c99d143f7e320a20f7efe33b012bf
Jul 27 18:33:16.900209 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:16.900160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"]
Jul 27 18:33:17.273983 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:17.273951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cknmb" event={"ID":"6c727ac3-12c3-4601-ac01-2de59f4e13e0","Type":"ContainerStarted","Data":"53d53dfb7bbb017bd0e82d4c9576d6bbd3bfaee77ba4692f87f3bccdb4980e9d"}
Jul 27 18:33:17.275342 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:17.275314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv" event={"ID":"fa9a6ad3-2488-4818-82de-2cea4140e79a","Type":"ContainerStarted","Data":"322a54e6c4a29682a59f627b8ad394c83972f6a222a6b685988caf787994ee52"}
Jul 27 18:33:17.276406 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:17.276384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72" event={"ID":"7e801566-d2c6-4032-8673-3d3585d3e5b0","Type":"ContainerStarted","Data":"ccdd97ba34c9a43e90ed878483c5000d6b5c99d143f7e320a20f7efe33b012bf"}
Jul 27 18:33:17.291701 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:17.291654    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bdb8c769b-gzjzv" podStartSLOduration=1.8109056369999998 podStartE2EDuration="7.291640878s" totalImagesPullingTime="5.480735241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:17.29130888 +0000 UTC m=+122.044103301" watchObservedRunningTime="2026-07-27 18:33:17.291640878 +0000 UTC m=+122.044435299"
Jul 27 18:33:17.515311 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:17.515277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:17.590428 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:17.590334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:18.282599 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:18.282450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72" event={"ID":"7e801566-d2c6-4032-8673-3d3585d3e5b0","Type":"ContainerStarted","Data":"cac10aacfb2c12af2e3304a0f83d013cab806e49b56c82ab9043629818c7b09e"}
Jul 27 18:33:18.300250 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:18.300178    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72" podStartSLOduration=3.288722737 podStartE2EDuration="4.300157979s" totalImagesPullingTime="1.011435242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:18.299935691 +0000 UTC m=+123.052730111" watchObservedRunningTime="2026-07-27 18:33:18.300157979 +0000 UTC m=+123.052952380"
Jul 27 18:33:19.286349 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:19.286318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:19.291770 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:19.291710    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-s6v72"
Jul 27 18:33:19.913892 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:19.913846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:20.010762 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:20.010713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:20.094431 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:20.094398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:20.172804 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:20.172713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:20.435135 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:20.435006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:21.294679 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:21.294596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cknmb" event={"ID":"6c727ac3-12c3-4601-ac01-2de59f4e13e0","Type":"ContainerStarted","Data":"3fec01bea9131c4814e13e02998c525ce5d24f8ec652b0e88785856159eb187d"}
Jul 27 18:33:22.042462 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:22.042410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:22.185635 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:22.185599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:22.296839 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:22.296636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:22.985584 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:22.985545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:24.289171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.289117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:24.536266 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.536230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:24.649285 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.649250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:24.689726 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.689673    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bdvsb"]
Jul 27 18:33:24.693003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.692984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.695721 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.695702    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 18:33:24.695857 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.695702    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 18:33:24.695857 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.695703    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4q95x\""
Jul 27 18:33:24.696047 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.696028    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 18:33:24.696121 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.696037    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 18:33:24.696825 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.696799    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 18:33:24.697129 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.697088    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 18:33:24.740086 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.740053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:24.825223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.825139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:24.867896 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.867859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-root\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.867900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-tls\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.867927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-wtmp\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.867955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dd006ff-488c-4726-8240-285e5eeb1039-metrics-client-ca\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.867986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.868006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-textfile\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.868026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-sys\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.868061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9ln\" (UniqueName: \"kubernetes.io/projected/3dd006ff-488c-4726-8240-285e5eeb1039-kube-api-access-rl9ln\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.868309 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.868087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-accelerators-collector-config\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.968851 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.968817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-root\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.968851 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.968853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-tls\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.968877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-wtmp\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.968898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dd006ff-488c-4726-8240-285e5eeb1039-metrics-client-ca\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.968936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.968960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-root\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.968970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-textfile\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:33:24.969009    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-sys\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-wtmp\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969083 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:33:24.969072    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-tls podName:3dd006ff-488c-4726-8240-285e5eeb1039 nodeName:}" failed. No retries permitted until 2026-07-27 18:33:25.469051557 +0000 UTC m=+130.221845976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-tls") pod "node-exporter-bdvsb" (UID: "3dd006ff-488c-4726-8240-285e5eeb1039") : secret "node-exporter-tls" not found
Jul 27 18:33:24.969562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dd006ff-488c-4726-8240-285e5eeb1039-sys\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9ln\" (UniqueName: \"kubernetes.io/projected/3dd006ff-488c-4726-8240-285e5eeb1039-kube-api-access-rl9ln\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-accelerators-collector-config\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-textfile\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969803 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dd006ff-488c-4726-8240-285e5eeb1039-metrics-client-ca\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.969803 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.969721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-accelerators-collector-config\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.971479 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.971463    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:24.997376 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:24.997345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9ln\" (UniqueName: \"kubernetes.io/projected/3dd006ff-488c-4726-8240-285e5eeb1039-kube-api-access-rl9ln\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:25.038669 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.038633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:25.139950 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.139914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:25.295861 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.295825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:25.311871 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.311840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cknmb" event={"ID":"6c727ac3-12c3-4601-ac01-2de59f4e13e0","Type":"ContainerStarted","Data":"e6893900903c69968f79c691d95b2a3a3199db9d991c3538ebc098efca2065d8"}
Jul 27 18:33:25.342285 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.342232    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cknmb" podStartSLOduration=2.074986201 podStartE2EDuration="15.342214796s" totalImagesPullingTime="13.267228595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:33:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:25.341340661 +0000 UTC m=+130.094135081" watchObservedRunningTime="2026-07-27 18:33:25.342214796 +0000 UTC m=+130.095009215"
Jul 27 18:33:25.473991 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.473894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-tls\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:25.476280 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.476256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dd006ff-488c-4726-8240-285e5eeb1039-node-exporter-tls\") pod \"node-exporter-bdvsb\" (UID: \"3dd006ff-488c-4726-8240-285e5eeb1039\") " pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:25.575105 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.575067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:33:25.577462 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.577443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf845a2-262b-48ee-9bac-2211c75c10f0-metrics-certs\") pod \"network-metrics-daemon-blpjc\" (UID: \"2cf845a2-262b-48ee-9bac-2211c75c10f0\") " pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:33:25.602754 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.602706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bdvsb"
Jul 27 18:33:25.614327 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:33:25.614301    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd006ff_488c_4726_8240_285e5eeb1039.slice/crio-5e00f3ee7f0d457d460fb74a729a22d5138e7088ba378d48077c627bad323ed6 WatchSource:0}: Error finding container 5e00f3ee7f0d457d460fb74a729a22d5138e7088ba378d48077c627bad323ed6: Status 404 returned error can't find the container with id 5e00f3ee7f0d457d460fb74a729a22d5138e7088ba378d48077c627bad323ed6
Jul 27 18:33:25.641828 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.641797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:25.756889 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.756818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wf8\""
Jul 27 18:33:25.762171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.762146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-blpjc"
Jul 27 18:33:25.793102 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.793069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:25.801019 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.800990    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:33:25.805820 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.805790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.813370 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.813306    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 18:33:25.814731 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.814451    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 18:33:25.815234 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.815025    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 18:33:25.817079 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.816791    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 18:33:25.820282 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.820081    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 18:33:25.820282 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.820083    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 18:33:25.826138 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.826111    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xdjkw\""
Jul 27 18:33:25.828995 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.828969    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 18:33:25.829386 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.829363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 18:33:25.830251 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.830227    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 18:33:25.837192 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.837060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:33:25.960038 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.960017    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-blpjc"]
Jul 27 18:33:25.961622 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:33:25.961594    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf845a2_262b_48ee_9bac_2211c75c10f0.slice/crio-8d1b648794b81e48f9984c92da198252046671ecb4e0047b749682eaa1a3d458 WatchSource:0}: Error finding container 8d1b648794b81e48f9984c92da198252046671ecb4e0047b749682eaa1a3d458: Status 404 returned error can't find the container with id 8d1b648794b81e48f9984c92da198252046671ecb4e0047b749682eaa1a3d458
Jul 27 18:33:25.979040 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-config-volume\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-config-out\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-web-config\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979484 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979484 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:25.979484 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:25.979392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqd4\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-kube-api-access-bsqd4\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.043782 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.043689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:26.080757 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.080708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.080925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.080772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.080925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.080807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.080925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.080830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-config-volume\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.080925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.080850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-config-out\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.080925 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.080877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.081181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.081019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-web-config\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.081181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.081062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.081181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.081102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.081181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.081123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqd4\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-kube-api-access-bsqd4\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.081181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.081161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.081436 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.081188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.081436 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.081237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.082587 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.082233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.082587 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.082555    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.082876 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.082849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.084585 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.084548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-config-volume\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.084998 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.084971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-config-out\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.085156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.085132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.085223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.085199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.085304 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.085281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.085518 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.085489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.085598 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.085542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-web-config\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.085694 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.085676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.086446 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.086425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.092132 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.092113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqd4\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-kube-api-access-bsqd4\") pod \"alertmanager-main-0\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.116525 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.116494    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:33:26.262541 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.262515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:33:26.263473 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:33:26.263440    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc135d2_7464_470d_8095_0839052a2008.slice/crio-d362bf9c670e6392bd421280d3918457c817c3a47f032b98256e958e99e6554f WatchSource:0}: Error finding container d362bf9c670e6392bd421280d3918457c817c3a47f032b98256e958e99e6554f: Status 404 returned error can't find the container with id d362bf9c670e6392bd421280d3918457c817c3a47f032b98256e958e99e6554f
Jul 27 18:33:26.316843 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.316761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerStarted","Data":"d362bf9c670e6392bd421280d3918457c817c3a47f032b98256e958e99e6554f"}
Jul 27 18:33:26.317816 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.317785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-blpjc" event={"ID":"2cf845a2-262b-48ee-9bac-2211c75c10f0","Type":"ContainerStarted","Data":"8d1b648794b81e48f9984c92da198252046671ecb4e0047b749682eaa1a3d458"}
Jul 27 18:33:26.318869 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:26.318850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdvsb" event={"ID":"3dd006ff-488c-4726-8240-285e5eeb1039","Type":"ContainerStarted","Data":"5e00f3ee7f0d457d460fb74a729a22d5138e7088ba378d48077c627bad323ed6"}
Jul 27 18:33:27.678395 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:27.678349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:27.799388 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:27.799356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:27.956898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:27.956862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:28.329636 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.329542    2578 generic.go:356] "Generic (PLEG): container finished" podID="3dd006ff-488c-4726-8240-285e5eeb1039" containerID="7d9d640ca2c311efe1178087022bccfc05e75fca3fefe0a1cd6ef34c0050a3bb" exitCode=0
Jul 27 18:33:28.329828 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.329650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdvsb" event={"ID":"3dd006ff-488c-4726-8240-285e5eeb1039","Type":"ContainerDied","Data":"7d9d640ca2c311efe1178087022bccfc05e75fca3fefe0a1cd6ef34c0050a3bb"}
Jul 27 18:33:28.331582 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.331554    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fc135d2-7464-470d-8095-0839052a2008" containerID="4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6" exitCode=0
Jul 27 18:33:28.331691 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.331632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6"}
Jul 27 18:33:28.333483 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.333462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-blpjc" event={"ID":"2cf845a2-262b-48ee-9bac-2211c75c10f0","Type":"ContainerStarted","Data":"b63f50407622584b554d348eb7af5fe8bbb250fc9ca1ca23ce3902b38fc6df5c"}
Jul 27 18:33:28.333577 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.333496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-blpjc" event={"ID":"2cf845a2-262b-48ee-9bac-2211c75c10f0","Type":"ContainerStarted","Data":"fe12ba49239a6259e1c3f9c7592cc9ad875eb6c7edadb3593f85aa035d10b859"}
Jul 27 18:33:28.386170 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.386128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:28.781354 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.781317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:28.881686 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:28.881654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:29.052618 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.052521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:29.192169 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.192137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:29.323238 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.323154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:29.341090 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.341045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdvsb" event={"ID":"3dd006ff-488c-4726-8240-285e5eeb1039","Type":"ContainerStarted","Data":"2aac90ff6efe3aa16e74674833a2c15054821ebd7e2eb9f6c6ee00c68103d6d4"}
Jul 27 18:33:29.341267 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.341111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdvsb" event={"ID":"3dd006ff-488c-4726-8240-285e5eeb1039","Type":"ContainerStarted","Data":"bc3cd45775d7440ef95fa07741276fd787d6fc4c452c0c1a656b9d6a0ee40198"}
Jul 27 18:33:29.373070 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.372943    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bdvsb" podStartSLOduration=3.112333154 podStartE2EDuration="5.372925188s" totalImagesPullingTime="2.172357057s" totalInitContainerRuntime="88.234977ms" isStatefulPod=true podCreationTimestamp="2026-07-27 18:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:29.372555387 +0000 UTC m=+134.125349824" watchObservedRunningTime="2026-07-27 18:33:29.372925188 +0000 UTC m=+134.125719608"
Jul 27 18:33:29.373909 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.373856    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-blpjc" podStartSLOduration=131.544880021 podStartE2EDuration="2m13.373839314s" totalImagesPullingTime="1.828959293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:28.563415004 +0000 UTC m=+133.316209424" watchObservedRunningTime="2026-07-27 18:33:29.373839314 +0000 UTC m=+134.126633736"
Jul 27 18:33:29.921372 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:29.921339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:30.347687 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:30.347602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerStarted","Data":"d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8"}
Jul 27 18:33:30.347687 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:30.347672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerStarted","Data":"b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3"}
Jul 27 18:33:30.347878 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:30.347699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerStarted","Data":"a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568"}
Jul 27 18:33:30.347878 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:30.347730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerStarted","Data":"b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f"}
Jul 27 18:33:30.347878 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:30.347791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerStarted","Data":"c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db"}
Jul 27 18:33:30.999644 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:30.999612    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:33:31.003312 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.003295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.006322 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.006292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:31.007114 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.007096    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 18:33:31.007227 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.007097    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 18:33:31.008349 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.008330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 18:33:31.008734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.008716    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 18:33:31.008841 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.008720    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 18:33:31.009020 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 18:33:31.009104 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009084    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 18:33:31.009875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009277    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 18:33:31.009875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 18:33:31.009875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 18:33:31.009875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 18:33:31.009875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009557    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lbqz7\""
Jul 27 18:33:31.009875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009580    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 18:33:31.010239 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.009994    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-62qq70i773dn3\""
Jul 27 18:33:31.010239 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.010149    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 18:33:31.016999 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.016973    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 18:33:31.017544 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.017526    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 18:33:31.024701 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024827 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024827 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024827 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-web-config\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024827 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config-out\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4b99\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-kube-api-access-f4b99\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.024967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.024985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.025052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.025089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.025163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.025194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.025227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.025252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.025295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.025278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.031178 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.031157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:33:31.126193 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config-out\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126193 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126383 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126383 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4b99\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-kube-api-access-f4b99\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126383 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126494 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126494 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126494 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126630 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126630 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126630 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126630 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126630 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-web-config\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.126922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.127313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.126924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.127313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.127106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.127313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.127167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.127313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.127278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.129534 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.128025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.129534 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.128254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.129534 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.128932    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.129841 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.129700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config-out\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.130580 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.130156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.130580 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.130253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.130580 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.130542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.131439 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.131404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.131606 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.131587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.132265 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.132235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.132369 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.132296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-web-config\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.132453 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.132435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.133098 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.133066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.133309 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.133292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.134060 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.134041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.135482 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.135457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4b99\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-kube-api-access-f4b99\") pod \"prometheus-k8s-0\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.315129 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.315035    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:31.355009 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.354978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerStarted","Data":"27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548"}
Jul 27 18:33:31.385287 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.385229    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.391525025 podStartE2EDuration="6.385212462s" totalImagesPullingTime="3.970934763s" totalInitContainerRuntime="22.752674ms" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:31.382303539 +0000 UTC m=+136.135098026" watchObservedRunningTime="2026-07-27 18:33:31.385212462 +0000 UTC m=+136.138006882"
Jul 27 18:33:31.467936 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:31.467906    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:33:31.470133 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:33:31.470104    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a0fc2f_daba_4edc_9bf7_7a871e351b74.slice/crio-5023b77b5bbdb36fd93fa2d473c492b595069727de7f7a9c19acdb007d042dd1 WatchSource:0}: Error finding container 5023b77b5bbdb36fd93fa2d473c492b595069727de7f7a9c19acdb007d042dd1: Status 404 returned error can't find the container with id 5023b77b5bbdb36fd93fa2d473c492b595069727de7f7a9c19acdb007d042dd1
Jul 27 18:33:32.360077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:32.360040    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66" exitCode=0
Jul 27 18:33:32.360576 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:32.360136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"}
Jul 27 18:33:32.360576 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:32.360222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerStarted","Data":"5023b77b5bbdb36fd93fa2d473c492b595069727de7f7a9c19acdb007d042dd1"}
Jul 27 18:33:32.903178 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:32.903133    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79485dbbb7-ls6nn"]
Jul 27 18:33:33.002476 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:33.002446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:33.101842 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:33.101801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:36.381385 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:36.381346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerStarted","Data":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"}
Jul 27 18:33:36.381796 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:36.381422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerStarted","Data":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"}
Jul 27 18:33:36.539415 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:36.539365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:36.642566 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:36.642521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:38.392528 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:38.392491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerStarted","Data":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"}
Jul 27 18:33:38.392922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:38.392571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerStarted","Data":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"}
Jul 27 18:33:38.392922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:38.392616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerStarted","Data":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"}
Jul 27 18:33:38.392922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:38.392652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerStarted","Data":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"}
Jul 27 18:33:38.433687 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:38.433623    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.195522197 podStartE2EDuration="8.433606815s" totalImagesPullingTime="5.218810071s" totalInitContainerRuntime="19.274547ms" isStatefulPod=false podCreationTimestamp="2026-07-27 18:33:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:33:38.433295434 +0000 UTC m=+143.186089882" watchObservedRunningTime="2026-07-27 18:33:38.433606815 +0000 UTC m=+143.186401236"
Jul 27 18:33:38.727057 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:38.726956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:38.818082 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:38.818006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.040491 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.040394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.169045 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.168985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.243710 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.243673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.360018 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.359933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.460442 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.460398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.575276 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.575234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.695760 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.695720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:39.818025 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:39.817991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:40.196511 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:40.196479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:40.303172 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:40.303093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:40.616481 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:40.616392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:40.796162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:40.796127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:40.909843 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:40.909802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:41.315458 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:41.315373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:41.348119 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:41.348083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:41.449151 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:41.449117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:41.604111 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:41.604000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:41.727927 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:41.727880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:42.603423 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:42.603388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:42.688526 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:42.688479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:46.081139 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:46.081108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:46.140430 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:46.140395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:46.427617 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:46.427583    2578 generic.go:356] "Generic (PLEG): container finished" podID="0b58bec9-93ad-4185-b0bd-04cb45a93568" containerID="4632af68df7cb13eec5c9302863a7fb54422ac6c5d03d5feab7f7d5a64f82378" exitCode=0
Jul 27 18:33:46.427798 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:46.427643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr" event={"ID":"0b58bec9-93ad-4185-b0bd-04cb45a93568","Type":"ContainerDied","Data":"4632af68df7cb13eec5c9302863a7fb54422ac6c5d03d5feab7f7d5a64f82378"}
Jul 27 18:33:46.427981 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:46.427966    2578 scope.go:117] "RemoveContainer" containerID="4632af68df7cb13eec5c9302863a7fb54422ac6c5d03d5feab7f7d5a64f82378"
Jul 27 18:33:47.434603 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:47.434569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fvlwr" event={"ID":"0b58bec9-93ad-4185-b0bd-04cb45a93568","Type":"ContainerStarted","Data":"762baeb190298787f0af2f3e05d0b206bf84545f665841e1f39541a22d55adec"}
Jul 27 18:33:50.204349 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:50.204314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:50.267046 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:50.267014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:52.597290 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:52.597254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:52.656426 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:52.656374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:55.787942 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:55.787891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:55.843812 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:55.843774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:57.614814 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:57.614780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:57.683570 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:57.683519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:57.925064 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:57.925028    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn" podUID="337679c5-c2a4-4a33-802b-82cbdf0ba04f" containerName="registry" containerID="cri-o://e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092" gracePeriod=30
Jul 27 18:33:58.159516 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.159493    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:33:58.265455 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265361    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-trusted-ca\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.265455 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265405    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337679c5-c2a4-4a33-802b-82cbdf0ba04f-ca-trust-extracted\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.265455 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265433    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-bound-sa-token\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.265455 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.265814 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265465    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-kube-api-access-g26w9\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.265814 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-installation-pull-secrets\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.265814 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265517    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-image-registry-private-configuration\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.265814 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-certificates\") pod \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\" (UID: \"337679c5-c2a4-4a33-802b-82cbdf0ba04f\") "
Jul 27 18:33:58.266020 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.265845    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:33:58.266192 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.266165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:33:58.268487 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.268446    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:33:58.268619 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.268495    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:33:58.268619 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.268518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:33:58.268804 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.268778    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:33:58.268992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.268971    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-kube-api-access-g26w9" (OuterVolumeSpecName: "kube-api-access-g26w9") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "kube-api-access-g26w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:33:58.273663 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.273642    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337679c5-c2a4-4a33-802b-82cbdf0ba04f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "337679c5-c2a4-4a33-802b-82cbdf0ba04f" (UID: "337679c5-c2a4-4a33-802b-82cbdf0ba04f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:33:58.366960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.366923    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-trusted-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.366960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.366951    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337679c5-c2a4-4a33-802b-82cbdf0ba04f-ca-trust-extracted\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.366960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.366963    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-bound-sa-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.366960 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.366972    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.367221 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.366980    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g26w9\" (UniqueName: \"kubernetes.io/projected/337679c5-c2a4-4a33-802b-82cbdf0ba04f-kube-api-access-g26w9\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.367221 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.366988    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-installation-pull-secrets\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.367221 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.366997    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337679c5-c2a4-4a33-802b-82cbdf0ba04f-image-registry-private-configuration\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.367221 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.367005    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337679c5-c2a4-4a33-802b-82cbdf0ba04f-registry-certificates\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:33:58.474531 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.474499    2578 generic.go:356] "Generic (PLEG): container finished" podID="337679c5-c2a4-4a33-802b-82cbdf0ba04f" containerID="e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092" exitCode=0
Jul 27 18:33:58.474702 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.474543    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn"
Jul 27 18:33:58.474702 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.474558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn" event={"ID":"337679c5-c2a4-4a33-802b-82cbdf0ba04f","Type":"ContainerDied","Data":"e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092"}
Jul 27 18:33:58.474702 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.474600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79485dbbb7-ls6nn" event={"ID":"337679c5-c2a4-4a33-802b-82cbdf0ba04f","Type":"ContainerDied","Data":"2ffcd29e600915d2dad6c40b0891ed65dd5683d6198348548223b8ff8b968d1f"}
Jul 27 18:33:58.474702 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.474632    2578 scope.go:117] "RemoveContainer" containerID="e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092"
Jul 27 18:33:58.483349 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.483333    2578 scope.go:117] "RemoveContainer" containerID="e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092"
Jul 27 18:33:58.483718 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:33:58.483691    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092\": container with ID starting with e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092 not found: ID does not exist" containerID="e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092"
Jul 27 18:33:58.483844 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.483724    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092"} err="failed to get container status \"e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092\": rpc error: code = NotFound desc = could not find container \"e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092\": container with ID starting with e7d97f3851958ba90109ac9346e9d5f64c83f4969118807a378b0f87fe784092 not found: ID does not exist"
Jul 27 18:33:58.498971 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.498941    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79485dbbb7-ls6nn"]
Jul 27 18:33:58.502905 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:58.502880    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79485dbbb7-ls6nn"]
Jul 27 18:33:59.213166 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:59.213130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:59.311407 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:59.311371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:33:59.844412 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:33:59.844370    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337679c5-c2a4-4a33-802b-82cbdf0ba04f" path="/var/lib/kubelet/pods/337679c5-c2a4-4a33-802b-82cbdf0ba04f/volumes"
Jul 27 18:34:02.005007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:02.004977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:02.065116 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:02.065083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:04.206649 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:04.206615    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:04.272270 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:04.272241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:05.214213 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:05.214183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:05.351912 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:05.351873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:09.664024 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:09.663930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:10.894315 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:10.894278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:11.010729 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:11.010691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:26.069283 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:26.069241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:26.253755 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:26.253713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:31.315624 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:31.315585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:31.336049 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:31.336012    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:31.618174 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:31.618085    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:40.846285 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:40.846249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:40.921977 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:40.921945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:45.122622 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.122582    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:34:45.123093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.122880    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="alertmanager" containerID="cri-o://c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db" gracePeriod=120
Jul 27 18:34:45.123093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.122979    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-web" containerID="cri-o://a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568" gracePeriod=120
Jul 27 18:34:45.123093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.123006    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="prom-label-proxy" containerID="cri-o://27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548" gracePeriod=120
Jul 27 18:34:45.123093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.123009    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="config-reloader" containerID="cri-o://b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f" gracePeriod=120
Jul 27 18:34:45.123093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.123033    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy" containerID="cri-o://b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3" gracePeriod=120
Jul 27 18:34:45.123093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.122949    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-metric" containerID="cri-o://d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8" gracePeriod=120
Jul 27 18:34:45.656443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656405    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fc135d2-7464-470d-8095-0839052a2008" containerID="27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548" exitCode=0
Jul 27 18:34:45.656443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656431    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fc135d2-7464-470d-8095-0839052a2008" containerID="d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8" exitCode=0
Jul 27 18:34:45.656443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656437    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fc135d2-7464-470d-8095-0839052a2008" containerID="b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3" exitCode=0
Jul 27 18:34:45.656443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656443    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fc135d2-7464-470d-8095-0839052a2008" containerID="b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f" exitCode=0
Jul 27 18:34:45.656443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656449    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fc135d2-7464-470d-8095-0839052a2008" containerID="c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db" exitCode=0
Jul 27 18:34:45.656867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548"}
Jul 27 18:34:45.656867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8"}
Jul 27 18:34:45.656867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3"}
Jul 27 18:34:45.656867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f"}
Jul 27 18:34:45.656867 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:45.656766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db"}
Jul 27 18:34:46.219635 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.219600    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc135d2_7464_470d_8095_0839052a2008.slice/crio-conmon-a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568.scope\": RecentStats: unable to find data in memory cache]"
Jul 27 18:34:46.362827 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.362799    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.435024 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.434944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435183 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-config-volume\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435183 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435095    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-config-out\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435183 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435134    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-web-config\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435183 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-main-db\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435199    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-metrics-client-ca\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435274    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-tls-assets\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435300    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-main-tls\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435328    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-cluster-tls-config\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435360    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-trusted-ca-bundle\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435897 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435407    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsqd4\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-kube-api-access-bsqd4\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.435897 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.435445    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-web\") pod \"4fc135d2-7464-470d-8095-0839052a2008\" (UID: \"4fc135d2-7464-470d-8095-0839052a2008\") "
Jul 27 18:34:46.437081 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.436190    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:34:46.437081 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.436638    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:46.437081 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.437026    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:46.440077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.439984    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-config-volume" (OuterVolumeSpecName: "config-volume") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:46.440077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.440002    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-config-out" (OuterVolumeSpecName: "config-out") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:34:46.440077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.440025    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:46.440077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.440046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:46.440077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.440069    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:46.440442 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.440170    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:46.440754 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.440683    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:34:46.441458 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.441434    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-kube-api-access-bsqd4" (OuterVolumeSpecName: "kube-api-access-bsqd4") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "kube-api-access-bsqd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:34:46.443883 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.443861    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:46.449201 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.449180    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-web-config" (OuterVolumeSpecName: "web-config") pod "4fc135d2-7464-470d-8095-0839052a2008" (UID: "4fc135d2-7464-470d-8095-0839052a2008"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:46.536482 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536448    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536482 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536478    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-tls-assets\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536482 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536489    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-main-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536498    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-cluster-tls-config\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536507    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536515    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsqd4\" (UniqueName: \"kubernetes.io/projected/4fc135d2-7464-470d-8095-0839052a2008-kube-api-access-bsqd4\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536524    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536532    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536540    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536549    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-config-out\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536557    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fc135d2-7464-470d-8095-0839052a2008-web-config\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536564    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fc135d2-7464-470d-8095-0839052a2008-alertmanager-main-db\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.536689 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.536571    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc135d2-7464-470d-8095-0839052a2008-metrics-client-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:46.663934 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.663886    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fc135d2-7464-470d-8095-0839052a2008" containerID="a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568" exitCode=0
Jul 27 18:34:46.664111 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.663979    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.664111 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.663968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568"}
Jul 27 18:34:46.664198 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.664124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fc135d2-7464-470d-8095-0839052a2008","Type":"ContainerDied","Data":"d362bf9c670e6392bd421280d3918457c817c3a47f032b98256e958e99e6554f"}
Jul 27 18:34:46.664198 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.664157    2578 scope.go:117] "RemoveContainer" containerID="27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548"
Jul 27 18:34:46.672131 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.672114    2578 scope.go:117] "RemoveContainer" containerID="d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8"
Jul 27 18:34:46.679436 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.679418    2578 scope.go:117] "RemoveContainer" containerID="b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3"
Jul 27 18:34:46.686405 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.686384    2578 scope.go:117] "RemoveContainer" containerID="a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568"
Jul 27 18:34:46.692076 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.692016    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:34:46.694241 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.694227    2578 scope.go:117] "RemoveContainer" containerID="b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f"
Jul 27 18:34:46.702073 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.702056    2578 scope.go:117] "RemoveContainer" containerID="c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db"
Jul 27 18:34:46.702199 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.702181    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:34:46.709589 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.709568    2578 scope.go:117] "RemoveContainer" containerID="4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6"
Jul 27 18:34:46.716917 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.716902    2578 scope.go:117] "RemoveContainer" containerID="27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548"
Jul 27 18:34:46.717196 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.717176    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548\": container with ID starting with 27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548 not found: ID does not exist" containerID="27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548"
Jul 27 18:34:46.717248 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717205    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548"} err="failed to get container status \"27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548\": rpc error: code = NotFound desc = could not find container \"27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548\": container with ID starting with 27917d1099a9b426f869b87d13edb429b75bfbc7b9725bbab2a8d9d5dfb31548 not found: ID does not exist"
Jul 27 18:34:46.717248 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717224    2578 scope.go:117] "RemoveContainer" containerID="d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8"
Jul 27 18:34:46.717434 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.717419    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8\": container with ID starting with d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8 not found: ID does not exist" containerID="d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8"
Jul 27 18:34:46.717477 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717439    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8"} err="failed to get container status \"d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8\": rpc error: code = NotFound desc = could not find container \"d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8\": container with ID starting with d63a1dc57bd00180a8bb37c99fe9500a9a6b252c807cc8ce8fb32eae23b998a8 not found: ID does not exist"
Jul 27 18:34:46.717477 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717451    2578 scope.go:117] "RemoveContainer" containerID="b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3"
Jul 27 18:34:46.717647 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.717631    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3\": container with ID starting with b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3 not found: ID does not exist" containerID="b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3"
Jul 27 18:34:46.717683 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717651    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3"} err="failed to get container status \"b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3\": rpc error: code = NotFound desc = could not find container \"b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3\": container with ID starting with b2fce3d319e9262d737f6aef2715af1dc840013dbd95a179711f1a64e0456ec3 not found: ID does not exist"
Jul 27 18:34:46.717683 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717664    2578 scope.go:117] "RemoveContainer" containerID="a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568"
Jul 27 18:34:46.717872 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.717857    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568\": container with ID starting with a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568 not found: ID does not exist" containerID="a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568"
Jul 27 18:34:46.717922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717876    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568"} err="failed to get container status \"a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568\": rpc error: code = NotFound desc = could not find container \"a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568\": container with ID starting with a26d3527379576f9be072246ed4cdead80ecd38ec865fb2067ea311ce2613568 not found: ID does not exist"
Jul 27 18:34:46.717922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.717889    2578 scope.go:117] "RemoveContainer" containerID="b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f"
Jul 27 18:34:46.718097 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.718082    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f\": container with ID starting with b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f not found: ID does not exist" containerID="b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f"
Jul 27 18:34:46.718136 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.718101    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f"} err="failed to get container status \"b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f\": rpc error: code = NotFound desc = could not find container \"b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f\": container with ID starting with b5f80caa25a092256f577a96d6f0cc239caefed67ef5ddba95c95e621529755f not found: ID does not exist"
Jul 27 18:34:46.718136 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.718113    2578 scope.go:117] "RemoveContainer" containerID="c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db"
Jul 27 18:34:46.718316 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.718298    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db\": container with ID starting with c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db not found: ID does not exist" containerID="c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db"
Jul 27 18:34:46.718358 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.718322    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db"} err="failed to get container status \"c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db\": rpc error: code = NotFound desc = could not find container \"c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db\": container with ID starting with c9b2b6242b81b43debc2cdb33108ce67f42f2d017a7837258386a95675ef93db not found: ID does not exist"
Jul 27 18:34:46.718358 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.718338    2578 scope.go:117] "RemoveContainer" containerID="4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6"
Jul 27 18:34:46.718572 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:46.718553    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6\": container with ID starting with 4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6 not found: ID does not exist" containerID="4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6"
Jul 27 18:34:46.718614 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.718578    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6"} err="failed to get container status \"4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6\": rpc error: code = NotFound desc = could not find container \"4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6\": container with ID starting with 4258a955c6dd0eb3a1a8363a443e2da15987dc19c4024d1afc5496f2cf569eb6 not found: ID does not exist"
Jul 27 18:34:46.781060 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.781032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:46.828894 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.828860    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:34:46.829140 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829128    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="init-config-reloader"
Jul 27 18:34:46.829181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829143    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="init-config-reloader"
Jul 27 18:34:46.829181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829152    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-web"
Jul 27 18:34:46.829181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829163    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-web"
Jul 27 18:34:46.829181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829177    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="alertmanager"
Jul 27 18:34:46.829181 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829182    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="alertmanager"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829195    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="config-reloader"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829200    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="config-reloader"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829207    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829213    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829218    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337679c5-c2a4-4a33-802b-82cbdf0ba04f" containerName="registry"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829223    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="337679c5-c2a4-4a33-802b-82cbdf0ba04f" containerName="registry"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829234    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="prom-label-proxy"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829243    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="prom-label-proxy"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829252    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-metric"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829257    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-metric"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829299    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="config-reloader"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829307    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="337679c5-c2a4-4a33-802b-82cbdf0ba04f" containerName="registry"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829313    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-web"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829324    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy"
Jul 27 18:34:46.829327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829333    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="alertmanager"
Jul 27 18:34:46.829724 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829339    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="kube-rbac-proxy-metric"
Jul 27 18:34:46.829724 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.829344    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc135d2-7464-470d-8095-0839052a2008" containerName="prom-label-proxy"
Jul 27 18:34:46.832993 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.832976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.836128 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 18:34:46.836271 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 18:34:46.836271 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 18:34:46.836271 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 18:34:46.836271 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 18:34:46.836271 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 18:34:46.836617 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 18:34:46.836617 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836099    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xdjkw\""
Jul 27 18:34:46.836617 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.836104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 18:34:46.842212 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.842191    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 18:34:46.849235 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.849212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:34:46.938842 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.938790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-config-out\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.938842 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.938848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939055 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.938907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939055 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.938959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939055 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.938993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-web-config\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939055 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939055 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:46.939206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:46.939205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2t2j\" (UniqueName: \"kubernetes.io/projected/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-kube-api-access-r2t2j\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.039811 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.039705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.039811 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.039754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.039811 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.039771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.039811 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.039796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040150 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.039956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040150 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2t2j\" (UniqueName: \"kubernetes.io/projected/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-kube-api-access-r2t2j\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040150 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-config-out\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040150 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040150 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040388 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040388 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-web-config\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040388 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040388 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.040952 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.040920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.041604 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.041579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.042482 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.042451    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.042584 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.042549    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.043023 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.042991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.043272 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.043071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.043272 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.043095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.043398 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.043376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.043690 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.043664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.044568 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.044548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-web-config\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.044695 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.044678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.044735 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.044704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-config-out\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.051026 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.051003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2t2j\" (UniqueName: \"kubernetes.io/projected/48b07cac-468f-4fc5-8d71-10b42e6bb5d7-kube-api-access-r2t2j\") pod \"alertmanager-main-0\" (UID: \"48b07cac-468f-4fc5-8d71-10b42e6bb5d7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.142590 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.142560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 18:34:47.284760 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.284714    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 18:34:47.286904 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:34:47.286874    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b07cac_468f_4fc5_8d71_10b42e6bb5d7.slice/crio-07fc73d642d65c00d8491e1f4c5aff27320c214906c5eac289661c3108ed7617 WatchSource:0}: Error finding container 07fc73d642d65c00d8491e1f4c5aff27320c214906c5eac289661c3108ed7617: Status 404 returned error can't find the container with id 07fc73d642d65c00d8491e1f4c5aff27320c214906c5eac289661c3108ed7617
Jul 27 18:34:47.349926 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.349772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:47.669553 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.669519    2578 generic.go:356] "Generic (PLEG): container finished" podID="48b07cac-468f-4fc5-8d71-10b42e6bb5d7" containerID="09cd9a0f14ee1f14f4393f3eb15ca775f3dd45457916e369e4b2223fa2dafc0b" exitCode=0
Jul 27 18:34:47.669789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.669610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerDied","Data":"09cd9a0f14ee1f14f4393f3eb15ca775f3dd45457916e369e4b2223fa2dafc0b"}
Jul 27 18:34:47.669789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.669701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerStarted","Data":"07fc73d642d65c00d8491e1f4c5aff27320c214906c5eac289661c3108ed7617"}
Jul 27 18:34:47.846153 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:47.846128    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fc135d2-7464-470d-8095-0839052a2008" path="/var/lib/kubelet/pods/4fc135d2-7464-470d-8095-0839052a2008/volumes"
Jul 27 18:34:48.677862 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:48.677715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerStarted","Data":"7b072500a8a6ee11ecaffc002ba03e5ccf4f39abbf4c354d7ed1a2eeb22dcbdd"}
Jul 27 18:34:48.677862 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:48.677808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerStarted","Data":"bdbb79197933ac9a7db0269fc8cf9347bc0522c4a7643e2c9c70a5725e844d4f"}
Jul 27 18:34:48.677862 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:48.677837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerStarted","Data":"4e16907995719d2eb52b9d2e73d925b1eb8d5bd6e033b165e99b96f13585ef6f"}
Jul 27 18:34:48.677862 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:48.677863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerStarted","Data":"ba4f7ca82a8b754de2f3dc6db90c18e55068dc04b332c814bdb0e21e23246c1e"}
Jul 27 18:34:48.678332 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:48.677884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerStarted","Data":"53cbfcb9bdc4e6417974c35894f5e632630aa368db421fbdae03478793a3e5e7"}
Jul 27 18:34:48.678332 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:48.677909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b07cac-468f-4fc5-8d71-10b42e6bb5d7","Type":"ContainerStarted","Data":"8d152d373b09aec38e849aa7f6ed8d45a7c9b27e852e1014913ba01734cfcebf"}
Jul 27 18:34:48.705540 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:48.705482    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.689593293 podStartE2EDuration="2.705462s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.868707ms" isStatefulPod=false podCreationTimestamp="2026-07-27 18:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:34:48.704111585 +0000 UTC m=+213.456906004" watchObservedRunningTime="2026-07-27 18:34:48.705462 +0000 UTC m=+213.458256423"
Jul 27 18:34:49.381418 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.381389    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:34:49.381711 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.381671    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="prometheus" containerID="cri-o://a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635" gracePeriod=600
Jul 27 18:34:49.381711 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.381692    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy" containerID="cri-o://d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357" gracePeriod=600
Jul 27 18:34:49.381931 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.381719    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="thanos-sidecar" containerID="cri-o://c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78" gracePeriod=600
Jul 27 18:34:49.381931 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.381721    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="config-reloader" containerID="cri-o://2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599" gracePeriod=600
Jul 27 18:34:49.382028 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.381735    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-web" containerID="cri-o://c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc" gracePeriod=600
Jul 27 18:34:49.382028 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.381774    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990" gracePeriod=600
Jul 27 18:34:49.633462 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.633441    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:49.687176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687138    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990" exitCode=0
Jul 27 18:34:49.687176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687175    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357" exitCode=0
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687186    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc" exitCode=0
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687195    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78" exitCode=0
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687202    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599" exitCode=0
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687210    2578 generic.go:356] "Generic (PLEG): container finished" podID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635" exitCode=0
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"}
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687242    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"}
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"}
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"}
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687383    2578 scope.go:117] "RemoveContainer" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"}
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"}
Jul 27 18:34:49.687621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.687453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a0fc2f-daba-4edc-9bf7-7a871e351b74","Type":"ContainerDied","Data":"5023b77b5bbdb36fd93fa2d473c492b595069727de7f7a9c19acdb007d042dd1"}
Jul 27 18:34:49.696991 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.696974    2578 scope.go:117] "RemoveContainer" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.704640 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.704622    2578 scope.go:117] "RemoveContainer" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.712130 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.712111    2578 scope.go:117] "RemoveContainer" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.719020 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.719001    2578 scope.go:117] "RemoveContainer" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.727671 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.727650    2578 scope.go:117] "RemoveContainer" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.735156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.735135    2578 scope.go:117] "RemoveContainer" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.742170 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.742148    2578 scope.go:117] "RemoveContainer" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.742441 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:49.742417    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": container with ID starting with cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990 not found: ID does not exist" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.742500 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.742452    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"} err="failed to get container status \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": rpc error: code = NotFound desc = could not find container \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": container with ID starting with cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990 not found: ID does not exist"
Jul 27 18:34:49.742500 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.742469    2578 scope.go:117] "RemoveContainer" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.742770 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:49.742734    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": container with ID starting with d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357 not found: ID does not exist" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.742849 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.742776    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"} err="failed to get container status \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": rpc error: code = NotFound desc = could not find container \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": container with ID starting with d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357 not found: ID does not exist"
Jul 27 18:34:49.742849 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.742797    2578 scope.go:117] "RemoveContainer" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.743042 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:49.743024    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": container with ID starting with c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc not found: ID does not exist" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.743111 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743051    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"} err="failed to get container status \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": rpc error: code = NotFound desc = could not find container \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": container with ID starting with c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc not found: ID does not exist"
Jul 27 18:34:49.743111 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743071    2578 scope.go:117] "RemoveContainer" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.743336 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:49.743320    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": container with ID starting with c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78 not found: ID does not exist" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.743373 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743341    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"} err="failed to get container status \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": rpc error: code = NotFound desc = could not find container \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": container with ID starting with c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78 not found: ID does not exist"
Jul 27 18:34:49.743373 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743354    2578 scope.go:117] "RemoveContainer" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.743550 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:49.743534    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": container with ID starting with 2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599 not found: ID does not exist" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.743588 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743555    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"} err="failed to get container status \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": rpc error: code = NotFound desc = could not find container \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": container with ID starting with 2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599 not found: ID does not exist"
Jul 27 18:34:49.743588 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743569    2578 scope.go:117] "RemoveContainer" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.743821 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:49.743805    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": container with ID starting with a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635 not found: ID does not exist" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.743891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743827    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"} err="failed to get container status \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": rpc error: code = NotFound desc = could not find container \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": container with ID starting with a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635 not found: ID does not exist"
Jul 27 18:34:49.743891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.743848    2578 scope.go:117] "RemoveContainer" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.744121 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:34:49.744104    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": container with ID starting with 9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66 not found: ID does not exist" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.744158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744125    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"} err="failed to get container status \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": rpc error: code = NotFound desc = could not find container \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": container with ID starting with 9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66 not found: ID does not exist"
Jul 27 18:34:49.744158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744147    2578 scope.go:117] "RemoveContainer" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.744360 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744344    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"} err="failed to get container status \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": rpc error: code = NotFound desc = could not find container \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": container with ID starting with cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990 not found: ID does not exist"
Jul 27 18:34:49.744399 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744360    2578 scope.go:117] "RemoveContainer" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.744581 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744563    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"} err="failed to get container status \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": rpc error: code = NotFound desc = could not find container \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": container with ID starting with d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357 not found: ID does not exist"
Jul 27 18:34:49.744646 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744582    2578 scope.go:117] "RemoveContainer" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.744855 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744838    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"} err="failed to get container status \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": rpc error: code = NotFound desc = could not find container \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": container with ID starting with c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc not found: ID does not exist"
Jul 27 18:34:49.744932 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.744855    2578 scope.go:117] "RemoveContainer" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.745082 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745063    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"} err="failed to get container status \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": rpc error: code = NotFound desc = could not find container \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": container with ID starting with c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78 not found: ID does not exist"
Jul 27 18:34:49.745131 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745083    2578 scope.go:117] "RemoveContainer" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.745265 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745247    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"} err="failed to get container status \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": rpc error: code = NotFound desc = could not find container \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": container with ID starting with 2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599 not found: ID does not exist"
Jul 27 18:34:49.745302 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745267    2578 scope.go:117] "RemoveContainer" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.745520 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745491    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"} err="failed to get container status \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": rpc error: code = NotFound desc = could not find container \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": container with ID starting with a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635 not found: ID does not exist"
Jul 27 18:34:49.745559 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745520    2578 scope.go:117] "RemoveContainer" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.745797 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745780    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"} err="failed to get container status \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": rpc error: code = NotFound desc = could not find container \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": container with ID starting with 9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66 not found: ID does not exist"
Jul 27 18:34:49.745869 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745799    2578 scope.go:117] "RemoveContainer" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.746014 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.745998    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"} err="failed to get container status \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": rpc error: code = NotFound desc = could not find container \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": container with ID starting with cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990 not found: ID does not exist"
Jul 27 18:34:49.746071 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746015    2578 scope.go:117] "RemoveContainer" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.746218 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746200    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"} err="failed to get container status \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": rpc error: code = NotFound desc = could not find container \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": container with ID starting with d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357 not found: ID does not exist"
Jul 27 18:34:49.746264 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746219    2578 scope.go:117] "RemoveContainer" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.746426 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746408    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"} err="failed to get container status \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": rpc error: code = NotFound desc = could not find container \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": container with ID starting with c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc not found: ID does not exist"
Jul 27 18:34:49.746498 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746427    2578 scope.go:117] "RemoveContainer" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.746646 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746630    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"} err="failed to get container status \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": rpc error: code = NotFound desc = could not find container \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": container with ID starting with c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78 not found: ID does not exist"
Jul 27 18:34:49.746705 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746648    2578 scope.go:117] "RemoveContainer" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.746859 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746842    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"} err="failed to get container status \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": rpc error: code = NotFound desc = could not find container \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": container with ID starting with 2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599 not found: ID does not exist"
Jul 27 18:34:49.746905 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.746859    2578 scope.go:117] "RemoveContainer" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.747076 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747058    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"} err="failed to get container status \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": rpc error: code = NotFound desc = could not find container \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": container with ID starting with a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635 not found: ID does not exist"
Jul 27 18:34:49.747137 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747078    2578 scope.go:117] "RemoveContainer" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.747324 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747306    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"} err="failed to get container status \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": rpc error: code = NotFound desc = could not find container \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": container with ID starting with 9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66 not found: ID does not exist"
Jul 27 18:34:49.747324 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747322    2578 scope.go:117] "RemoveContainer" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.747519 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747503    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"} err="failed to get container status \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": rpc error: code = NotFound desc = could not find container \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": container with ID starting with cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990 not found: ID does not exist"
Jul 27 18:34:49.747560 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747519    2578 scope.go:117] "RemoveContainer" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.747692 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747675    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"} err="failed to get container status \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": rpc error: code = NotFound desc = could not find container \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": container with ID starting with d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357 not found: ID does not exist"
Jul 27 18:34:49.747732 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747692    2578 scope.go:117] "RemoveContainer" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.747876 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747860    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"} err="failed to get container status \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": rpc error: code = NotFound desc = could not find container \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": container with ID starting with c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc not found: ID does not exist"
Jul 27 18:34:49.747933 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.747876    2578 scope.go:117] "RemoveContainer" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.748054 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748039    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"} err="failed to get container status \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": rpc error: code = NotFound desc = could not find container \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": container with ID starting with c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78 not found: ID does not exist"
Jul 27 18:34:49.748097 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748054    2578 scope.go:117] "RemoveContainer" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.748206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748189    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"} err="failed to get container status \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": rpc error: code = NotFound desc = could not find container \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": container with ID starting with 2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599 not found: ID does not exist"
Jul 27 18:34:49.748241 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748206    2578 scope.go:117] "RemoveContainer" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.748408 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748393    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"} err="failed to get container status \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": rpc error: code = NotFound desc = could not find container \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": container with ID starting with a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635 not found: ID does not exist"
Jul 27 18:34:49.748408 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748407    2578 scope.go:117] "RemoveContainer" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.748584 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748569    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"} err="failed to get container status \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": rpc error: code = NotFound desc = could not find container \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": container with ID starting with 9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66 not found: ID does not exist"
Jul 27 18:34:49.748634 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748584    2578 scope.go:117] "RemoveContainer" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.748767 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748732    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"} err="failed to get container status \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": rpc error: code = NotFound desc = could not find container \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": container with ID starting with cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990 not found: ID does not exist"
Jul 27 18:34:49.748806 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748771    2578 scope.go:117] "RemoveContainer" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.748976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748961    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"} err="failed to get container status \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": rpc error: code = NotFound desc = could not find container \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": container with ID starting with d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357 not found: ID does not exist"
Jul 27 18:34:49.748976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.748976    2578 scope.go:117] "RemoveContainer" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.749162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749147    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"} err="failed to get container status \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": rpc error: code = NotFound desc = could not find container \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": container with ID starting with c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc not found: ID does not exist"
Jul 27 18:34:49.749162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749162    2578 scope.go:117] "RemoveContainer" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.749340 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749325    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"} err="failed to get container status \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": rpc error: code = NotFound desc = could not find container \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": container with ID starting with c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78 not found: ID does not exist"
Jul 27 18:34:49.749377 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749341    2578 scope.go:117] "RemoveContainer" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.749538 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749519    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"} err="failed to get container status \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": rpc error: code = NotFound desc = could not find container \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": container with ID starting with 2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599 not found: ID does not exist"
Jul 27 18:34:49.749578 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749538    2578 scope.go:117] "RemoveContainer" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.749708 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749695    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"} err="failed to get container status \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": rpc error: code = NotFound desc = could not find container \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": container with ID starting with a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635 not found: ID does not exist"
Jul 27 18:34:49.749783 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749709    2578 scope.go:117] "RemoveContainer" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.749921 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749902    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"} err="failed to get container status \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": rpc error: code = NotFound desc = could not find container \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": container with ID starting with 9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66 not found: ID does not exist"
Jul 27 18:34:49.749972 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.749923    2578 scope.go:117] "RemoveContainer" containerID="cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"
Jul 27 18:34:49.750080 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750067    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990"} err="failed to get container status \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": rpc error: code = NotFound desc = could not find container \"cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990\": container with ID starting with cfd178c6bec9e5e5604c30ff7d76819c911fdabccf8948a06ba61568c71c7990 not found: ID does not exist"
Jul 27 18:34:49.750118 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750081    2578 scope.go:117] "RemoveContainer" containerID="d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"
Jul 27 18:34:49.750233 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750219    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357"} err="failed to get container status \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": rpc error: code = NotFound desc = could not find container \"d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357\": container with ID starting with d702e83b376d4ba2ea3efd6cc63753253bddbd65031c05b1b5939f9207418357 not found: ID does not exist"
Jul 27 18:34:49.750268 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750234    2578 scope.go:117] "RemoveContainer" containerID="c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"
Jul 27 18:34:49.750418 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750403    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc"} err="failed to get container status \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": rpc error: code = NotFound desc = could not find container \"c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc\": container with ID starting with c516ec1e6f63f61bb7897d76e7617cf40fcf311deb8882b264984f02547e2cbc not found: ID does not exist"
Jul 27 18:34:49.750418 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750417    2578 scope.go:117] "RemoveContainer" containerID="c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"
Jul 27 18:34:49.750607 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750591    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78"} err="failed to get container status \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": rpc error: code = NotFound desc = could not find container \"c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78\": container with ID starting with c22e26cfd0852741f6cd309318684e43af7f230ed5fa3bb98965cb862d284b78 not found: ID does not exist"
Jul 27 18:34:49.750607 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750606    2578 scope.go:117] "RemoveContainer" containerID="2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"
Jul 27 18:34:49.750786 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750766    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599"} err="failed to get container status \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": rpc error: code = NotFound desc = could not find container \"2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599\": container with ID starting with 2de8931d16465dfc7096c25309e3896acdefab429f1fda6723d7575761f72599 not found: ID does not exist"
Jul 27 18:34:49.750826 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750788    2578 scope.go:117] "RemoveContainer" containerID="a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"
Jul 27 18:34:49.750997 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750981    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635"} err="failed to get container status \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": rpc error: code = NotFound desc = could not find container \"a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635\": container with ID starting with a459ee824fdd0acf3c70f470bbbb4f5f0713c5d7fbbce2f5d7e818bd54d2c635 not found: ID does not exist"
Jul 27 18:34:49.751035 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.750996    2578 scope.go:117] "RemoveContainer" containerID="9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"
Jul 27 18:34:49.751171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.751155    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66"} err="failed to get container status \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": rpc error: code = NotFound desc = could not find container \"9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66\": container with ID starting with 9aeab1e2828d4381d84985c7994153cfb863fa2d4424513a1a7a49b492cace66 not found: ID does not exist"
Jul 27 18:34:49.764467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-metrics-client-ca\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764537 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764484    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-thanos-prometheus-http-client-file\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764569 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764532    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-tls\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764569 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764557    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-kube-rbac-proxy\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764628 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764574    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config-out\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764628 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764590    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764722 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764624    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-metrics-client-certs\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764836 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-grpc-tls\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.764894 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764853    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:49.764894 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764875    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-db\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764909    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-0\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-1\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.764965    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-web-config\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765204 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-2\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765204 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765204 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-trusted-ca-bundle\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765568 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765325    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4b99\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-kube-api-access-f4b99\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765568 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765348    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-tls-assets\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765568 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765377    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-serving-certs-ca-bundle\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.765568 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765420    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-kubelet-serving-ca-bundle\") pod \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\" (UID: \"84a0fc2f-daba-4edc-9bf7-7a871e351b74\") "
Jul 27 18:34:49.768007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.765891    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-metrics-client-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.768007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.766836    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:49.768007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.767280    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.768007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.767440    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:49.768007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.767625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.769189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.768117    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:34:49.769189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.768199    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:49.769189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.768230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:49.769189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.768285    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.769189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.768638    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:49.769189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.768870    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:34:49.769189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.769039    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config-out" (OuterVolumeSpecName: "config-out") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:34:49.769540 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.769368    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.769540 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.769431    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.769540 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.769490    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.769892 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.769862    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config" (OuterVolumeSpecName: "config") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.769978 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.769927    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:34:49.770675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.770656    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.771024 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.771010    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-kube-api-access-f4b99" (OuterVolumeSpecName: "kube-api-access-f4b99") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "kube-api-access-f4b99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:34:49.780065 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.780044    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-web-config" (OuterVolumeSpecName: "web-config") pod "84a0fc2f-daba-4edc-9bf7-7a871e351b74" (UID: "84a0fc2f-daba-4edc-9bf7-7a871e351b74"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:34:49.867240 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867212    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4b99\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-kube-api-access-f4b99\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867240 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867237    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a0fc2f-daba-4edc-9bf7-7a871e351b74-tls-assets\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867250    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867260    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867269    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867277    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867285    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-kube-rbac-proxy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867293    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config-out\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867301    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867309    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-metrics-client-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867316    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-grpc-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867324    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-db\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867332    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867340    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867348    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-config\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867355    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-web-config\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867363    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867788 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867371    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a0fc2f-daba-4edc-9bf7-7a871e351b74-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:49.867788 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:49.867380    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a0fc2f-daba-4edc-9bf7-7a871e351b74-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:34:50.008608 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.008529    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:34:50.013297 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.013271    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:34:50.039849 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.039825    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:34:50.040110 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040097    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="thanos-sidecar"
Jul 27 18:34:50.040158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040113    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="thanos-sidecar"
Jul 27 18:34:50.040158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040124    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-thanos"
Jul 27 18:34:50.040158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040129    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-thanos"
Jul 27 18:34:50.040158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040137    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-web"
Jul 27 18:34:50.040158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040143    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-web"
Jul 27 18:34:50.040158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040151    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="config-reloader"
Jul 27 18:34:50.040158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040156    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="config-reloader"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040166    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="prometheus"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040171    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="prometheus"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040178    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040183    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040192    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="init-config-reloader"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040196    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="init-config-reloader"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040243    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="thanos-sidecar"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040250    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-web"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040256    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040262    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="prometheus"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040267    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="config-reloader"
Jul 27 18:34:50.040351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.040272    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" containerName="kube-rbac-proxy-thanos"
Jul 27 18:34:50.044410 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.044393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.047131 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.047099    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 18:34:50.047131 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.047121    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 18:34:50.047329 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.047234    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 18:34:50.047329 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.047324    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 18:34:50.047407 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.047356    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lbqz7\""
Jul 27 18:34:50.047846 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.047828    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 18:34:50.047934 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.047829    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 18:34:50.048102 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048086    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 18:34:50.048170 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048143    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 18:34:50.048170 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048153    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 18:34:50.048260 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 18:34:50.048260 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048194    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 18:34:50.048260 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048214    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 18:34:50.048895 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048839    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-62qq70i773dn3\""
Jul 27 18:34:50.049063 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.048934    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 18:34:50.050958 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.050919    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 18:34:50.054955 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.054936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 18:34:50.062590 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.062569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:34:50.170527 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170527 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28mb\" (UniqueName: \"kubernetes.io/projected/11b85bba-2689-4d5f-958f-bf0ec35a32a1-kube-api-access-l28mb\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11b85bba-2689-4d5f-958f-bf0ec35a32a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-config\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.170789 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11b85bba-2689-4d5f-958f-bf0ec35a32a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.170979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.171037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.171075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.171110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171162 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.171154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.171453 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.171169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.271914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.271812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.271914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.271868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.271914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.271903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.271945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.271977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.272014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.272039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.272067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.272095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l28mb\" (UniqueName: \"kubernetes.io/projected/11b85bba-2689-4d5f-958f-bf0ec35a32a1-kube-api-access-l28mb\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.272130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272176 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.272166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.272490 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.272193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.273517 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.273484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.275631 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.275561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.275776 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.275713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.275857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.275876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.275943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11b85bba-2689-4d5f-958f-bf0ec35a32a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-config\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276596    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11b85bba-2689-4d5f-958f-bf0ec35a32a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.276893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.276854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.277873 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.277360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.277873 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.277553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11b85bba-2689-4d5f-958f-bf0ec35a32a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.278625 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.278304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b85bba-2689-4d5f-958f-bf0ec35a32a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.279489 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.279457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.279605 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.279497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.279605 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.279500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11b85bba-2689-4d5f-958f-bf0ec35a32a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.280214 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.280187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-config\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.282358 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.280847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11b85bba-2689-4d5f-958f-bf0ec35a32a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.282358 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.281122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11b85bba-2689-4d5f-958f-bf0ec35a32a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.284928 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.284908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28mb\" (UniqueName: \"kubernetes.io/projected/11b85bba-2689-4d5f-958f-bf0ec35a32a1-kube-api-access-l28mb\") pod \"prometheus-k8s-0\" (UID: \"11b85bba-2689-4d5f-958f-bf0ec35a32a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.355270 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.355232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:50.500395 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.500374    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:34:50.502413 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:34:50.502386    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b85bba_2689_4d5f_958f_bf0ec35a32a1.slice/crio-ff2ae5704f65189d99ce5127c8a767dad3493866d9f7f10e9e2e98cd2d79e185 WatchSource:0}: Error finding container ff2ae5704f65189d99ce5127c8a767dad3493866d9f7f10e9e2e98cd2d79e185: Status 404 returned error can't find the container with id ff2ae5704f65189d99ce5127c8a767dad3493866d9f7f10e9e2e98cd2d79e185
Jul 27 18:34:50.693856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.693824    2578 generic.go:356] "Generic (PLEG): container finished" podID="11b85bba-2689-4d5f-958f-bf0ec35a32a1" containerID="96f5dbd929d88451a0ce65f6989d386fdef73f36b86b272eb21a112ce85a15f6" exitCode=0
Jul 27 18:34:50.694206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.693886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerDied","Data":"96f5dbd929d88451a0ce65f6989d386fdef73f36b86b272eb21a112ce85a15f6"}
Jul 27 18:34:50.694206 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:50.693939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerStarted","Data":"ff2ae5704f65189d99ce5127c8a767dad3493866d9f7f10e9e2e98cd2d79e185"}
Jul 27 18:34:51.701022 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.700938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerStarted","Data":"74f42e88885ed4ce6702b79c18407275ce3b8f588a253e169befbb30b6ac6165"}
Jul 27 18:34:51.701022 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.701009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerStarted","Data":"3e4899efc643cd9f11f7cd5abedf278eaacda14ab05e989ca880d07e1d77578b"}
Jul 27 18:34:51.701400 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.701039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerStarted","Data":"655ed0328da13c4e7d7b0395b0d86b8b5d84ccf187599ae2f84f9c27290f52bd"}
Jul 27 18:34:51.701400 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.701082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerStarted","Data":"2e1c55283eddd29b1ffe1811723d825442ec6d8a901fff80db61d297aa7fd263"}
Jul 27 18:34:51.701400 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.701111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerStarted","Data":"5939274f5c7eaa110c627018f82e34f6edd0e465416f297f687482bfb900ea2f"}
Jul 27 18:34:51.701400 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.701135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11b85bba-2689-4d5f-958f-bf0ec35a32a1","Type":"ContainerStarted","Data":"72d4c8b5e2e2cfa6128d026f56b4e695e1951bbb48dcd8bf21fefdce44555bde"}
Jul 27 18:34:51.731667 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.731584    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.712824532 podStartE2EDuration="1.731566661s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.742129ms" isStatefulPod=false podCreationTimestamp="2026-07-27 18:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:34:51.73008874 +0000 UTC m=+216.482883172" watchObservedRunningTime="2026-07-27 18:34:51.731566661 +0000 UTC m=+216.484361080"
Jul 27 18:34:51.845696 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:51.845663    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84a0fc2f-daba-4edc-9bf7-7a871e351b74" path="/var/lib/kubelet/pods/84a0fc2f-daba-4edc-9bf7-7a871e351b74/volumes"
Jul 27 18:34:52.747262 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:52.747202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:52.804521 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:52.804489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:55.355969 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:55.355923    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:34:55.801854 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:55.801819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:55.904149 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:55.904111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:57.558602 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:57.558560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:57.667954 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:57.667912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:34:57.734980 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:34:57.734946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:35:32.444636 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:35:32.444578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:35:50.355698 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:35:50.355656    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:35:50.371964 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:35:50.371937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:35:50.928807 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:35:50.928775    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:35:51.337973 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:35:51.337878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:35:53.732207 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:35:53.732169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:35:53.841003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:35:53.840957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:15.682171 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:15.682142    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 18:36:20.996423 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:20.996374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:21.474922 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:21.474886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:25.804800 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:25.804761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:25.898643 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:25.898559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:27.276281 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:27.276243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:27.466243 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:27.466212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:27.999190 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:27.999149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:28.106781 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.106725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:28.217802 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.217765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7r5w5"]
Jul 27 18:36:28.220961 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.220946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.224177 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.224152    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gv4gb\""
Jul 27 18:36:28.225118 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.225102    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 18:36:28.225222 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.225122    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 18:36:28.234439 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.234415    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7r5w5"]
Jul 27 18:36:28.277631 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.277544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dac7c3b9-9634-409d-b56c-545e46176d51-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7r5w5\" (UID: \"dac7c3b9-9634-409d-b56c-545e46176d51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.277631 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.277614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcpbq\" (UniqueName: \"kubernetes.io/projected/dac7c3b9-9634-409d-b56c-545e46176d51-kube-api-access-xcpbq\") pod \"cert-manager-webhook-6486ffd997-7r5w5\" (UID: \"dac7c3b9-9634-409d-b56c-545e46176d51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.378669 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.378637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcpbq\" (UniqueName: \"kubernetes.io/projected/dac7c3b9-9634-409d-b56c-545e46176d51-kube-api-access-xcpbq\") pod \"cert-manager-webhook-6486ffd997-7r5w5\" (UID: \"dac7c3b9-9634-409d-b56c-545e46176d51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.378832 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.378677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dac7c3b9-9634-409d-b56c-545e46176d51-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7r5w5\" (UID: \"dac7c3b9-9634-409d-b56c-545e46176d51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.389089 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.389062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcpbq\" (UniqueName: \"kubernetes.io/projected/dac7c3b9-9634-409d-b56c-545e46176d51-kube-api-access-xcpbq\") pod \"cert-manager-webhook-6486ffd997-7r5w5\" (UID: \"dac7c3b9-9634-409d-b56c-545e46176d51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.392018 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.391986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dac7c3b9-9634-409d-b56c-545e46176d51-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7r5w5\" (UID: \"dac7c3b9-9634-409d-b56c-545e46176d51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.530065 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.529977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:28.662903 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.662878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7r5w5"]
Jul 27 18:36:28.665449 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:36:28.665421    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddac7c3b9_9634_409d_b56c_545e46176d51.slice/crio-d04b37f74d129506aee5dde72d9427bf9d3bb299a78cab1536bfba84b98b6dae WatchSource:0}: Error finding container d04b37f74d129506aee5dde72d9427bf9d3bb299a78cab1536bfba84b98b6dae: Status 404 returned error can't find the container with id d04b37f74d129506aee5dde72d9427bf9d3bb299a78cab1536bfba84b98b6dae
Jul 27 18:36:28.667643 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:28.667626    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:36:29.061594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:29.061558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5" event={"ID":"dac7c3b9-9634-409d-b56c-545e46176d51","Type":"ContainerStarted","Data":"d04b37f74d129506aee5dde72d9427bf9d3bb299a78cab1536bfba84b98b6dae"}
Jul 27 18:36:29.824108 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:29.824063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:30.460538 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:30.460503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:32.454758 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:32.454648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:32.518918 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:32.518841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:33.078568 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:33.078535    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5" event={"ID":"dac7c3b9-9634-409d-b56c-545e46176d51","Type":"ContainerStarted","Data":"5eb9b8b46f2f474b3430d497700f2a7a0fdc220bb8a75f5284733ea9205ccf05"}
Jul 27 18:36:33.078764 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:33.078624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:33.116978 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:33.116926    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5" podStartSLOduration=0.875367302 podStartE2EDuration="5.116899174s" totalImagesPullingTime="4.241531872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:36:33.11622159 +0000 UTC m=+317.869016009" watchObservedRunningTime="2026-07-27 18:36:33.116899174 +0000 UTC m=+317.869693593"
Jul 27 18:36:35.626410 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:35.626368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:35.743734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:35.743704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:39.085621 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:39.085583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7r5w5"
Jul 27 18:36:39.231775 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:39.231720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:39.448985 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:39.448958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:40.317807 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:40.317769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:40.515287 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:40.515255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:40.728043 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:40.728007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:40.957200 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:40.957164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:43.040037 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:43.040001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:58.414119 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:58.414082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:58.503916 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:58.503879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:59.052279 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.052250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:59.439163 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.439120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:59.566934 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.566886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:59.638803 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.638769    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"]
Jul 27 18:36:59.654046 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.654020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.656976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.656955    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 18:36:59.657215 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.657192    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 18:36:59.657215 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.657206    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d46ft\""
Jul 27 18:36:59.657472 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.657452    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 18:36:59.657558 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.657509    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 18:36:59.688553 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.688521    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"]
Jul 27 18:36:59.747017 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.746933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8747b503-f35e-480d-aba1-89de1923d6b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.747161 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.747011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8747b503-f35e-480d-aba1-89de1923d6b9-tmp\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.747161 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.747053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5czch\" (UniqueName: \"kubernetes.io/projected/8747b503-f35e-480d-aba1-89de1923d6b9-kube-api-access-5czch\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.747161 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.747075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8747b503-f35e-480d-aba1-89de1923d6b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.747161 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.747131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8747b503-f35e-480d-aba1-89de1923d6b9-manifests\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.818132 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.818101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:59.847823 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.847793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5czch\" (UniqueName: \"kubernetes.io/projected/8747b503-f35e-480d-aba1-89de1923d6b9-kube-api-access-5czch\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.847986 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.847838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8747b503-f35e-480d-aba1-89de1923d6b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.847986 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.847886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8747b503-f35e-480d-aba1-89de1923d6b9-manifests\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.847986 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.847971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8747b503-f35e-480d-aba1-89de1923d6b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.848110 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.847998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8747b503-f35e-480d-aba1-89de1923d6b9-tmp\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.848405 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.848386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8747b503-f35e-480d-aba1-89de1923d6b9-manifests\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.850492 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.850470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8747b503-f35e-480d-aba1-89de1923d6b9-tmp\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.850607 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.850544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8747b503-f35e-480d-aba1-89de1923d6b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.850696 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.850676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8747b503-f35e-480d-aba1-89de1923d6b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.858056 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.858034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5czch\" (UniqueName: \"kubernetes.io/projected/8747b503-f35e-480d-aba1-89de1923d6b9-kube-api-access-5czch\") pod \"opendatahub-operator-controller-manager-7dfd8c75b7-zz254\" (UID: \"8747b503-f35e-480d-aba1-89de1923d6b9\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:36:59.924558 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.924522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:36:59.964506 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:36:59.964472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:37:00.032006 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:00.031907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:00.153844 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:00.153805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"]
Jul 27 18:37:00.167412 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:37:00.167388    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8747b503_f35e_480d_aba1_89de1923d6b9.slice/crio-deec8a9615104f7df925acea5bf3baaab983ed7e634636bea570e7dd7fc1d425 WatchSource:0}: Error finding container deec8a9615104f7df925acea5bf3baaab983ed7e634636bea570e7dd7fc1d425: Status 404 returned error can't find the container with id deec8a9615104f7df925acea5bf3baaab983ed7e634636bea570e7dd7fc1d425
Jul 27 18:37:00.172832 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:00.172807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:00.178857 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:00.178832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254" event={"ID":"8747b503-f35e-480d-aba1-89de1923d6b9","Type":"ContainerStarted","Data":"deec8a9615104f7df925acea5bf3baaab983ed7e634636bea570e7dd7fc1d425"}
Jul 27 18:37:00.270625 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:00.270584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:00.367554 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:00.367483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:04.197813 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:04.197773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254" event={"ID":"8747b503-f35e-480d-aba1-89de1923d6b9","Type":"ContainerStarted","Data":"736b0a95df39d15bc17575785c9b6af73a8b48130d196cf569ec81ade701c583"}
Jul 27 18:37:05.203314 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:05.203277    2578 generic.go:356] "Generic (PLEG): container finished" podID="8747b503-f35e-480d-aba1-89de1923d6b9" containerID="736b0a95df39d15bc17575785c9b6af73a8b48130d196cf569ec81ade701c583" exitCode=0
Jul 27 18:37:05.203856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:05.203374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254" event={"ID":"8747b503-f35e-480d-aba1-89de1923d6b9","Type":"ContainerDied","Data":"736b0a95df39d15bc17575785c9b6af73a8b48130d196cf569ec81ade701c583"}
Jul 27 18:37:06.209235 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:06.209198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254" event={"ID":"8747b503-f35e-480d-aba1-89de1923d6b9","Type":"ContainerStarted","Data":"255a223acae715cd062d23acc005c2eb0a730bcbe92dec214c15396b5e216330"}
Jul 27 18:37:06.209677 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:06.209270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:37:06.242961 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:06.242911    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254" podStartSLOduration=2.581983621 podStartE2EDuration="7.242893964s" totalImagesPullingTime="3.575914143s" totalInitContainerRuntime="1.0849962s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:36:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:06.242116967 +0000 UTC m=+350.994911385" watchObservedRunningTime="2026-07-27 18:37:06.242893964 +0000 UTC m=+350.995688384"
Jul 27 18:37:17.215215 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:17.215177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dfd8c75b7-zz254"
Jul 27 18:37:18.890640 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:18.890596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:19.901985 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.901952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"]
Jul 27 18:37:19.909918 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.909886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:19.914007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.913979    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 18:37:19.915007 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.914983    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 18:37:19.915134 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.915027    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:37:19.915134 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.915002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5swx8\""
Jul 27 18:37:19.915262 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.915004    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 18:37:19.915528 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:19.915513    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 18:37:20.011066 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.011034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/224bbe5a-546a-4612-adb2-142fd4619c15-manager-config\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.011066 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.011072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/224bbe5a-546a-4612-adb2-142fd4619c15-cert\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.011276 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.011112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9dz\" (UniqueName: \"kubernetes.io/projected/224bbe5a-546a-4612-adb2-142fd4619c15-kube-api-access-7d9dz\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.011276 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.011191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/224bbe5a-546a-4612-adb2-142fd4619c15-metrics-cert\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.019401 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.019373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"]
Jul 27 18:37:20.111591 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.111557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9dz\" (UniqueName: \"kubernetes.io/projected/224bbe5a-546a-4612-adb2-142fd4619c15-kube-api-access-7d9dz\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.111591 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.111590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/224bbe5a-546a-4612-adb2-142fd4619c15-metrics-cert\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.111884 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.111630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/224bbe5a-546a-4612-adb2-142fd4619c15-manager-config\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.111884 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.111650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/224bbe5a-546a-4612-adb2-142fd4619c15-cert\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.112391 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.112364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/224bbe5a-546a-4612-adb2-142fd4619c15-manager-config\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.114244 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.114216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/224bbe5a-546a-4612-adb2-142fd4619c15-metrics-cert\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.114420 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.114398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/224bbe5a-546a-4612-adb2-142fd4619c15-cert\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.125675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.125647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9dz\" (UniqueName: \"kubernetes.io/projected/224bbe5a-546a-4612-adb2-142fd4619c15-kube-api-access-7d9dz\") pod \"lws-controller-manager-5c45656c54-qgsmm\" (UID: \"224bbe5a-546a-4612-adb2-142fd4619c15\") " pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.219082 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.218990    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:20.368183 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.368059    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"]
Jul 27 18:37:20.371303 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:37:20.371277    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224bbe5a_546a_4612_adb2_142fd4619c15.slice/crio-80fb0cfd5fc7669fa41d6b044c17eeb2007d5a66e2da5527d4d2e51f23462981 WatchSource:0}: Error finding container 80fb0cfd5fc7669fa41d6b044c17eeb2007d5a66e2da5527d4d2e51f23462981: Status 404 returned error can't find the container with id 80fb0cfd5fc7669fa41d6b044c17eeb2007d5a66e2da5527d4d2e51f23462981
Jul 27 18:37:20.461229 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.461186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:20.811080 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:20.811048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:21.265443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:21.265407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm" event={"ID":"224bbe5a-546a-4612-adb2-142fd4619c15","Type":"ContainerStarted","Data":"80fb0cfd5fc7669fa41d6b044c17eeb2007d5a66e2da5527d4d2e51f23462981"}
Jul 27 18:37:21.343667 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:21.343623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:21.852544 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:21.852503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:22.492524 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:22.492481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:22.985152 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:22.985115    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:23.107112 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:23.107074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:23.465503 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:23.465462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:24.734584 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:24.734552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:28.791129 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.791071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:28.875201 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.875167    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"]
Jul 27 18:37:28.879527 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.879509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:28.883464 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.883445    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 18:37:28.883887 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.883865    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 18:37:28.884253 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.884189    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 18:37:28.884253 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.884213    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 18:37:28.884253 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.884228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sns6q\""
Jul 27 18:37:28.884253 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.884215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 18:37:28.884485 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.884215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 18:37:28.902289 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.902267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"]
Jul 27 18:37:28.911776 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.911729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:28.985294 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.985265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a36e35a-dce3-4736-9a58-78379134614e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:28.985294 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.985297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:28.985520 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.985332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a36e35a-dce3-4736-9a58-78379134614e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:28.985520 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.985390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m84d5\" (UniqueName: \"kubernetes.io/projected/3a36e35a-dce3-4736-9a58-78379134614e-kube-api-access-m84d5\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:28.985520 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.985409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:28.985520 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.985431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a36e35a-dce3-4736-9a58-78379134614e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:28.985520 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:28.985482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.086394 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.086316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a36e35a-dce3-4736-9a58-78379134614e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.086394 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.086353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.086394 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.086388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a36e35a-dce3-4736-9a58-78379134614e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.086679 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.086414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m84d5\" (UniqueName: \"kubernetes.io/projected/3a36e35a-dce3-4736-9a58-78379134614e-kube-api-access-m84d5\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.086679 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.086433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.086679 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.086515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a36e35a-dce3-4736-9a58-78379134614e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.086679 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.086550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.087364 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.087335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a36e35a-dce3-4736-9a58-78379134614e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.089049 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.089019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a36e35a-dce3-4736-9a58-78379134614e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.089145 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.089067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.089221 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.089199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.089262 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.089222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a36e35a-dce3-4736-9a58-78379134614e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.104768 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.104719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m84d5\" (UniqueName: \"kubernetes.io/projected/3a36e35a-dce3-4736-9a58-78379134614e-kube-api-access-m84d5\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.104881 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.104785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a36e35a-dce3-4736-9a58-78379134614e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zqnk6\" (UID: \"3a36e35a-dce3-4736-9a58-78379134614e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.189801 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.189764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:29.346508 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.346456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"]
Jul 27 18:37:29.348592 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:37:29.348564    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a36e35a_dce3_4736_9a58_78379134614e.slice/crio-a29388af04e6a108706cda5ad136fc2394f7a6c6eea97317d4c1209a92a1d7a2 WatchSource:0}: Error finding container a29388af04e6a108706cda5ad136fc2394f7a6c6eea97317d4c1209a92a1d7a2: Status 404 returned error can't find the container with id a29388af04e6a108706cda5ad136fc2394f7a6c6eea97317d4c1209a92a1d7a2
Jul 27 18:37:29.704546 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.704479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:29.796843 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.796797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:29.999777 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:29.999670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:30.303782 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:30.303668    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6" event={"ID":"3a36e35a-dce3-4736-9a58-78379134614e","Type":"ContainerStarted","Data":"a29388af04e6a108706cda5ad136fc2394f7a6c6eea97317d4c1209a92a1d7a2"}
Jul 27 18:37:32.293758 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:32.293700    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:37:32.294049 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:32.293809    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:37:32.607304 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:32.607203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:32.818821 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:32.818781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:32.999570 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:32.999540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:33.130223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.130184    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:33.319507 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.319409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm" event={"ID":"224bbe5a-546a-4612-adb2-142fd4619c15","Type":"ContainerStarted","Data":"11f14814145806c24e0a5e8e838b9d1557c9c2521b4487bfd77ed015b2a6cadc"}
Jul 27 18:37:33.319507 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.319486    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:37:33.321077 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.321056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6" event={"ID":"3a36e35a-dce3-4736-9a58-78379134614e","Type":"ContainerStarted","Data":"c299a3bdc611b4c1db9d222a4049dafdfe32fe1fe6043ff37a3688c1e2a072b5"}
Jul 27 18:37:33.321263 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.321246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:33.322770 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.322733    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-zqnk6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:37:33.322860 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.322799    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6" podUID="3a36e35a-dce3-4736-9a58-78379134614e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:37:33.447208 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.447156    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm" podStartSLOduration=2.576215107 podStartE2EDuration="14.447138553s" totalImagesPullingTime="11.870923446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:33.442135973 +0000 UTC m=+378.194930393" watchObservedRunningTime="2026-07-27 18:37:33.447138553 +0000 UTC m=+378.199932973"
Jul 27 18:37:33.525517 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:33.525457    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6" podStartSLOduration=2.583312935 podStartE2EDuration="5.525438858s" totalImagesPullingTime="2.942125923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:37:33.522228447 +0000 UTC m=+378.275022867" watchObservedRunningTime="2026-07-27 18:37:33.525438858 +0000 UTC m=+378.278233278"
Jul 27 18:37:34.055931 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:34.055895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:34.171547 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:34.171511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:34.325610 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:34.325529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zqnk6"
Jul 27 18:37:34.355734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:34.355702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:37:44.326980 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:37:44.326951    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c45656c54-qgsmm"
Jul 27 18:38:20.714117 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:20.714064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:20.812187 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:20.812147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:49.627293 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:49.627261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:50.274595 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:50.274564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:50.467495 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:50.467449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:54.470044 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:54.469945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:56.528107 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:56.528028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:56.840326 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:56.840230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:58.900863 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:58.900830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:38:59.452076 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:38:59.452032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:01.506992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:01.506950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:04.109845 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:04.109808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:04.676093 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:04.676046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:04.851445 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:04.851411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:07.854995 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:07.854956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:07.958909 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:07.958872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:11.725790 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:11.725732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:11.844651 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:11.844611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:12.009212 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:12.009122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:12.930191 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:12.930150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:13.482156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:13.482113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:15.699675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:15.699645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:15.800210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:15.800177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:22.794687 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:22.794648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:22.986058 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:22.986012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:23.117976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:23.117883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:23.252835 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:23.252792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:23.395869 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:23.395817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:26.251640 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:26.251591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:26.345402 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:26.345348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:30.303728 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:30.303690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:30.406367 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:30.406327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:33.758041 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:33.758001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:33.892089 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:33.892053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:38.593118 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:38.593079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:38.701899 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:38.701865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:53.328009 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.327974    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"]
Jul 27 18:39:53.330945 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.330926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.335217 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.335195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qmxpd\""
Jul 27 18:39:53.358706 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.358675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"]
Jul 27 18:39:53.383166 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.383138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:53.400126 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k52bc\" (UniqueName: \"kubernetes.io/projected/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-kube-api-access-k52bc\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400256 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400256 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400256 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400444 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400444 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400444 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400444 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.400444 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.400374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501468 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501468 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k52bc\" (UniqueName: \"kubernetes.io/projected/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-kube-api-access-k52bc\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.501891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.501679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.502232 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.502027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.502232 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.502153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.502232 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.502180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.502362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.502286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.502436 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.502412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.504130 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.504113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.504193 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.504168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.513249 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.513223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.513489 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.513473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k52bc\" (UniqueName: \"kubernetes.io/projected/3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8-kube-api-access-k52bc\") pod \"maas-default-gateway-openshift-default-5ccb968c66-wl9sv\" (UID: \"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.590438 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.590351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:53.641068 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.641032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:53.823265 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.823226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"]
Jul 27 18:39:53.827132 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:39:53.827105    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9367c4_d8fb_43a8_9213_0ea8c73cd7c8.slice/crio-219fc2a7a5601fbc4d1d1b89ae65705f4ae28baf69c1d30d6f3a0362a95d18e7 WatchSource:0}: Error finding container 219fc2a7a5601fbc4d1d1b89ae65705f4ae28baf69c1d30d6f3a0362a95d18e7: Status 404 returned error can't find the container with id 219fc2a7a5601fbc4d1d1b89ae65705f4ae28baf69c1d30d6f3a0362a95d18e7
Jul 27 18:39:53.912780 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:53.912728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" event={"ID":"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8","Type":"ContainerStarted","Data":"219fc2a7a5601fbc4d1d1b89ae65705f4ae28baf69c1d30d6f3a0362a95d18e7"}
Jul 27 18:39:56.710917 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:56.710878    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:39:56.711170 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:56.710957    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:39:56.711170 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:56.710988    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:39:56.929934 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:56.929889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" event={"ID":"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8","Type":"ContainerStarted","Data":"cf6a1ab3d37a6ffb723ad82bc1227803af2ba01cab8f2ab3bbb01d51c457aebe"}
Jul 27 18:39:56.972870 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:56.972730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" podStartSLOduration=1.091298017 podStartE2EDuration="3.972709942s" totalImagesPullingTime="2.881411925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:39:56.970922899 +0000 UTC m=+521.723717320" watchObservedRunningTime="2026-07-27 18:39:56.972709942 +0000 UTC m=+521.725504363"
Jul 27 18:39:57.641408 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:57.641373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:57.645974 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:57.645951    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:57.934467 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:57.934373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:57.935373 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:57.935352    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:39:58.380178 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.380097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:58.401469 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.401437    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6szpb"]
Jul 27 18:39:58.404985 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.404969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.409908 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.409882    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 18:39:58.410175 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.410160    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 18:39:58.410247 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.410224    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 18:39:58.411000 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.410961    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-snhgl\""
Jul 27 18:39:58.428602 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.428574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6szpb"]
Jul 27 18:39:58.455051 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.455015    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6szpb"]
Jul 27 18:39:58.503713 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.503681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:58.549436 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.549407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mntg8\" (UniqueName: \"kubernetes.io/projected/9337620b-9e98-48b0-92c1-6d73f675f42b-kube-api-access-mntg8\") pod \"limitador-limitador-64c94fd64f-6szpb\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.549597 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.549462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9337620b-9e98-48b0-92c1-6d73f675f42b-config-file\") pod \"limitador-limitador-64c94fd64f-6szpb\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.650720 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.650690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mntg8\" (UniqueName: \"kubernetes.io/projected/9337620b-9e98-48b0-92c1-6d73f675f42b-kube-api-access-mntg8\") pod \"limitador-limitador-64c94fd64f-6szpb\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.650872 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.650782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9337620b-9e98-48b0-92c1-6d73f675f42b-config-file\") pod \"limitador-limitador-64c94fd64f-6szpb\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.651345 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.651326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9337620b-9e98-48b0-92c1-6d73f675f42b-config-file\") pod \"limitador-limitador-64c94fd64f-6szpb\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.666375 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.666341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mntg8\" (UniqueName: \"kubernetes.io/projected/9337620b-9e98-48b0-92c1-6d73f675f42b-kube-api-access-mntg8\") pod \"limitador-limitador-64c94fd64f-6szpb\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.681885 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.681856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:58.715711 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.715680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:39:58.874211 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.874186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6szpb"]
Jul 27 18:39:58.876275 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:39:58.876237    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9337620b_9e98_48b0_92c1_6d73f675f42b.slice/crio-3a1dc3f507b0579d25ba42359033e26b36a80f7806a3fb3c3b9e10485754c9b6 WatchSource:0}: Error finding container 3a1dc3f507b0579d25ba42359033e26b36a80f7806a3fb3c3b9e10485754c9b6: Status 404 returned error can't find the container with id 3a1dc3f507b0579d25ba42359033e26b36a80f7806a3fb3c3b9e10485754c9b6
Jul 27 18:39:58.940702 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:58.940610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb" event={"ID":"9337620b-9e98-48b0-92c1-6d73f675f42b","Type":"ContainerStarted","Data":"3a1dc3f507b0579d25ba42359033e26b36a80f7806a3fb3c3b9e10485754c9b6"}
Jul 27 18:39:59.426650 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:59.426620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:39:59.527810 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:39:59.527767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:02.961233 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:02.961197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb" event={"ID":"9337620b-9e98-48b0-92c1-6d73f675f42b","Type":"ContainerStarted","Data":"ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602"}
Jul 27 18:40:02.961638 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:02.961285    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:40:02.984780 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:02.984701    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb" podStartSLOduration=1.6937763559999999 podStartE2EDuration="4.984680756s" totalImagesPullingTime="3.2909044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:40:02.984026738 +0000 UTC m=+527.736821157" watchObservedRunningTime="2026-07-27 18:40:02.984680756 +0000 UTC m=+527.737475180"
Jul 27 18:40:13.966347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:13.966264    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:40:14.119015 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.118975    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6szpb"]
Jul 27 18:40:14.119240 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.119192    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb" podUID="9337620b-9e98-48b0-92c1-6d73f675f42b" containerName="limitador" containerID="cri-o://ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602" gracePeriod=30
Jul 27 18:40:14.654646 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.654621    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:40:14.693613 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.693529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mntg8\" (UniqueName: \"kubernetes.io/projected/9337620b-9e98-48b0-92c1-6d73f675f42b-kube-api-access-mntg8\") pod \"9337620b-9e98-48b0-92c1-6d73f675f42b\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") "
Jul 27 18:40:14.693792 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.693634    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9337620b-9e98-48b0-92c1-6d73f675f42b-config-file\") pod \"9337620b-9e98-48b0-92c1-6d73f675f42b\" (UID: \"9337620b-9e98-48b0-92c1-6d73f675f42b\") "
Jul 27 18:40:14.693993 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.693966    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9337620b-9e98-48b0-92c1-6d73f675f42b-config-file" (OuterVolumeSpecName: "config-file") pod "9337620b-9e98-48b0-92c1-6d73f675f42b" (UID: "9337620b-9e98-48b0-92c1-6d73f675f42b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:40:14.695868 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.695846    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9337620b-9e98-48b0-92c1-6d73f675f42b-kube-api-access-mntg8" (OuterVolumeSpecName: "kube-api-access-mntg8") pod "9337620b-9e98-48b0-92c1-6d73f675f42b" (UID: "9337620b-9e98-48b0-92c1-6d73f675f42b"). InnerVolumeSpecName "kube-api-access-mntg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:40:14.794486 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.794454    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mntg8\" (UniqueName: \"kubernetes.io/projected/9337620b-9e98-48b0-92c1-6d73f675f42b-kube-api-access-mntg8\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:40:14.794486 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:14.794482    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9337620b-9e98-48b0-92c1-6d73f675f42b-config-file\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:40:15.013787 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.013681    2578 generic.go:356] "Generic (PLEG): container finished" podID="9337620b-9e98-48b0-92c1-6d73f675f42b" containerID="ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602" exitCode=0
Jul 27 18:40:15.013787 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.013730    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb"
Jul 27 18:40:15.013787 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.013768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb" event={"ID":"9337620b-9e98-48b0-92c1-6d73f675f42b","Type":"ContainerDied","Data":"ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602"}
Jul 27 18:40:15.014267 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.013819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6szpb" event={"ID":"9337620b-9e98-48b0-92c1-6d73f675f42b","Type":"ContainerDied","Data":"3a1dc3f507b0579d25ba42359033e26b36a80f7806a3fb3c3b9e10485754c9b6"}
Jul 27 18:40:15.014267 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.013842    2578 scope.go:117] "RemoveContainer" containerID="ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602"
Jul 27 18:40:15.023304 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.023287    2578 scope.go:117] "RemoveContainer" containerID="ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602"
Jul 27 18:40:15.023585 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:40:15.023567    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602\": container with ID starting with ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602 not found: ID does not exist" containerID="ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602"
Jul 27 18:40:15.023674 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.023596    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602"} err="failed to get container status \"ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602\": rpc error: code = NotFound desc = could not find container \"ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602\": container with ID starting with ba7190727f41f0ca65769b3839635eeee7915db9acbe62076d923e2bb318a602 not found: ID does not exist"
Jul 27 18:40:15.038986 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.038954    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6szpb"]
Jul 27 18:40:15.047749 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.047713    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6szpb"]
Jul 27 18:40:15.847398 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:15.846996    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9337620b-9e98-48b0-92c1-6d73f675f42b" path="/var/lib/kubelet/pods/9337620b-9e98-48b0-92c1-6d73f675f42b/volumes"
Jul 27 18:40:19.515645 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:19.515603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:19.652547 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:19.652506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:20.009118 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.009086    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"]
Jul 27 18:40:20.009398 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.009387    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9337620b-9e98-48b0-92c1-6d73f675f42b" containerName="limitador"
Jul 27 18:40:20.009446 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.009400    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9337620b-9e98-48b0-92c1-6d73f675f42b" containerName="limitador"
Jul 27 18:40:20.009477 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.009465    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9337620b-9e98-48b0-92c1-6d73f675f42b" containerName="limitador"
Jul 27 18:40:20.012505 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.012487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.016647 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.016626    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 18:40:20.016647 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.016631    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xhwr6\""
Jul 27 18:40:20.017428 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.017410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 18:40:20.017482 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.017426    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:40:20.031457 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.031433    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"]
Jul 27 18:40:20.041854 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.041826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/50f3fd04-abf4-4418-be58-e2c1a88c35d6-data\") pod \"postgres-69fb4594cf-rszr2\" (UID: \"50f3fd04-abf4-4418-be58-e2c1a88c35d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.041965 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.041863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9wkn\" (UniqueName: \"kubernetes.io/projected/50f3fd04-abf4-4418-be58-e2c1a88c35d6-kube-api-access-v9wkn\") pod \"postgres-69fb4594cf-rszr2\" (UID: \"50f3fd04-abf4-4418-be58-e2c1a88c35d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.074148 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.074112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:20.142389 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.142353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/50f3fd04-abf4-4418-be58-e2c1a88c35d6-data\") pod \"postgres-69fb4594cf-rszr2\" (UID: \"50f3fd04-abf4-4418-be58-e2c1a88c35d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.142560 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.142397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9wkn\" (UniqueName: \"kubernetes.io/projected/50f3fd04-abf4-4418-be58-e2c1a88c35d6-kube-api-access-v9wkn\") pod \"postgres-69fb4594cf-rszr2\" (UID: \"50f3fd04-abf4-4418-be58-e2c1a88c35d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.142780 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.142736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/50f3fd04-abf4-4418-be58-e2c1a88c35d6-data\") pod \"postgres-69fb4594cf-rszr2\" (UID: \"50f3fd04-abf4-4418-be58-e2c1a88c35d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.158459 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.158424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9wkn\" (UniqueName: \"kubernetes.io/projected/50f3fd04-abf4-4418-be58-e2c1a88c35d6-kube-api-access-v9wkn\") pod \"postgres-69fb4594cf-rszr2\" (UID: \"50f3fd04-abf4-4418-be58-e2c1a88c35d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.322615 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.322534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:20.454914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:20.454890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"]
Jul 27 18:40:20.456647 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:40:20.456619    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f3fd04_abf4_4418_be58_e2c1a88c35d6.slice/crio-5a74e5001d6447b2c015f0ac0482f2d471f7885e12ce9b61b35231ddfa94e426 WatchSource:0}: Error finding container 5a74e5001d6447b2c015f0ac0482f2d471f7885e12ce9b61b35231ddfa94e426: Status 404 returned error can't find the container with id 5a74e5001d6447b2c015f0ac0482f2d471f7885e12ce9b61b35231ddfa94e426
Jul 27 18:40:21.040714 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:21.040672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2" event={"ID":"50f3fd04-abf4-4418-be58-e2c1a88c35d6","Type":"ContainerStarted","Data":"5a74e5001d6447b2c015f0ac0482f2d471f7885e12ce9b61b35231ddfa94e426"}
Jul 27 18:40:27.073196 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:27.073138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2" event={"ID":"50f3fd04-abf4-4418-be58-e2c1a88c35d6","Type":"ContainerStarted","Data":"012af8a639ae71c49241b08779761128cc702831c21daa262c427e3f9b0663b5"}
Jul 27 18:40:27.073673 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:27.073254    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:27.097393 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:27.097333    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2" podStartSLOduration=2.530426778 podStartE2EDuration="8.097315635s" totalImagesPullingTime="5.566888857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:40:27.096766828 +0000 UTC m=+551.849561239" watchObservedRunningTime="2026-07-27 18:40:27.097315635 +0000 UTC m=+551.850110056"
Jul 27 18:40:33.106976 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:33.106947    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rszr2"
Jul 27 18:40:33.532240 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:33.532208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:33.967098 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:33.967061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:43.788675 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:43.788641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:43.905946 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:43.905907    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74dd665f98-w9sh5"]
Jul 27 18:40:43.908333 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:43.908316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:43.925089 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:43.925065    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 18:40:43.925215 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:43.925111    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 18:40:43.925215 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:43.925066    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tfdg7\""
Jul 27 18:40:43.945643 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:43.945614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dd665f98-w9sh5"]
Jul 27 18:40:44.018025 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.017995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:44.057092 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.057012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ca6d6a0-a80c-48c6-a79b-02066734d95a-webhook-cert\") pod \"maas-controller-74dd665f98-w9sh5\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") " pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:44.057092 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.057081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcnfn\" (UniqueName: \"kubernetes.io/projected/1ca6d6a0-a80c-48c6-a79b-02066734d95a-kube-api-access-tcnfn\") pod \"maas-controller-74dd665f98-w9sh5\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") " pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:44.116318 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.116290    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-2ctk5"]
Jul 27 18:40:44.119053 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.119036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.154169 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.154134    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-2ctk5"]
Jul 27 18:40:44.158261 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.158229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcnfn\" (UniqueName: \"kubernetes.io/projected/1ca6d6a0-a80c-48c6-a79b-02066734d95a-kube-api-access-tcnfn\") pod \"maas-controller-74dd665f98-w9sh5\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") " pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:44.158429 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.158318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ca6d6a0-a80c-48c6-a79b-02066734d95a-webhook-cert\") pod \"maas-controller-74dd665f98-w9sh5\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") " pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:44.161003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.160978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ca6d6a0-a80c-48c6-a79b-02066734d95a-webhook-cert\") pod \"maas-controller-74dd665f98-w9sh5\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") " pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:44.207776 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.207722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcnfn\" (UniqueName: \"kubernetes.io/projected/1ca6d6a0-a80c-48c6-a79b-02066734d95a-kube-api-access-tcnfn\") pod \"maas-controller-74dd665f98-w9sh5\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") " pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:44.218654 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.218628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:44.238636 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.238604    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:44.259762 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.259710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94559580-9206-44df-a7df-27312b67ccca-webhook-cert\") pod \"maas-controller-fcbb5cd48-2ctk5\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") " pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.259964 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.259897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662tm\" (UniqueName: \"kubernetes.io/projected/94559580-9206-44df-a7df-27312b67ccca-kube-api-access-662tm\") pod \"maas-controller-fcbb5cd48-2ctk5\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") " pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.361292 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.361214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-662tm\" (UniqueName: \"kubernetes.io/projected/94559580-9206-44df-a7df-27312b67ccca-kube-api-access-662tm\") pod \"maas-controller-fcbb5cd48-2ctk5\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") " pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.361292 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.361252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94559580-9206-44df-a7df-27312b67ccca-webhook-cert\") pod \"maas-controller-fcbb5cd48-2ctk5\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") " pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.363797 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.363776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94559580-9206-44df-a7df-27312b67ccca-webhook-cert\") pod \"maas-controller-fcbb5cd48-2ctk5\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") " pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.372570 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.372549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dd665f98-w9sh5"]
Jul 27 18:40:44.373691 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:40:44.373664    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca6d6a0_a80c_48c6_a79b_02066734d95a.slice/crio-e1c26175702b7bad7228c3d753aaa33703dd3476d9e213e2353cadff3d91a211 WatchSource:0}: Error finding container e1c26175702b7bad7228c3d753aaa33703dd3476d9e213e2353cadff3d91a211: Status 404 returned error can't find the container with id e1c26175702b7bad7228c3d753aaa33703dd3476d9e213e2353cadff3d91a211
Jul 27 18:40:44.390305 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.390281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-662tm\" (UniqueName: \"kubernetes.io/projected/94559580-9206-44df-a7df-27312b67ccca-kube-api-access-662tm\") pod \"maas-controller-fcbb5cd48-2ctk5\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") " pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.428771 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.428711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:44.585595 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:44.585568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-2ctk5"]
Jul 27 18:40:44.588171 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:40:44.588143    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94559580_9206_44df_a7df_27312b67ccca.slice/crio-954fbb4fc6ae7d5f6d915a9d5736ba1235c61964bc9c0b3f22f0c6be864511d7 WatchSource:0}: Error finding container 954fbb4fc6ae7d5f6d915a9d5736ba1235c61964bc9c0b3f22f0c6be864511d7: Status 404 returned error can't find the container with id 954fbb4fc6ae7d5f6d915a9d5736ba1235c61964bc9c0b3f22f0c6be864511d7
Jul 27 18:40:45.159877 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:45.159837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5" event={"ID":"94559580-9206-44df-a7df-27312b67ccca","Type":"ContainerStarted","Data":"954fbb4fc6ae7d5f6d915a9d5736ba1235c61964bc9c0b3f22f0c6be864511d7"}
Jul 27 18:40:45.161524 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:45.161498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dd665f98-w9sh5" event={"ID":"1ca6d6a0-a80c-48c6-a79b-02066734d95a","Type":"ContainerStarted","Data":"e1c26175702b7bad7228c3d753aaa33703dd3476d9e213e2353cadff3d91a211"}
Jul 27 18:40:47.173727 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.173683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5" event={"ID":"94559580-9206-44df-a7df-27312b67ccca","Type":"ContainerStarted","Data":"8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84"}
Jul 27 18:40:47.174139 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.173819    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:47.175303 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.175262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dd665f98-w9sh5" event={"ID":"1ca6d6a0-a80c-48c6-a79b-02066734d95a","Type":"ContainerStarted","Data":"92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc"}
Jul 27 18:40:47.175398 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.175337    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:47.210524 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.210488    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:47.241211 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.241163    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5" podStartSLOduration=0.998013081 podStartE2EDuration="3.241131658s" totalImagesPullingTime="2.243118577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:40:47.239699285 +0000 UTC m=+571.992493705" watchObservedRunningTime="2026-07-27 18:40:47.241131658 +0000 UTC m=+571.993926078"
Jul 27 18:40:47.297549 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.297503    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74dd665f98-w9sh5" podStartSLOduration=1.849175395 podStartE2EDuration="4.297486845s" totalImagesPullingTime="2.44831145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:40:47.296198643 +0000 UTC m=+572.048993078" watchObservedRunningTime="2026-07-27 18:40:47.297486845 +0000 UTC m=+572.050281265"
Jul 27 18:40:47.655241 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:47.655208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:40:58.183327 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.183297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:58.183853 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.183373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:40:58.308205 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.308164    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dd665f98-w9sh5"]
Jul 27 18:40:58.308443 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.308417    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74dd665f98-w9sh5" podUID="1ca6d6a0-a80c-48c6-a79b-02066734d95a" containerName="manager" containerID="cri-o://92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc" gracePeriod=30
Jul 27 18:40:58.546523 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.546499    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:58.589209 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.589179    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcnfn\" (UniqueName: \"kubernetes.io/projected/1ca6d6a0-a80c-48c6-a79b-02066734d95a-kube-api-access-tcnfn\") pod \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") "
Jul 27 18:40:58.589389 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.589246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ca6d6a0-a80c-48c6-a79b-02066734d95a-webhook-cert\") pod \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\" (UID: \"1ca6d6a0-a80c-48c6-a79b-02066734d95a\") "
Jul 27 18:40:58.591574 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.591541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca6d6a0-a80c-48c6-a79b-02066734d95a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1ca6d6a0-a80c-48c6-a79b-02066734d95a" (UID: "1ca6d6a0-a80c-48c6-a79b-02066734d95a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:40:58.591721 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.591700    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ca6d6a0-a80c-48c6-a79b-02066734d95a-kube-api-access-tcnfn" (OuterVolumeSpecName: "kube-api-access-tcnfn") pod "1ca6d6a0-a80c-48c6-a79b-02066734d95a" (UID: "1ca6d6a0-a80c-48c6-a79b-02066734d95a"). InnerVolumeSpecName "kube-api-access-tcnfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:40:58.690336 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.690297    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcnfn\" (UniqueName: \"kubernetes.io/projected/1ca6d6a0-a80c-48c6-a79b-02066734d95a-kube-api-access-tcnfn\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:40:58.690336 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:58.690333    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ca6d6a0-a80c-48c6-a79b-02066734d95a-webhook-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:40:59.231410 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.231376    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ca6d6a0-a80c-48c6-a79b-02066734d95a" containerID="92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc" exitCode=0
Jul 27 18:40:59.231898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.231418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dd665f98-w9sh5" event={"ID":"1ca6d6a0-a80c-48c6-a79b-02066734d95a","Type":"ContainerDied","Data":"92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc"}
Jul 27 18:40:59.231898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.231427    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dd665f98-w9sh5"
Jul 27 18:40:59.231898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.231460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dd665f98-w9sh5" event={"ID":"1ca6d6a0-a80c-48c6-a79b-02066734d95a","Type":"ContainerDied","Data":"e1c26175702b7bad7228c3d753aaa33703dd3476d9e213e2353cadff3d91a211"}
Jul 27 18:40:59.231898 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.231481    2578 scope.go:117] "RemoveContainer" containerID="92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc"
Jul 27 18:40:59.240977 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.240960    2578 scope.go:117] "RemoveContainer" containerID="92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc"
Jul 27 18:40:59.241284 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:40:59.241265    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc\": container with ID starting with 92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc not found: ID does not exist" containerID="92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc"
Jul 27 18:40:59.241325 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.241296    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc"} err="failed to get container status \"92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc\": rpc error: code = NotFound desc = could not find container \"92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc\": container with ID starting with 92fbffaa99d50824d3919a33b25b4bbcfefeee8b7739bee050e0c79423ebd3dc not found: ID does not exist"
Jul 27 18:40:59.257281 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.257255    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dd665f98-w9sh5"]
Jul 27 18:40:59.261322 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.261299    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74dd665f98-w9sh5"]
Jul 27 18:40:59.845796 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:40:59.845765    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ca6d6a0-a80c-48c6-a79b-02066734d95a" path="/var/lib/kubelet/pods/1ca6d6a0-a80c-48c6-a79b-02066734d95a/volumes"
Jul 27 18:41:06.406180 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:06.406132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:12.470185 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:12.470151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:12.623175 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:12.623130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:22.133551 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.133513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:22.261194 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.261158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:22.748382 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.748342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:22.752405 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.752381    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-557776f786-xjmbc"]
Jul 27 18:41:22.752776 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.752759    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca6d6a0-a80c-48c6-a79b-02066734d95a" containerName="manager"
Jul 27 18:41:22.752776 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.752776    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca6d6a0-a80c-48c6-a79b-02066734d95a" containerName="manager"
Jul 27 18:41:22.752906 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.752844    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ca6d6a0-a80c-48c6-a79b-02066734d95a" containerName="manager"
Jul 27 18:41:22.755645 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.755631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:22.758210 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.758183    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 18:41:22.758319 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.758242    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5c8w7\""
Jul 27 18:41:22.777536 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.777505    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-557776f786-xjmbc"]
Jul 27 18:41:22.891866 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.891833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-openshift-service-ca\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:22.892058 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.891874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-maas-api-tls\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:22.892058 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.891992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdfsl\" (UniqueName: \"kubernetes.io/projected/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-kube-api-access-wdfsl\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:22.993316 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.993287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-openshift-service-ca\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:22.993316 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.993322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-maas-api-tls\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:22.993538 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.993354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdfsl\" (UniqueName: \"kubernetes.io/projected/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-kube-api-access-wdfsl\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:22.993538 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:41:22.993447    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 27 18:41:22.993538 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:41:22.993517    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-maas-api-tls podName:c8cb1cc8-b10e-4f90-8a52-9d5482e12efe nodeName:}" failed. No retries permitted until 2026-07-27 18:41:23.493499409 +0000 UTC m=+608.246293808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-maas-api-tls") pod "maas-api-557776f786-xjmbc" (UID: "c8cb1cc8-b10e-4f90-8a52-9d5482e12efe") : secret "maas-api-serving-cert" not found
Jul 27 18:41:22.993973 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:22.993957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-openshift-service-ca\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:23.002667 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.002600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdfsl\" (UniqueName: \"kubernetes.io/projected/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-kube-api-access-wdfsl\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:23.072556 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.072518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:23.333298 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.333194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:23.450693 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.450645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:23.487437 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.487369    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"]
Jul 27 18:41:23.491110 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.491086    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.494126 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.494103    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mtmsf\""
Jul 27 18:41:23.494126 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.494105    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 18:41:23.497586 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.497563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-maas-api-tls\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:23.500389 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.500361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8cb1cc8-b10e-4f90-8a52-9d5482e12efe-maas-api-tls\") pod \"maas-api-557776f786-xjmbc\" (UID: \"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe\") " pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:23.507179 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.507152    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"]
Jul 27 18:41:23.575900 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.575868    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-xkcqj"]
Jul 27 18:41:23.579474 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.579452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.595295 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.595267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-xkcqj"]
Jul 27 18:41:23.598118 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.598093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99g6v\" (UniqueName: \"kubernetes.io/projected/cf1aadb2-c3ce-4244-8f65-4964210b4656-kube-api-access-99g6v\") pod \"payload-pre-processing-687dbb6cf6-tzknq\" (UID: \"cf1aadb2-c3ce-4244-8f65-4964210b4656\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.598252 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.598147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1aadb2-c3ce-4244-8f65-4964210b4656-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tzknq\" (UID: \"cf1aadb2-c3ce-4244-8f65-4964210b4656\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.665642 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.665612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:23.698816 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.698779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1aadb2-c3ce-4244-8f65-4964210b4656-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tzknq\" (UID: \"cf1aadb2-c3ce-4244-8f65-4964210b4656\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.698996 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.698854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fppjv\" (UniqueName: \"kubernetes.io/projected/0831ed87-7c67-4a74-aabb-de74e5f11230-kube-api-access-fppjv\") pod \"payload-processing-5cc6cd444b-xkcqj\" (UID: \"0831ed87-7c67-4a74-aabb-de74e5f11230\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.698996 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.698908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0831ed87-7c67-4a74-aabb-de74e5f11230-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-xkcqj\" (UID: \"0831ed87-7c67-4a74-aabb-de74e5f11230\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.699125 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.699010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99g6v\" (UniqueName: \"kubernetes.io/projected/cf1aadb2-c3ce-4244-8f65-4964210b4656-kube-api-access-99g6v\") pod \"payload-pre-processing-687dbb6cf6-tzknq\" (UID: \"cf1aadb2-c3ce-4244-8f65-4964210b4656\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.699893 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.699867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1aadb2-c3ce-4244-8f65-4964210b4656-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tzknq\" (UID: \"cf1aadb2-c3ce-4244-8f65-4964210b4656\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.708853 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.708821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99g6v\" (UniqueName: \"kubernetes.io/projected/cf1aadb2-c3ce-4244-8f65-4964210b4656-kube-api-access-99g6v\") pod \"payload-pre-processing-687dbb6cf6-tzknq\" (UID: \"cf1aadb2-c3ce-4244-8f65-4964210b4656\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.800299 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.800263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fppjv\" (UniqueName: \"kubernetes.io/projected/0831ed87-7c67-4a74-aabb-de74e5f11230-kube-api-access-fppjv\") pod \"payload-processing-5cc6cd444b-xkcqj\" (UID: \"0831ed87-7c67-4a74-aabb-de74e5f11230\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.800483 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.800323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0831ed87-7c67-4a74-aabb-de74e5f11230-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-xkcqj\" (UID: \"0831ed87-7c67-4a74-aabb-de74e5f11230\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.801048 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.801022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0831ed87-7c67-4a74-aabb-de74e5f11230-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-xkcqj\" (UID: \"0831ed87-7c67-4a74-aabb-de74e5f11230\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.812627 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.812598    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:23.813433 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.813412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-557776f786-xjmbc"]
Jul 27 18:41:23.817091 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:41:23.817069    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cb1cc8_b10e_4f90_8a52_9d5482e12efe.slice/crio-aa5a2983e2cb152fd6db1f6c7d924e0bda37b0c0ecef1a146c25599a6a92db23 WatchSource:0}: Error finding container aa5a2983e2cb152fd6db1f6c7d924e0bda37b0c0ecef1a146c25599a6a92db23: Status 404 returned error can't find the container with id aa5a2983e2cb152fd6db1f6c7d924e0bda37b0c0ecef1a146c25599a6a92db23
Jul 27 18:41:23.817712 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.817693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fppjv\" (UniqueName: \"kubernetes.io/projected/0831ed87-7c67-4a74-aabb-de74e5f11230-kube-api-access-fppjv\") pod \"payload-processing-5cc6cd444b-xkcqj\" (UID: \"0831ed87-7c67-4a74-aabb-de74e5f11230\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.889152 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.889111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:23.964410 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:23.964385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"]
Jul 27 18:41:23.966435 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:41:23.966405    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1aadb2_c3ce_4244_8f65_4964210b4656.slice/crio-6b634b246547cabfe7e7a90a288a234eee58d90620ac933c63099ad348c33cc1 WatchSource:0}: Error finding container 6b634b246547cabfe7e7a90a288a234eee58d90620ac933c63099ad348c33cc1: Status 404 returned error can't find the container with id 6b634b246547cabfe7e7a90a288a234eee58d90620ac933c63099ad348c33cc1
Jul 27 18:41:24.051330 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:24.051307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-xkcqj"]
Jul 27 18:41:24.053347 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:41:24.053322    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0831ed87_7c67_4a74_aabb_de74e5f11230.slice/crio-29f3eeeaccdbf61ab04bd0dc987b3341085e69551e2936a23953e6fd9a74bb1a WatchSource:0}: Error finding container 29f3eeeaccdbf61ab04bd0dc987b3341085e69551e2936a23953e6fd9a74bb1a: Status 404 returned error can't find the container with id 29f3eeeaccdbf61ab04bd0dc987b3341085e69551e2936a23953e6fd9a74bb1a
Jul 27 18:41:24.344493 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:24.344462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq" event={"ID":"cf1aadb2-c3ce-4244-8f65-4964210b4656","Type":"ContainerStarted","Data":"6b634b246547cabfe7e7a90a288a234eee58d90620ac933c63099ad348c33cc1"}
Jul 27 18:41:24.345764 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:24.345726    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc" event={"ID":"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe","Type":"ContainerStarted","Data":"aa5a2983e2cb152fd6db1f6c7d924e0bda37b0c0ecef1a146c25599a6a92db23"}
Jul 27 18:41:24.346792 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:24.346771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj" event={"ID":"0831ed87-7c67-4a74-aabb-de74e5f11230","Type":"ContainerStarted","Data":"29f3eeeaccdbf61ab04bd0dc987b3341085e69551e2936a23953e6fd9a74bb1a"}
Jul 27 18:41:27.367554 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.367509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc" event={"ID":"c8cb1cc8-b10e-4f90-8a52-9d5482e12efe","Type":"ContainerStarted","Data":"4bca6c782be693ac316af2a2e80973ffb5a3ad5175a40f36aff9d1c5eec54803"}
Jul 27 18:41:27.369157 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.369132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:27.371259 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.371234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj" event={"ID":"0831ed87-7c67-4a74-aabb-de74e5f11230","Type":"ContainerStarted","Data":"0fac8853ea6399601877049a309b4ddebd6dbc7f2ab69733fbd604f3dd79b43d"}
Jul 27 18:41:27.371873 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.371858    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:27.373579 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.373557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq" event={"ID":"cf1aadb2-c3ce-4244-8f65-4964210b4656","Type":"ContainerStarted","Data":"b8a4267f602e18d0b509febbf7214e5f09d5cbf9ce5bc862341203d1acfcb975"}
Jul 27 18:41:27.373900 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.373887    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:27.395765 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.395675    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc" podStartSLOduration=2.567523415 podStartE2EDuration="5.395654054s" totalImagesPullingTime="2.828130639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:41:27.393318188 +0000 UTC m=+612.146112601" watchObservedRunningTime="2026-07-27 18:41:27.395654054 +0000 UTC m=+612.148448476"
Jul 27 18:41:27.414694 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.414631    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj" podStartSLOduration=1.816294401 podStartE2EDuration="4.414616249s" totalImagesPullingTime="2.598321848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:41:27.412279285 +0000 UTC m=+612.165073741" watchObservedRunningTime="2026-07-27 18:41:27.414616249 +0000 UTC m=+612.167410668"
Jul 27 18:41:27.436247 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:27.436195    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq" podStartSLOduration=1.757829794 podStartE2EDuration="4.436177453s" totalImagesPullingTime="2.678347659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:41:27.434699152 +0000 UTC m=+612.187493591" watchObservedRunningTime="2026-07-27 18:41:27.436177453 +0000 UTC m=+612.188971873"
Jul 27 18:41:29.770588 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:29.770554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:31.397058 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:31.397022    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8" containerID="cf6a1ab3d37a6ffb723ad82bc1227803af2ba01cab8f2ab3bbb01d51c457aebe" exitCode=0
Jul 27 18:41:31.397504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:31.397083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" event={"ID":"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8","Type":"ContainerDied","Data":"cf6a1ab3d37a6ffb723ad82bc1227803af2ba01cab8f2ab3bbb01d51c457aebe"}
Jul 27 18:41:31.397504 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:31.397460    2578 scope.go:117] "RemoveContainer" containerID="cf6a1ab3d37a6ffb723ad82bc1227803af2ba01cab8f2ab3bbb01d51c457aebe"
Jul 27 18:41:31.398431 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:31.398398    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:41:31.398486 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:31.398472    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:41:31.398532 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:31.398508    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:41:32.403489 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:32.403452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" event={"ID":"3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8","Type":"ContainerStarted","Data":"1f74a2d230c474c45ff6eccbf361760c674d36256756016f0bbe40786c0b7488"}
Jul 27 18:41:32.642227 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:32.642183    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:41:32.642492 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:32.642469    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wl9sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 18:41:32.642547 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:32.642522    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" podUID="3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 18:41:33.642278 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:33.642240    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wl9sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 18:41:33.642674 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:33.642300    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" podUID="3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 18:41:34.394668 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:34.394639    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-557776f786-xjmbc"
Jul 27 18:41:34.641986 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:34.641955    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wl9sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 18:41:34.642138 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:34.642008    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" podUID="3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 18:41:35.460795 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:35.460756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:35.561850 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:35.561807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:41:35.641737 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:35.641701    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-wl9sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Jul 27 18:41:35.641950 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:35.641786    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv" podUID="3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Jul 27 18:41:36.645478 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:36.645385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:41:36.645897 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:36.645778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:41:36.646616 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:36.646598    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-wl9sv"
Jul 27 18:41:38.382967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:38.382932    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tzknq"
Jul 27 18:41:39.388589 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:39.388560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-xkcqj"
Jul 27 18:41:48.390446 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:41:48.390406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:01.125641 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:01.125609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:06.590454 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.590420    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"]
Jul 27 18:42:06.593857 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.593834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.597426 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.597392    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 18:42:06.597574 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.597399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kt8p7\""
Jul 27 18:42:06.597574 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.597441    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 18:42:06.597574 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.597470    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 18:42:06.604916 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.604895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"]
Jul 27 18:42:06.638866 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.638832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:06.705388 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.705347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.705562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.705402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.705562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.705471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.705562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.705500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5tf6\" (UniqueName: \"kubernetes.io/projected/da650cd3-5d88-48af-85c0-1c9ce13b3813-kube-api-access-f5tf6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.705562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.705539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.705562 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.705562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da650cd3-5d88-48af-85c0-1c9ce13b3813-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806187 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806187 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5tf6\" (UniqueName: \"kubernetes.io/projected/da650cd3-5d88-48af-85c0-1c9ce13b3813-kube-api-access-f5tf6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806408 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806408 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da650cd3-5d88-48af-85c0-1c9ce13b3813-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806408 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806408 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806603 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806660 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.806715 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.806672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.808694 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.808673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da650cd3-5d88-48af-85c0-1c9ce13b3813-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.809033 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.809015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da650cd3-5d88-48af-85c0-1c9ce13b3813-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.815858 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.815832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5tf6\" (UniqueName: \"kubernetes.io/projected/da650cd3-5d88-48af-85c0-1c9ce13b3813-kube-api-access-f5tf6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-njdwt\" (UID: \"da650cd3-5d88-48af-85c0-1c9ce13b3813\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:06.905063 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:06.905026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:07.042865 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:07.042839    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"]
Jul 27 18:42:07.045696 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:42:07.045666    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda650cd3_5d88_48af_85c0_1c9ce13b3813.slice/crio-20bee02194f72037f6a7c0882337b31327f4f63de6969946cde97b45bee5283d WatchSource:0}: Error finding container 20bee02194f72037f6a7c0882337b31327f4f63de6969946cde97b45bee5283d: Status 404 returned error can't find the container with id 20bee02194f72037f6a7c0882337b31327f4f63de6969946cde97b45bee5283d
Jul 27 18:42:07.046957 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:07.046937    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:42:07.560985 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:07.560950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt" event={"ID":"da650cd3-5d88-48af-85c0-1c9ce13b3813","Type":"ContainerStarted","Data":"20bee02194f72037f6a7c0882337b31327f4f63de6969946cde97b45bee5283d"}
Jul 27 18:42:08.566910 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:08.566873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt" event={"ID":"da650cd3-5d88-48af-85c0-1c9ce13b3813","Type":"ContainerStarted","Data":"2af996c505a1458a8db98a67c55f12110cfdd11bce84b03f9568685402907709"}
Jul 27 18:42:16.905671 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:16.905612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:16.906223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:16.905693    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:16.918331 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:16.918308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:16.950633 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:16.950578    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt" podStartSLOduration=9.97809687 podStartE2EDuration="10.950563595s" totalImagesPullingTime="972.466725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:42:08.623668039 +0000 UTC m=+653.376462460" watchObservedRunningTime="2026-07-27 18:42:16.950563595 +0000 UTC m=+661.703358066"
Jul 27 18:42:17.617967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:17.617937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-njdwt"
Jul 27 18:42:23.825397 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:23.825356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:30.684784 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.684715    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"]
Jul 27 18:42:30.688860 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.688835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.691889 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.691859    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 18:42:30.697841 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.697812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"]
Jul 27 18:42:30.720992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.720955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:30.721265 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.721242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.721315 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.721304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.721358 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.721347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.721395 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.721367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5jpg\" (UniqueName: \"kubernetes.io/projected/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-kube-api-access-t5jpg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.721490 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.721474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.721529 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.721510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823020 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.822977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823223 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823413 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5jpg\" (UniqueName: \"kubernetes.io/projected/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-kube-api-access-t5jpg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823592 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823799 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.823799 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.823630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.825833 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.825805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.825961 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.825939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:30.833286 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:30.833249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5jpg\" (UniqueName: \"kubernetes.io/projected/0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c-kube-api-access-t5jpg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9\" (UID: \"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:31.002145 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:31.002042    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:31.153945 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:31.153912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"]
Jul 27 18:42:31.156181 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:42:31.156147    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a65e7ff_0fbc_4d71_9b03_4b9ecf77949c.slice/crio-2c903fccaf9b43a0557475daf4860751f9ffbb3e1d6f6ef14521849e494ee2c5 WatchSource:0}: Error finding container 2c903fccaf9b43a0557475daf4860751f9ffbb3e1d6f6ef14521849e494ee2c5: Status 404 returned error can't find the container with id 2c903fccaf9b43a0557475daf4860751f9ffbb3e1d6f6ef14521849e494ee2c5
Jul 27 18:42:31.675838 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:31.675800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9" event={"ID":"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c","Type":"ContainerStarted","Data":"dad1e2248577cb1498d6db5b469daac3a95ed15a1e8e11c049734b9009ed8dca"}
Jul 27 18:42:31.676056 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:31.675854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9" event={"ID":"0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c","Type":"ContainerStarted","Data":"2c903fccaf9b43a0557475daf4860751f9ffbb3e1d6f6ef14521849e494ee2c5"}
Jul 27 18:42:31.696972 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:31.696903    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9" podStartSLOduration=1.4756549030000001 podStartE2EDuration="1.696883553s" totalImagesPullingTime="221.22865ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:42:31.695013116 +0000 UTC m=+676.447807537" watchObservedRunningTime="2026-07-27 18:42:31.696883553 +0000 UTC m=+676.449677972"
Jul 27 18:42:41.002961 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:41.002909    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:41.003487 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:41.003037    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:41.016173 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:41.016138    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:41.737481 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:41.737448    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9"
Jul 27 18:42:46.242096 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:46.242045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:48.091790 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:48.091757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:48.184654 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:48.184611    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:42:55.011632 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:42:55.011573    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:43:57.064594 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:43:57.064555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:43:57.178144 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:43:57.178106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:43:57.405149 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:43:57.405103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:43:58.320492 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:43:58.320452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:43:58.422806 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:43:58.422736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:44:50.326942 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:44:50.326900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:44:53.957345 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:44:53.957265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:45:02.657285 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:02.657248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:45:03.890914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:03.890875    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-2ctk5"]
Jul 27 18:45:03.891331 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:03.891145    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5" podUID="94559580-9206-44df-a7df-27312b67ccca" containerName="manager" containerID="cri-o://8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84" gracePeriod=30
Jul 27 18:45:04.153256 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.153170    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:45:04.273765 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.273698    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-662tm\" (UniqueName: \"kubernetes.io/projected/94559580-9206-44df-a7df-27312b67ccca-kube-api-access-662tm\") pod \"94559580-9206-44df-a7df-27312b67ccca\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") "
Jul 27 18:45:04.273947 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.273824    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94559580-9206-44df-a7df-27312b67ccca-webhook-cert\") pod \"94559580-9206-44df-a7df-27312b67ccca\" (UID: \"94559580-9206-44df-a7df-27312b67ccca\") "
Jul 27 18:45:04.276239 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.276204    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94559580-9206-44df-a7df-27312b67ccca-kube-api-access-662tm" (OuterVolumeSpecName: "kube-api-access-662tm") pod "94559580-9206-44df-a7df-27312b67ccca" (UID: "94559580-9206-44df-a7df-27312b67ccca"). InnerVolumeSpecName "kube-api-access-662tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:45:04.276239 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.276225    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94559580-9206-44df-a7df-27312b67ccca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "94559580-9206-44df-a7df-27312b67ccca" (UID: "94559580-9206-44df-a7df-27312b67ccca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:45:04.375425 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.375389    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94559580-9206-44df-a7df-27312b67ccca-webhook-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:45:04.375425 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.375422    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-662tm\" (UniqueName: \"kubernetes.io/projected/94559580-9206-44df-a7df-27312b67ccca-kube-api-access-662tm\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:45:04.442719 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.442632    2578 generic.go:356] "Generic (PLEG): container finished" podID="94559580-9206-44df-a7df-27312b67ccca" containerID="8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84" exitCode=0
Jul 27 18:45:04.442719 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.442684    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5"
Jul 27 18:45:04.442939 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.442692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5" event={"ID":"94559580-9206-44df-a7df-27312b67ccca","Type":"ContainerDied","Data":"8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84"}
Jul 27 18:45:04.442939 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.442833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-2ctk5" event={"ID":"94559580-9206-44df-a7df-27312b67ccca","Type":"ContainerDied","Data":"954fbb4fc6ae7d5f6d915a9d5736ba1235c61964bc9c0b3f22f0c6be864511d7"}
Jul 27 18:45:04.442939 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.442866    2578 scope.go:117] "RemoveContainer" containerID="8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84"
Jul 27 18:45:04.452885 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.452866    2578 scope.go:117] "RemoveContainer" containerID="8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84"
Jul 27 18:45:04.453231 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:45:04.453207    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84\": container with ID starting with 8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84 not found: ID does not exist" containerID="8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84"
Jul 27 18:45:04.453315 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.453245    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84"} err="failed to get container status \"8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84\": rpc error: code = NotFound desc = could not find container \"8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84\": container with ID starting with 8d521f33bfbc7c1f73ea95bbb0ab53a830c52ef48e52c91861e42ef1d4906c84 not found: ID does not exist"
Jul 27 18:45:04.465015 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.464970    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-2ctk5"]
Jul 27 18:45:04.469541 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:04.469505    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-2ctk5"]
Jul 27 18:45:05.846160 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:45:05.846125    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94559580-9206-44df-a7df-27312b67ccca" path="/var/lib/kubelet/pods/94559580-9206-44df-a7df-27312b67ccca/volumes"
Jul 27 18:46:05.373150 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.373109    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-hvqql"]
Jul 27 18:46:05.373645 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.373540    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94559580-9206-44df-a7df-27312b67ccca" containerName="manager"
Jul 27 18:46:05.373645 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.373558    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="94559580-9206-44df-a7df-27312b67ccca" containerName="manager"
Jul 27 18:46:05.373645 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.373640    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="94559580-9206-44df-a7df-27312b67ccca" containerName="manager"
Jul 27 18:46:05.377130 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.377100    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.379914 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.379876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tfdg7\""
Jul 27 18:46:05.380092 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.380003    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 18:46:05.380971 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.380954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 18:46:05.386866 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.386827    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-hvqql"]
Jul 27 18:46:05.461701 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.461670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87c3a2a3-a884-45c7-8c93-258c9a46a291-webhook-cert\") pod \"maas-controller-fcbb5cd48-hvqql\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") " pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.461824 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.461721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwhbd\" (UniqueName: \"kubernetes.io/projected/87c3a2a3-a884-45c7-8c93-258c9a46a291-kube-api-access-pwhbd\") pod \"maas-controller-fcbb5cd48-hvqql\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") " pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.562992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.562947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87c3a2a3-a884-45c7-8c93-258c9a46a291-webhook-cert\") pod \"maas-controller-fcbb5cd48-hvqql\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") " pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.562992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.562995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwhbd\" (UniqueName: \"kubernetes.io/projected/87c3a2a3-a884-45c7-8c93-258c9a46a291-kube-api-access-pwhbd\") pod \"maas-controller-fcbb5cd48-hvqql\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") " pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.565872 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.565840    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87c3a2a3-a884-45c7-8c93-258c9a46a291-webhook-cert\") pod \"maas-controller-fcbb5cd48-hvqql\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") " pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.572861 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.572829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwhbd\" (UniqueName: \"kubernetes.io/projected/87c3a2a3-a884-45c7-8c93-258c9a46a291-kube-api-access-pwhbd\") pod \"maas-controller-fcbb5cd48-hvqql\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") " pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.715156 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.715114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:05.870158 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:05.870081    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-hvqql"]
Jul 27 18:46:05.872696 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:46:05.872656    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c3a2a3_a884_45c7_8c93_258c9a46a291.slice/crio-d7e84fb7007fadb48b6fdb71419313860e73f624444c29041b21329a53dc3489 WatchSource:0}: Error finding container d7e84fb7007fadb48b6fdb71419313860e73f624444c29041b21329a53dc3489: Status 404 returned error can't find the container with id d7e84fb7007fadb48b6fdb71419313860e73f624444c29041b21329a53dc3489
Jul 27 18:46:06.770559 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:06.770519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-hvqql" event={"ID":"87c3a2a3-a884-45c7-8c93-258c9a46a291","Type":"ContainerStarted","Data":"000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c"}
Jul 27 18:46:06.771003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:06.770577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-hvqql" event={"ID":"87c3a2a3-a884-45c7-8c93-258c9a46a291","Type":"ContainerStarted","Data":"d7e84fb7007fadb48b6fdb71419313860e73f624444c29041b21329a53dc3489"}
Jul 27 18:46:06.771003 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:06.770657    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:06.799060 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:06.798997    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fcbb5cd48-hvqql" podStartSLOduration=1.1087599830000001 podStartE2EDuration="1.798977106s" totalImagesPullingTime="690.217123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:46:06.797968776 +0000 UTC m=+891.550763196" watchObservedRunningTime="2026-07-27 18:46:06.798977106 +0000 UTC m=+891.551771527"
Jul 27 18:46:17.778564 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:17.778530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:22.369219 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.369177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:46:22.492804 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.492760    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-hvqql"]
Jul 27 18:46:22.493022 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.492993    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-fcbb5cd48-hvqql" podUID="87c3a2a3-a884-45c7-8c93-258c9a46a291" containerName="manager" containerID="cri-o://000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c" gracePeriod=30
Jul 27 18:46:22.761799 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.761757    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:22.827934 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.827879    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwhbd\" (UniqueName: \"kubernetes.io/projected/87c3a2a3-a884-45c7-8c93-258c9a46a291-kube-api-access-pwhbd\") pod \"87c3a2a3-a884-45c7-8c93-258c9a46a291\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") "
Jul 27 18:46:22.828178 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.827983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87c3a2a3-a884-45c7-8c93-258c9a46a291-webhook-cert\") pod \"87c3a2a3-a884-45c7-8c93-258c9a46a291\" (UID: \"87c3a2a3-a884-45c7-8c93-258c9a46a291\") "
Jul 27 18:46:22.830351 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.830311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c3a2a3-a884-45c7-8c93-258c9a46a291-kube-api-access-pwhbd" (OuterVolumeSpecName: "kube-api-access-pwhbd") pod "87c3a2a3-a884-45c7-8c93-258c9a46a291" (UID: "87c3a2a3-a884-45c7-8c93-258c9a46a291"). InnerVolumeSpecName "kube-api-access-pwhbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:46:22.830492 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.830321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87c3a2a3-a884-45c7-8c93-258c9a46a291-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "87c3a2a3-a884-45c7-8c93-258c9a46a291" (UID: "87c3a2a3-a884-45c7-8c93-258c9a46a291"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:46:22.851189 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.851150    2578 generic.go:356] "Generic (PLEG): container finished" podID="87c3a2a3-a884-45c7-8c93-258c9a46a291" containerID="000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c" exitCode=0
Jul 27 18:46:22.851402 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.851195    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-hvqql"
Jul 27 18:46:22.851402 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.851236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-hvqql" event={"ID":"87c3a2a3-a884-45c7-8c93-258c9a46a291","Type":"ContainerDied","Data":"000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c"}
Jul 27 18:46:22.851402 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.851298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-hvqql" event={"ID":"87c3a2a3-a884-45c7-8c93-258c9a46a291","Type":"ContainerDied","Data":"d7e84fb7007fadb48b6fdb71419313860e73f624444c29041b21329a53dc3489"}
Jul 27 18:46:22.851402 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.851325    2578 scope.go:117] "RemoveContainer" containerID="000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c"
Jul 27 18:46:22.861010 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.860964    2578 scope.go:117] "RemoveContainer" containerID="000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c"
Jul 27 18:46:22.861304 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:46:22.861283    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c\": container with ID starting with 000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c not found: ID does not exist" containerID="000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c"
Jul 27 18:46:22.861353 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.861317    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c"} err="failed to get container status \"000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c\": rpc error: code = NotFound desc = could not find container \"000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c\": container with ID starting with 000cf916266c157445018d5ebdc9bf97f9c121509cad480294d6309e7f8fde1c not found: ID does not exist"
Jul 27 18:46:22.871783 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.871728    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-hvqql"]
Jul 27 18:46:22.875215 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.875179    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-hvqql"]
Jul 27 18:46:22.928967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.928875    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87c3a2a3-a884-45c7-8c93-258c9a46a291-webhook-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:46:22.928967 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:22.928906    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwhbd\" (UniqueName: \"kubernetes.io/projected/87c3a2a3-a884-45c7-8c93-258c9a46a291-kube-api-access-pwhbd\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 18:46:23.601865 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.600446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:46:23.720416 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.720369    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-rhxst"]
Jul 27 18:46:23.720938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.720916    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c3a2a3-a884-45c7-8c93-258c9a46a291" containerName="manager"
Jul 27 18:46:23.720938 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.720939    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c3a2a3-a884-45c7-8c93-258c9a46a291" containerName="manager"
Jul 27 18:46:23.721109 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.721016    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c3a2a3-a884-45c7-8c93-258c9a46a291" containerName="manager"
Jul 27 18:46:23.725391 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.725355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:23.728025 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.727998    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 18:46:23.729101 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.729075    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 18:46:23.729229 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.729146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tfdg7\""
Jul 27 18:46:23.734564 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.734527    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-rhxst"]
Jul 27 18:46:23.836120 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.836067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49acff4f-4b4c-496b-bc02-3db361ca992b-webhook-cert\") pod \"maas-controller-fcbb5cd48-rhxst\" (UID: \"49acff4f-4b4c-496b-bc02-3db361ca992b\") " pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:23.836312 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.836176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbb5\" (UniqueName: \"kubernetes.io/projected/49acff4f-4b4c-496b-bc02-3db361ca992b-kube-api-access-dfbb5\") pod \"maas-controller-fcbb5cd48-rhxst\" (UID: \"49acff4f-4b4c-496b-bc02-3db361ca992b\") " pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:23.846313 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.846276    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c3a2a3-a884-45c7-8c93-258c9a46a291" path="/var/lib/kubelet/pods/87c3a2a3-a884-45c7-8c93-258c9a46a291/volumes"
Jul 27 18:46:23.937971 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.937918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49acff4f-4b4c-496b-bc02-3db361ca992b-webhook-cert\") pod \"maas-controller-fcbb5cd48-rhxst\" (UID: \"49acff4f-4b4c-496b-bc02-3db361ca992b\") " pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:23.938208 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.937984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbb5\" (UniqueName: \"kubernetes.io/projected/49acff4f-4b4c-496b-bc02-3db361ca992b-kube-api-access-dfbb5\") pod \"maas-controller-fcbb5cd48-rhxst\" (UID: \"49acff4f-4b4c-496b-bc02-3db361ca992b\") " pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:23.941304 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.941275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49acff4f-4b4c-496b-bc02-3db361ca992b-webhook-cert\") pod \"maas-controller-fcbb5cd48-rhxst\" (UID: \"49acff4f-4b4c-496b-bc02-3db361ca992b\") " pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:23.946919 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:23.946889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbb5\" (UniqueName: \"kubernetes.io/projected/49acff4f-4b4c-496b-bc02-3db361ca992b-kube-api-access-dfbb5\") pod \"maas-controller-fcbb5cd48-rhxst\" (UID: \"49acff4f-4b4c-496b-bc02-3db361ca992b\") " pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:24.038102 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:24.038057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:24.187238 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:24.187207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fcbb5cd48-rhxst"]
Jul 27 18:46:24.189363 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:46:24.189285    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49acff4f_4b4c_496b_bc02_3db361ca992b.slice/crio-b114377f8f337e51d569aac7b26a5b6e82a8996d4871f444d227be374816d626 WatchSource:0}: Error finding container b114377f8f337e51d569aac7b26a5b6e82a8996d4871f444d227be374816d626: Status 404 returned error can't find the container with id b114377f8f337e51d569aac7b26a5b6e82a8996d4871f444d227be374816d626
Jul 27 18:46:24.864267 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:24.864156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-rhxst" event={"ID":"49acff4f-4b4c-496b-bc02-3db361ca992b","Type":"ContainerStarted","Data":"46718203d62a1f1e89164bb710c9d2b3038cdd8045225a8c9d7d070a38601f04"}
Jul 27 18:46:24.864267 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:24.864212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fcbb5cd48-rhxst" event={"ID":"49acff4f-4b4c-496b-bc02-3db361ca992b","Type":"ContainerStarted","Data":"b114377f8f337e51d569aac7b26a5b6e82a8996d4871f444d227be374816d626"}
Jul 27 18:46:24.864734 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:24.864283    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:24.899358 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:24.899294    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fcbb5cd48-rhxst" podStartSLOduration=1.517474113 podStartE2EDuration="1.899274933s" totalImagesPullingTime="381.80082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:46:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:46:24.897636298 +0000 UTC m=+909.650430719" watchObservedRunningTime="2026-07-27 18:46:24.899274933 +0000 UTC m=+909.652069353"
Jul 27 18:46:35.871191 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:35.871158    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fcbb5cd48-rhxst"
Jul 27 18:46:54.997299 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:54.997258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:46:57.454347 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:57.454309    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:46:57.555875 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:57.555832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:46:57.724098 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:46:57.724001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:47:03.669079 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:47:03.669038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:47:03.777993 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:47:03.777954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:47:03.875315 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:47:03.875278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:47:04.042428 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:47:04.042330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:47:09.960274 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:47:09.960231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:47:10.027288 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:47:10.027252    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:48:31.634383 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:48:31.634338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:49:18.900812 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:49:18.900689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:49:19.606127 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:49:19.606091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:49:19.689362 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:49:19.689323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:54:27.524912 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:54:27.524870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:54:48.136350 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:54:48.136314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:54:55.051566 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:54:55.051502    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:55:31.727405 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:55:31.727324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:56:11.270034 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:56:11.269970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:56:12.382328 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:56:12.382264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:56:54.964913 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:56:54.964875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:25.147491 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:25.147451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:46.625470 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:46.625430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:49.711425 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:49.711381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:49.807069 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:49.807030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:50.199688 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:50.199649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:56.205532 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.205486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:56.301807 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.301773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:56.432144 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.432111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:56.722700 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.722664    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"]
Jul 27 18:59:56.726191 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.726167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.730874 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.730849    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-165a5b4f-openshift-default-dockercfg-bpt62\""
Jul 27 18:59:56.744062 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.744033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:56.752829 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.752788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"]
Jul 27 18:59:56.821619 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-credential-socket\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.821856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-envoy\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.821856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-socket\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.821856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092aee0c-6fef-4e71-bfef-8b19754cb284-istiod-ca-cert\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.821856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-certs\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.821856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-data\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.821856 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg8hz\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-kube-api-access-qg8hz\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.822095 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.821963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-token\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.822155 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.822137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-podinfo\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.909991 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.909955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:56.923627 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.923589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-podinfo\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.923852 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.923638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-credential-socket\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.923852 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.923791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-envoy\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.923992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.923861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-socket\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.923992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.923915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092aee0c-6fef-4e71-bfef-8b19754cb284-istiod-ca-cert\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.923992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.923953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-certs\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.923992 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.923979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-data\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.924188 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.924020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg8hz\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-kube-api-access-qg8hz\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.924188 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.924097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-credential-socket\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.924188 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.924120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-token\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.924336 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.924214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-socket\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.924336 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.924301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-certs\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.924673 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.924654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092aee0c-6fef-4e71-bfef-8b19754cb284-istiod-ca-cert\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.924799 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.924778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-data\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.926429 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.926405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-envoy\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.926542 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.926525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-podinfo\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.933008 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.932966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-token\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:56.933140 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:56.933073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg8hz\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-kube-api-access-qg8hz\") pod \"e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") " pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:57.038293 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.038175    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:57.195545 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.195515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"]
Jul 27 18:59:57.197982 ip-10-0-140-183 kubenswrapper[2578]: W0727 18:59:57.197945    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092aee0c_6fef_4e71_bfef_8b19754cb284.slice/crio-6d28f6f19b95d0c25b94050e5b754a9e7f40c68c0c52d74efdda0b1beaab9dbc WatchSource:0}: Error finding container 6d28f6f19b95d0c25b94050e5b754a9e7f40c68c0c52d74efdda0b1beaab9dbc: Status 404 returned error can't find the container with id 6d28f6f19b95d0c25b94050e5b754a9e7f40c68c0c52d74efdda0b1beaab9dbc
Jul 27 18:59:57.200671 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.200631    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:59:57.200771 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.200716    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:59:57.200822 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.200789    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 18:59:57.888694 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.888657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" event={"ID":"092aee0c-6fef-4e71-bfef-8b19754cb284","Type":"ContainerStarted","Data":"f0e31064110d073d59294506084610202038a7909c60e7c0c7da4fd1a0ccb183"}
Jul 27 18:59:57.889202 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.888709    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" event={"ID":"092aee0c-6fef-4e71-bfef-8b19754cb284","Type":"ContainerStarted","Data":"6d28f6f19b95d0c25b94050e5b754a9e7f40c68c0c52d74efdda0b1beaab9dbc"}
Jul 27 18:59:57.910774 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:57.910693    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podStartSLOduration=1.910674414 podStartE2EDuration="1.910674414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:59:57.909184919 +0000 UTC m=+1722.661979364" watchObservedRunningTime="2026-07-27 18:59:57.910674414 +0000 UTC m=+1722.663468833"
Jul 27 18:59:58.038826 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:58.038782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:58.045175 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:58.045142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:58.893815 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:58.893783    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:58.894973 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:58.894952    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 18:59:59.271671 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.271546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:59.439120 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.439081    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"]
Jul 27 18:59:59.442615 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.442590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.448778 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.448732    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-165a5b4f-serving-cert\""
Jul 27 18:59:59.475830 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.475788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"]
Jul 27 18:59:59.482783 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.482716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:59.548646 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.548548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.548646 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.548591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72jn\" (UniqueName: \"kubernetes.io/projected/64df5d72-32cf-4bec-b144-0f943f3ffbeb-kube-api-access-c72jn\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.548891 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.548688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64df5d72-32cf-4bec-b144-0f943f3ffbeb-openshift-service-ca\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.581401 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.581362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 18:59:59.650014 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.649969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.650014 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.650017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c72jn\" (UniqueName: \"kubernetes.io/projected/64df5d72-32cf-4bec-b144-0f943f3ffbeb-kube-api-access-c72jn\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.650241 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.650063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64df5d72-32cf-4bec-b144-0f943f3ffbeb-openshift-service-ca\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.650241 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:59:59.650146    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-serving-cert: secret "maas-api-e2e-ait-165a5b4f-serving-cert" not found
Jul 27 18:59:59.650241 ip-10-0-140-183 kubenswrapper[2578]: E0727 18:59:59.650237    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls podName:64df5d72-32cf-4bec-b144-0f943f3ffbeb nodeName:}" failed. No retries permitted until 2026-07-27 19:00:00.150214447 +0000 UTC m=+1724.903008845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls") pod "maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz" (UID: "64df5d72-32cf-4bec-b144-0f943f3ffbeb") : secret "maas-api-e2e-ait-165a5b4f-serving-cert" not found
Jul 27 18:59:59.650695 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.650673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64df5d72-32cf-4bec-b144-0f943f3ffbeb-openshift-service-ca\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 18:59:59.659254 ip-10-0-140-183 kubenswrapper[2578]: I0727 18:59:59.659227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72jn\" (UniqueName: \"kubernetes.io/projected/64df5d72-32cf-4bec-b144-0f943f3ffbeb-kube-api-access-c72jn\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:00.155760 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.155697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:00.158593 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.158563    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls\") pod \"maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:00.182350 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.182311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:00.256322 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.256279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:00.355474 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.355432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:00.526931 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.524044    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"]
Jul 27 19:00:00.529015 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:00:00.528975    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64df5d72_32cf_4bec_b144_0f943f3ffbeb.slice/crio-4d60d0de3317358db58cd6f67db638d3c51f78c6e33e0208a7875275422e2099 WatchSource:0}: Error finding container 4d60d0de3317358db58cd6f67db638d3c51f78c6e33e0208a7875275422e2099: Status 404 returned error can't find the container with id 4d60d0de3317358db58cd6f67db638d3c51f78c6e33e0208a7875275422e2099
Jul 27 19:00:00.530866 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.530842    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:00:00.905128 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:00.905084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz" event={"ID":"64df5d72-32cf-4bec-b144-0f943f3ffbeb","Type":"ContainerStarted","Data":"4d60d0de3317358db58cd6f67db638d3c51f78c6e33e0208a7875275422e2099"}
Jul 27 19:00:01.911575 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:01.911538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz" event={"ID":"64df5d72-32cf-4bec-b144-0f943f3ffbeb","Type":"ContainerStarted","Data":"055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d"}
Jul 27 19:00:01.912078 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:01.911647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:01.932397 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:01.932327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz" podStartSLOduration=1.96546524 podStartE2EDuration="2.93230898s" totalImagesPullingTime="966.84374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:01.931011684 +0000 UTC m=+1726.683806108" watchObservedRunningTime="2026-07-27 19:00:01.93230898 +0000 UTC m=+1726.685103400"
Jul 27 19:00:07.922453 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:07.922412    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:14.935961 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:14.935917    2578 patch_prober.go:28] interesting pod/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 19:00:14.936493 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:14.936006    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:00:17.004434 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:17.004396    2578 generic.go:356] "Generic (PLEG): container finished" podID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerID="f0e31064110d073d59294506084610202038a7909c60e7c0c7da4fd1a0ccb183" exitCode=0
Jul 27 19:00:17.005045 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:17.004475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" event={"ID":"092aee0c-6fef-4e71-bfef-8b19754cb284","Type":"ContainerDied","Data":"f0e31064110d073d59294506084610202038a7909c60e7c0c7da4fd1a0ccb183"}
Jul 27 19:00:17.005124 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:17.005042    2578 scope.go:117] "RemoveContainer" containerID="f0e31064110d073d59294506084610202038a7909c60e7c0c7da4fd1a0ccb183"
Jul 27 19:00:17.006208 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:17.006172    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:00:17.006327 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:17.006249    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:00:17.006327 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:17.006300    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:00:18.011998 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:18.011958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" event={"ID":"092aee0c-6fef-4e71-bfef-8b19754cb284","Type":"ContainerStarted","Data":"e3b829b759ce2e8eac63350e0f86462990a2c515939772eb1b94134cfa89921d"}
Jul 27 19:00:18.038685 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:18.038646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 19:00:18.038929 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:18.038907    2578 patch_prober.go:28] interesting pod/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:00:18.038992 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:18.038951    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 27 19:00:19.038755 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:19.038715    2578 patch_prober.go:28] interesting pod/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:00:19.039198 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:19.038801    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 27 19:00:20.039311 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:20.039268    2578 patch_prober.go:28] interesting pod/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:00:20.039725 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:20.039327    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 27 19:00:21.038564 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:21.038531    2578 patch_prober.go:28] interesting pod/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:00:21.038761 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:21.038589    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 27 19:00:22.039230 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:22.039189    2578 patch_prober.go:28] interesting pod/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:00:22.039642 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:22.039254    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 27 19:00:23.043694 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:23.043658    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 19:00:23.044189 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:23.044054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 19:00:23.044840 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:23.044822    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 19:00:35.240805 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.240763    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"]
Jul 27 19:00:35.241452 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.241039    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz" podUID="64df5d72-32cf-4bec-b144-0f943f3ffbeb" containerName="maas-api" containerID="cri-o://055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d" gracePeriod=30
Jul 27 19:00:35.268479 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.268447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:35.345181 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.345142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:35.518639 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.518601    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:35.523874 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.523843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:35.609719 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.609664    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64df5d72-32cf-4bec-b144-0f943f3ffbeb-openshift-service-ca\") pod \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") "
Jul 27 19:00:35.609719 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.609729    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls\") pod \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") "
Jul 27 19:00:35.610032 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.609798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c72jn\" (UniqueName: \"kubernetes.io/projected/64df5d72-32cf-4bec-b144-0f943f3ffbeb-kube-api-access-c72jn\") pod \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\" (UID: \"64df5d72-32cf-4bec-b144-0f943f3ffbeb\") "
Jul 27 19:00:35.610166 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.610140    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64df5d72-32cf-4bec-b144-0f943f3ffbeb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64df5d72-32cf-4bec-b144-0f943f3ffbeb" (UID: "64df5d72-32cf-4bec-b144-0f943f3ffbeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:35.612390 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.612353    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64df5d72-32cf-4bec-b144-0f943f3ffbeb" (UID: "64df5d72-32cf-4bec-b144-0f943f3ffbeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:00:35.612390 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.612366    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64df5d72-32cf-4bec-b144-0f943f3ffbeb-kube-api-access-c72jn" (OuterVolumeSpecName: "kube-api-access-c72jn") pod "64df5d72-32cf-4bec-b144-0f943f3ffbeb" (UID: "64df5d72-32cf-4bec-b144-0f943f3ffbeb"). InnerVolumeSpecName "kube-api-access-c72jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:00:35.711483 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.711433    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64df5d72-32cf-4bec-b144-0f943f3ffbeb-openshift-service-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:35.711483 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.711479    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64df5d72-32cf-4bec-b144-0f943f3ffbeb-maas-api-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:35.711483 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:35.711489    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c72jn\" (UniqueName: \"kubernetes.io/projected/64df5d72-32cf-4bec-b144-0f943f3ffbeb-kube-api-access-c72jn\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:36.108974 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.108872    2578 generic.go:356] "Generic (PLEG): container finished" podID="64df5d72-32cf-4bec-b144-0f943f3ffbeb" containerID="055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d" exitCode=0
Jul 27 19:00:36.108974 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.108942    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"
Jul 27 19:00:36.108974 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.108960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz" event={"ID":"64df5d72-32cf-4bec-b144-0f943f3ffbeb","Type":"ContainerDied","Data":"055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d"}
Jul 27 19:00:36.109256 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.109047    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz" event={"ID":"64df5d72-32cf-4bec-b144-0f943f3ffbeb","Type":"ContainerDied","Data":"4d60d0de3317358db58cd6f67db638d3c51f78c6e33e0208a7875275422e2099"}
Jul 27 19:00:36.109256 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.109071    2578 scope.go:117] "RemoveContainer" containerID="055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d"
Jul 27 19:00:36.118441 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.118421    2578 scope.go:117] "RemoveContainer" containerID="055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d"
Jul 27 19:00:36.118775 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:00:36.118732    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d\": container with ID starting with 055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d not found: ID does not exist" containerID="055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d"
Jul 27 19:00:36.118870 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.118788    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d"} err="failed to get container status \"055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d\": rpc error: code = NotFound desc = could not find container \"055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d\": container with ID starting with 055d180970ce059de922dcc38097cf2df295b1bad0759b547bd2fbd77d7afd7d not found: ID does not exist"
Jul 27 19:00:36.153253 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.153204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"]
Jul 27 19:00:36.158053 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:36.158012    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-165a5b4f-8854dc59c-c6bsz"]
Jul 27 19:00:37.846197 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:37.846153    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64df5d72-32cf-4bec-b144-0f943f3ffbeb" path="/var/lib/kubelet/pods/64df5d72-32cf-4bec-b144-0f943f3ffbeb/volumes"
Jul 27 19:00:39.908082 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:39.908047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:40.039177 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:40.039144    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"]
Jul 27 19:00:40.039410 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:40.039376    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy" containerID="cri-o://e3b829b759ce2e8eac63350e0f86462990a2c515939772eb1b94134cfa89921d" gracePeriod=30
Jul 27 19:00:40.068353 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:40.068319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:40.281261 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:40.281173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:40.528476 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:40.528420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:40.626385 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:40.626304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:41.060269 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.060225    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"]
Jul 27 19:00:41.060684 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.060673    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64df5d72-32cf-4bec-b144-0f943f3ffbeb" containerName="maas-api"
Jul 27 19:00:41.060727 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.060689    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64df5d72-32cf-4bec-b144-0f943f3ffbeb" containerName="maas-api"
Jul 27 19:00:41.060795 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.060789    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64df5d72-32cf-4bec-b144-0f943f3ffbeb" containerName="maas-api"
Jul 27 19:00:41.065393 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.065364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.068873 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.068849    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e045185e-gw-openshift-default-dockercfg-8tkt6\""
Jul 27 19:00:41.075721 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.075683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"]
Jul 27 19:00:41.163617 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-envoy\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.163893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc9d\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-kube-api-access-rbc9d\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.163893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163700    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-credential-socket\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.163893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-token\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.163893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-socket\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.163893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-certs\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.163893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-data\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.164220 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.163955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-podinfo\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.164220 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.164027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istiod-ca-cert\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.196604 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.196555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:41.265186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-socket\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265369 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-certs\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265369 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-data\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265369 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-podinfo\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istiod-ca-cert\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-envoy\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265588 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc9d\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-kube-api-access-rbc9d\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265634 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-socket\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265634 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-credential-socket\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265734 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-data\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265734 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-token\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.265959 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.265939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-credential-socket\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.266090 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.266068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-certs\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.266285 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.266264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istiod-ca-cert\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.268187 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.268158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-envoy\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.268429 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.268404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-podinfo\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.274658 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.274626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-token\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.274888 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.274863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc9d\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-kube-api-access-rbc9d\") pod \"e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") " pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.299807 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.299768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:41.378986 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.378889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:41.401065 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.401034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:41.537591 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.537562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"]
Jul 27 19:00:41.539837 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:00:41.539795    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod729dbc2c_7bc9_4ae2_abdc_49e78551583e.slice/crio-f954a7c00efd3e72e50644275b63efb287bcf75b21222d16d4be587cd855ef43 WatchSource:0}: Error finding container f954a7c00efd3e72e50644275b63efb287bcf75b21222d16d4be587cd855ef43: Status 404 returned error can't find the container with id f954a7c00efd3e72e50644275b63efb287bcf75b21222d16d4be587cd855ef43
Jul 27 19:00:41.542099 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.542050    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:00:41.542212 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.542158    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:00:41.542212 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:41.542206    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:00:42.143496 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:42.143456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" event={"ID":"729dbc2c-7bc9-4ae2-abdc-49e78551583e","Type":"ContainerStarted","Data":"24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d"}
Jul 27 19:00:42.143963 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:42.143514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" event={"ID":"729dbc2c-7bc9-4ae2-abdc-49e78551583e","Type":"ContainerStarted","Data":"f954a7c00efd3e72e50644275b63efb287bcf75b21222d16d4be587cd855ef43"}
Jul 27 19:00:42.174987 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:42.174926    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" podStartSLOduration=1.174905067 podStartE2EDuration="1.174905067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:42.171938312 +0000 UTC m=+1766.924732744" watchObservedRunningTime="2026-07-27 19:00:42.174905067 +0000 UTC m=+1766.927699487"
Jul 27 19:00:42.379514 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:42.379478    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:42.384999 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:42.384969    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:43.148804 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:43.148771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:43.149948 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:43.149928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:00:44.004831 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.004800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:44.121491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.121453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:44.223290 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.223243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:44.434181 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.434146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:44.531328 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.531295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:00:44.583620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.583578    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"]
Jul 27 19:00:44.587351 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.587322    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:44.590272 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.590239    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e045185e-dockercfg-6jzjn\""
Jul 27 19:00:44.590665 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.590645    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e045185e\""
Jul 27 19:00:44.604005 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.603969    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"]
Jul 27 19:00:44.707357 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.707247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dbd8c-99bf-4256-9081-6694dafe94fe-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") " pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:44.707939 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.707906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl4jp\" (UniqueName: \"kubernetes.io/projected/3f4dbd8c-99bf-4256-9081-6694dafe94fe-kube-api-access-rl4jp\") pod \"payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") " pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:44.808924 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.808882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl4jp\" (UniqueName: \"kubernetes.io/projected/3f4dbd8c-99bf-4256-9081-6694dafe94fe-kube-api-access-rl4jp\") pod \"payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") " pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:44.809161 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.808951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dbd8c-99bf-4256-9081-6694dafe94fe-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") " pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:44.809684 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.809659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dbd8c-99bf-4256-9081-6694dafe94fe-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") " pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:44.819817 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.819782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl4jp\" (UniqueName: \"kubernetes.io/projected/3f4dbd8c-99bf-4256-9081-6694dafe94fe-kube-api-access-rl4jp\") pod \"payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") " pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:44.899334 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:44.899295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:45.061335 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.061301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"]
Jul 27 19:00:45.064545 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:00:45.064512    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4dbd8c_99bf_4256_9081_6694dafe94fe.slice/crio-d334ede079a0e116aa12daa3d0d24496bada00c1374e99e1e32bf9fe876e7445 WatchSource:0}: Error finding container d334ede079a0e116aa12daa3d0d24496bada00c1374e99e1e32bf9fe876e7445: Status 404 returned error can't find the container with id d334ede079a0e116aa12daa3d0d24496bada00c1374e99e1e32bf9fe876e7445
Jul 27 19:00:45.161577 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.161543    2578 generic.go:356] "Generic (PLEG): container finished" podID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerID="e3b829b759ce2e8eac63350e0f86462990a2c515939772eb1b94134cfa89921d" exitCode=0
Jul 27 19:00:45.161763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.161614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" event={"ID":"092aee0c-6fef-4e71-bfef-8b19754cb284","Type":"ContainerDied","Data":"e3b829b759ce2e8eac63350e0f86462990a2c515939772eb1b94134cfa89921d"}
Jul 27 19:00:45.161763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.161690    2578 scope.go:117] "RemoveContainer" containerID="f0e31064110d073d59294506084610202038a7909c60e7c0c7da4fd1a0ccb183"
Jul 27 19:00:45.163340 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.163296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx" event={"ID":"3f4dbd8c-99bf-4256-9081-6694dafe94fe","Type":"ContainerStarted","Data":"d334ede079a0e116aa12daa3d0d24496bada00c1374e99e1e32bf9fe876e7445"}
Jul 27 19:00:45.300024 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.299993    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 19:00:45.414972 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.414933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092aee0c-6fef-4e71-bfef-8b19754cb284-istiod-ca-cert\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415190 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.414991    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-envoy\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415190 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415019    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-credential-socket\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415190 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-certs\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415190 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415114    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-token\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415190 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415152    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg8hz\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-kube-api-access-qg8hz\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415447 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-podinfo\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415447 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-socket\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415447 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-data\") pod \"092aee0c-6fef-4e71-bfef-8b19754cb284\" (UID: \"092aee0c-6fef-4e71-bfef-8b19754cb284\") "
Jul 27 19:00:45.415598 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415437    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:00:45.415598 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415445    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092aee0c-6fef-4e71-bfef-8b19754cb284-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:45.415598 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415447    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:00:45.415783 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415610    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:00:45.415783 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415681    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.415783 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415702    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092aee0c-6fef-4e71-bfef-8b19754cb284-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.415783 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415717    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.415783 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.415730    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.416509 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.416483    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-data" (OuterVolumeSpecName: "istio-data") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:00:45.417703 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.417680    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:00:45.417703 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.417693    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-token" (OuterVolumeSpecName: "istio-token") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:00:45.418097 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.418068    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:00:45.418200 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.418100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-kube-api-access-qg8hz" (OuterVolumeSpecName: "kube-api-access-qg8hz") pod "092aee0c-6fef-4e71-bfef-8b19754cb284" (UID: "092aee0c-6fef-4e71-bfef-8b19754cb284"). InnerVolumeSpecName "kube-api-access-qg8hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:00:45.516886 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.516848    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.516886 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.516878    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg8hz\" (UniqueName: \"kubernetes.io/projected/092aee0c-6fef-4e71-bfef-8b19754cb284-kube-api-access-qg8hz\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.516886 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.516889    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.517150 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.516898    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:45.517150 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:45.516909    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092aee0c-6fef-4e71-bfef-8b19754cb284-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:00:46.171341 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.171311    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"
Jul 27 19:00:46.171573 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.171341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65" event={"ID":"092aee0c-6fef-4e71-bfef-8b19754cb284","Type":"ContainerDied","Data":"6d28f6f19b95d0c25b94050e5b754a9e7f40c68c0c52d74efdda0b1beaab9dbc"}
Jul 27 19:00:46.171573 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.171417    2578 scope.go:117] "RemoveContainer" containerID="e3b829b759ce2e8eac63350e0f86462990a2c515939772eb1b94134cfa89921d"
Jul 27 19:00:46.173469 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.173430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx" event={"ID":"3f4dbd8c-99bf-4256-9081-6694dafe94fe","Type":"ContainerStarted","Data":"794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e"}
Jul 27 19:00:46.173621 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.173529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:46.195521 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.195439    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx" podStartSLOduration=2.195413793 podStartE2EDuration="2.195413793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:46.193438241 +0000 UTC m=+1770.946232684" watchObservedRunningTime="2026-07-27 19:00:46.195413793 +0000 UTC m=+1770.948208215"
Jul 27 19:00:46.210627 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.210585    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"]
Jul 27 19:00:46.216486 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:46.216447    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-165a5b4f-openshift-default-5c49b477b4-ztc65"]
Jul 27 19:00:47.847077 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:47.847036    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" path="/var/lib/kubelet/pods/092aee0c-6fef-4e71-bfef-8b19754cb284/volumes"
Jul 27 19:00:57.183830 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:57.183797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:00:59.191983 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:59.191933    2578 patch_prober.go:28] interesting pod/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 19:00:59.192392 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:00:59.192032    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:01:00.257636 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:00.257547    2578 generic.go:356] "Generic (PLEG): container finished" podID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerID="24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d" exitCode=0
Jul 27 19:01:00.258074 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:00.257625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" event={"ID":"729dbc2c-7bc9-4ae2-abdc-49e78551583e","Type":"ContainerDied","Data":"24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d"}
Jul 27 19:01:00.258120 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:00.258099    2578 scope.go:117] "RemoveContainer" containerID="24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d"
Jul 27 19:01:00.259292 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:00.259263    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:00.259361 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:00.259338    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:00.259400 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:00.259370    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:01.264982 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:01.264944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" event={"ID":"729dbc2c-7bc9-4ae2-abdc-49e78551583e","Type":"ContainerStarted","Data":"2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe"}
Jul 27 19:01:01.379447 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:01.379399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:01:01.379936 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:01.379904    2578 patch_prober.go:28] interesting pod/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:01:01.380046 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:01.379966    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 27 19:01:02.379458 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:02.379402    2578 patch_prober.go:28] interesting pod/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:01:02.380037 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:02.379488    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 27 19:01:03.379640 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:03.379587    2578 patch_prober.go:28] interesting pod/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:01:03.380206 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:03.379685    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 27 19:01:04.379645 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:04.379595    2578 patch_prober.go:28] interesting pod/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:01:04.380220 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:04.379674    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 27 19:01:05.384171 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:05.384135    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:01:05.384641 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:05.384445    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:01:05.385330 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:05.385310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:01:19.296259 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.296201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:19.323319 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.323278    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"]
Jul 27 19:01:19.323570 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.323542    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx" podUID="3f4dbd8c-99bf-4256-9081-6694dafe94fe" containerName="payload-processing" containerID="cri-o://794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e" gracePeriod=30
Jul 27 19:01:19.412552 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.412511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:19.581972 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.581939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:19.599889 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.599845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:01:19.753089 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.753056    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl4jp\" (UniqueName: \"kubernetes.io/projected/3f4dbd8c-99bf-4256-9081-6694dafe94fe-kube-api-access-rl4jp\") pod \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") "
Jul 27 19:01:19.753308 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.753139    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dbd8c-99bf-4256-9081-6694dafe94fe-plugins-config-volume\") pod \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\" (UID: \"3f4dbd8c-99bf-4256-9081-6694dafe94fe\") "
Jul 27 19:01:19.753577 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.753552    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4dbd8c-99bf-4256-9081-6694dafe94fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f4dbd8c-99bf-4256-9081-6694dafe94fe" (UID: "3f4dbd8c-99bf-4256-9081-6694dafe94fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:01:19.755607 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.755575    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4dbd8c-99bf-4256-9081-6694dafe94fe-kube-api-access-rl4jp" (OuterVolumeSpecName: "kube-api-access-rl4jp") pod "3f4dbd8c-99bf-4256-9081-6694dafe94fe" (UID: "3f4dbd8c-99bf-4256-9081-6694dafe94fe"). InnerVolumeSpecName "kube-api-access-rl4jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:01:19.853975 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.853944    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl4jp\" (UniqueName: \"kubernetes.io/projected/3f4dbd8c-99bf-4256-9081-6694dafe94fe-kube-api-access-rl4jp\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:19.853975 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:19.853972    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dbd8c-99bf-4256-9081-6694dafe94fe-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:20.379267 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.379226    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f4dbd8c-99bf-4256-9081-6694dafe94fe" containerID="794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e" exitCode=0
Jul 27 19:01:20.379267 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.379279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx" event={"ID":"3f4dbd8c-99bf-4256-9081-6694dafe94fe","Type":"ContainerDied","Data":"794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e"}
Jul 27 19:01:20.379891 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.379283    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"
Jul 27 19:01:20.379891 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.379331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx" event={"ID":"3f4dbd8c-99bf-4256-9081-6694dafe94fe","Type":"ContainerDied","Data":"d334ede079a0e116aa12daa3d0d24496bada00c1374e99e1e32bf9fe876e7445"}
Jul 27 19:01:20.379891 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.379355    2578 scope.go:117] "RemoveContainer" containerID="794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e"
Jul 27 19:01:20.389613 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.389588    2578 scope.go:117] "RemoveContainer" containerID="794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e"
Jul 27 19:01:20.390021 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:01:20.390001    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e\": container with ID starting with 794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e not found: ID does not exist" containerID="794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e"
Jul 27 19:01:20.390084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.390036    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e"} err="failed to get container status \"794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e\": rpc error: code = NotFound desc = could not find container \"794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e\": container with ID starting with 794ff599199d331e5a3f4f602365456e51729a16cc1e1e1ff922ddc201d7618e not found: ID does not exist"
Jul 27 19:01:20.397582 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.397543    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"]
Jul 27 19:01:20.401774 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:20.401718    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e045185e-5d4458795c-7kjbx"]
Jul 27 19:01:21.846271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:21.846233    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f4dbd8c-99bf-4256-9081-6694dafe94fe" path="/var/lib/kubelet/pods/3f4dbd8c-99bf-4256-9081-6694dafe94fe/volumes"
Jul 27 19:01:23.693417 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:23.693374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:23.822272 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:23.822233    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"]
Jul 27 19:01:23.822578 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:23.822535    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy" containerID="cri-o://2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe" gracePeriod=30
Jul 27 19:01:23.843720 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:23.843668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:24.077040 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.076935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:24.313878 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.313839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:24.617926 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.617889    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"]
Jul 27 19:01:24.618279 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.618266    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy"
Jul 27 19:01:24.618358 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.618280    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy"
Jul 27 19:01:24.618358 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.618297    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4dbd8c-99bf-4256-9081-6694dafe94fe" containerName="payload-processing"
Jul 27 19:01:24.618358 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.618303    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4dbd8c-99bf-4256-9081-6694dafe94fe" containerName="payload-processing"
Jul 27 19:01:24.618484 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.618371    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy"
Jul 27 19:01:24.618484 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.618380    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4dbd8c-99bf-4256-9081-6694dafe94fe" containerName="payload-processing"
Jul 27 19:01:24.621315 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.621290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.624017 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.623997    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cf4c6eb2-openshift-default-dockercfg-2dp9t\""
Jul 27 19:01:24.634369 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.634336    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"]
Jul 27 19:01:24.646136 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.646105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:24.702101 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.701965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-envoy\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702101 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9mr6\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-kube-api-access-h9mr6\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-socket\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-certs\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7f0c35-8255-4289-9316-e756edd7c4a5-istiod-ca-cert\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-credential-socket\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-podinfo\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-token\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.702620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.702402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-data\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.803468 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-socket\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.803468 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-certs\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.803797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7f0c35-8255-4289-9316-e756edd7c4a5-istiod-ca-cert\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.803797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-credential-socket\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.803797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-podinfo\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.803797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-token\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.803797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-data\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.804088 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-envoy\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.804088 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9mr6\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-kube-api-access-h9mr6\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.804088 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.803953    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-socket\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.804088 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.804037    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-credential-socket\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.804232 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.804120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-data\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.804321 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.804303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-certs\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.804388 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.804367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7f0c35-8255-4289-9316-e756edd7c4a5-istiod-ca-cert\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.806348 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.806323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-envoy\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.806483 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.806472    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-podinfo\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.813708 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.813673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-token\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.813908 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.813791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9mr6\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-kube-api-access-h9mr6\") pod \"e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") " pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.934905 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.934865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:24.990031 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:24.989982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:25.090769 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.090725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"]
Jul 27 19:01:25.093014 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:01:25.092981    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7f0c35_8255_4289_9316_e756edd7c4a5.slice/crio-7e85b7593915b4d7f0de0ccae75de61e82743b9bf2561b0520d32aaff928fb9e WatchSource:0}: Error finding container 7e85b7593915b4d7f0de0ccae75de61e82743b9bf2561b0520d32aaff928fb9e: Status 404 returned error can't find the container with id 7e85b7593915b4d7f0de0ccae75de61e82743b9bf2561b0520d32aaff928fb9e
Jul 27 19:01:25.095507 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.095467    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:25.095607 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.095547    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:25.095607 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.095578    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:25.409436 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.409399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" event={"ID":"5b7f0c35-8255-4289-9316-e756edd7c4a5","Type":"ContainerStarted","Data":"ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac"}
Jul 27 19:01:25.409606 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.409458    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" event={"ID":"5b7f0c35-8255-4289-9316-e756edd7c4a5","Type":"ContainerStarted","Data":"7e85b7593915b4d7f0de0ccae75de61e82743b9bf2561b0520d32aaff928fb9e"}
Jul 27 19:01:25.432719 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.432653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" podStartSLOduration=1.432635651 podStartE2EDuration="1.432635651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:01:25.430468154 +0000 UTC m=+1810.183262575" watchObservedRunningTime="2026-07-27 19:01:25.432635651 +0000 UTC m=+1810.185430070"
Jul 27 19:01:25.935921 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:25.935877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:26.757212 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:26.757171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:26.820129 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:26.820065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:26.943020 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:26.942987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:26.977799 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:26.977767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:27.342108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:27.342063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:27.419829 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:27.419790    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:27.420839 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:27.420811    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:27.611237 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:27.611133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:27.708356 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:27.708318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:01:29.095797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.095686    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:01:29.150487 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-envoy\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150487 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150490    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-data\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150757 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-token\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150757 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150557    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-certs\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150757 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbc9d\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-kube-api-access-rbc9d\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150927 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-credential-socket\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150927 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150859    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-socket\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150927 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-podinfo\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.150927 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150918    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istiod-ca-cert\") pod \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\" (UID: \"729dbc2c-7bc9-4ae2-abdc-49e78551583e\") "
Jul 27 19:01:29.151133 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.150961    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:01:29.151133 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.151099    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:01:29.151133 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.151114    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:01:29.151410 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.151389    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-data" (OuterVolumeSpecName: "istio-data") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:01:29.151410 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.151390    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.151524 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.151428    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.151524 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.151441    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.151625 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.151600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:01:29.153083 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.153050    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:01:29.153450 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.153428    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-kube-api-access-rbc9d" (OuterVolumeSpecName: "kube-api-access-rbc9d") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "kube-api-access-rbc9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:01:29.153594 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.153576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:01:29.153650 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.153575    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-token" (OuterVolumeSpecName: "istio-token") pod "729dbc2c-7bc9-4ae2-abdc-49e78551583e" (UID: "729dbc2c-7bc9-4ae2-abdc-49e78551583e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:01:29.252378 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.252338    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.252378 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.252373    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.252378 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.252382    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.252378 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.252392    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbc9d\" (UniqueName: \"kubernetes.io/projected/729dbc2c-7bc9-4ae2-abdc-49e78551583e-kube-api-access-rbc9d\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.252678 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.252401    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.252678 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.252409    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/729dbc2c-7bc9-4ae2-abdc-49e78551583e-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:01:29.430902 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.430864    2578 generic.go:356] "Generic (PLEG): container finished" podID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerID="2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe" exitCode=0
Jul 27 19:01:29.431070 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.430922    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"
Jul 27 19:01:29.431070 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.430960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" event={"ID":"729dbc2c-7bc9-4ae2-abdc-49e78551583e","Type":"ContainerDied","Data":"2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe"}
Jul 27 19:01:29.431070 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.431025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw" event={"ID":"729dbc2c-7bc9-4ae2-abdc-49e78551583e","Type":"ContainerDied","Data":"f954a7c00efd3e72e50644275b63efb287bcf75b21222d16d4be587cd855ef43"}
Jul 27 19:01:29.431070 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.431054    2578 scope.go:117] "RemoveContainer" containerID="2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe"
Jul 27 19:01:29.441292 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.441266    2578 scope.go:117] "RemoveContainer" containerID="24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d"
Jul 27 19:01:29.451679 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.451522    2578 scope.go:117] "RemoveContainer" containerID="2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe"
Jul 27 19:01:29.452056 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:01:29.452027    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe\": container with ID starting with 2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe not found: ID does not exist" containerID="2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe"
Jul 27 19:01:29.452141 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.452061    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe"} err="failed to get container status \"2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe\": rpc error: code = NotFound desc = could not find container \"2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe\": container with ID starting with 2878207fc24879afa94f1785ec17525c139f4356358929dfce7eb2bc88dc3cfe not found: ID does not exist"
Jul 27 19:01:29.452141 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.452081    2578 scope.go:117] "RemoveContainer" containerID="24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d"
Jul 27 19:01:29.452389 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:01:29.452370    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d\": container with ID starting with 24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d not found: ID does not exist" containerID="24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d"
Jul 27 19:01:29.452441 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.452394    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d"} err="failed to get container status \"24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d\": rpc error: code = NotFound desc = could not find container \"24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d\": container with ID starting with 24ca44c096adf91cf1f6bb53f908190bbe650437e6d1a6cc41e3147f65b3f13d not found: ID does not exist"
Jul 27 19:01:29.453510 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.453491    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"]
Jul 27 19:01:29.457530 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.457493    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e045185e-gw-openshift-default-58896c9cbd-c68kw"]
Jul 27 19:01:29.846938 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:29.846847    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" path="/var/lib/kubelet/pods/729dbc2c-7bc9-4ae2-abdc-49e78551583e/volumes"
Jul 27 19:01:42.646385 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:42.646311    2578 patch_prober.go:28] interesting pod/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:40678->10.132.0.40:15021: read: connection reset by peer" start-of-body=
Jul 27 19:01:42.646778 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:42.646389    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:40678->10.132.0.40:15021: read: connection reset by peer"
Jul 27 19:01:43.508089 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:43.508050    2578 generic.go:356] "Generic (PLEG): container finished" podID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerID="ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac" exitCode=0
Jul 27 19:01:43.508274 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:43.508131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" event={"ID":"5b7f0c35-8255-4289-9316-e756edd7c4a5","Type":"ContainerDied","Data":"ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac"}
Jul 27 19:01:43.508587 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:43.508570    2578 scope.go:117] "RemoveContainer" containerID="ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac"
Jul 27 19:01:43.509693 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:43.509665    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:43.510003 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:43.509735    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:43.510003 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:43.509791    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:01:44.515577 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:44.515540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" event={"ID":"5b7f0c35-8255-4289-9316-e756edd7c4a5","Type":"ContainerStarted","Data":"26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d"}
Jul 27 19:01:44.935727 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:44.935685    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:44.936131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:44.936102    2578 patch_prober.go:28] interesting pod/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 27 19:01:44.936199 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:44.936166    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 27 19:01:45.936069 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:45.936029    2578 patch_prober.go:28] interesting pod/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 27 19:01:45.936503 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:45.936093    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 27 19:01:46.935831 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:46.935788    2578 patch_prober.go:28] interesting pod/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 27 19:01:46.936045 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:46.935850    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 27 19:01:47.936110 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:47.936066    2578 patch_prober.go:28] interesting pod/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 27 19:01:47.936616 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:47.936139    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 27 19:01:48.939537 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:48.939494    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:48.940088 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:48.939924    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:01:48.940894 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:01:48.940869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:02:02.986761 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:02.986662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:03.055027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:03.054961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:03.116881 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:03.116816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:07.648679 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:07.648640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:08.796938 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:08.796902    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"]
Jul 27 19:02:08.797368 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:08.797126    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy" containerID="cri-o://26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d" gracePeriod=30
Jul 27 19:02:08.820678 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:08.820636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:09.045510 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.045477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:09.300278 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.300242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:09.644398 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.644351    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"]
Jul 27 19:02:09.644860 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.644843    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy"
Jul 27 19:02:09.644860 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.644862    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy"
Jul 27 19:02:09.644970 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.644886    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy"
Jul 27 19:02:09.644970 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.644893    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy"
Jul 27 19:02:09.645041 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.644986    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy"
Jul 27 19:02:09.645041 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.644997    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="092aee0c-6fef-4e71-bfef-8b19754cb284" containerName="istio-proxy"
Jul 27 19:02:09.648126 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.648099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.650578 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.650554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-27df8036-openshift-default-dockercfg-kg8bq\""
Jul 27 19:02:09.672144 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.672105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"]
Jul 27 19:02:09.683678 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.683647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:09.748297 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-socket\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-envoy\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59081967-e6a7-44e4-bd88-086f7a40086a-istio-podinfo\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-istio-token\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-certs\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-credential-socket\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59081967-e6a7-44e4-bd88-086f7a40086a-istiod-ca-cert\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748785 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9vpk\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-kube-api-access-d9vpk\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.748785 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.748633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-data\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.758128 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.758091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:09.849987 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.849942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-socket\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.849987 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.849982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-envoy\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59081967-e6a7-44e4-bd88-086f7a40086a-istio-podinfo\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-istio-token\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-certs\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-credential-socket\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59081967-e6a7-44e4-bd88-086f7a40086a-istiod-ca-cert\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9vpk\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-kube-api-access-d9vpk\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-data\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.850572 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-certs\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.851002 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-socket\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.851002 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.850734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-data\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.851125 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.851032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-credential-socket\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.851257 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.851235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59081967-e6a7-44e4-bd88-086f7a40086a-istiod-ca-cert\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.852765 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.852719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-envoy\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.852910 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.852894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59081967-e6a7-44e4-bd88-086f7a40086a-istio-podinfo\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.859639 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.859602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-istio-token\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.859827 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.859689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9vpk\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-kube-api-access-d9vpk\") pod \"e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") " pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:09.960037 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:09.959932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:10.116474 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.116443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"]
Jul 27 19:02:10.119186 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:02:10.119148    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59081967_e6a7_44e4_bd88_086f7a40086a.slice/crio-e5481074cad007b0f72b6ab2f2c720146bc4ca8d944978d3c0aee9439c063d59 WatchSource:0}: Error finding container e5481074cad007b0f72b6ab2f2c720146bc4ca8d944978d3c0aee9439c063d59: Status 404 returned error can't find the container with id e5481074cad007b0f72b6ab2f2c720146bc4ca8d944978d3c0aee9439c063d59
Jul 27 19:02:10.121547 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.121500    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:02:10.121627 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.121605    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:02:10.121665 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.121653    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:02:10.660507 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.660462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" event={"ID":"59081967-e6a7-44e4-bd88-086f7a40086a","Type":"ContainerStarted","Data":"b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b"}
Jul 27 19:02:10.660705 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.660565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" event={"ID":"59081967-e6a7-44e4-bd88-086f7a40086a","Type":"ContainerStarted","Data":"e5481074cad007b0f72b6ab2f2c720146bc4ca8d944978d3c0aee9439c063d59"}
Jul 27 19:02:10.685819 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.685726    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" podStartSLOduration=1.685705837 podStartE2EDuration="1.685705837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:02:10.683691037 +0000 UTC m=+1855.436485481" watchObservedRunningTime="2026-07-27 19:02:10.685705837 +0000 UTC m=+1855.438500259"
Jul 27 19:02:10.960914 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:10.960804    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:11.967024 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:11.966989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:12.023481 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.023447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:12.126638 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.126604    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:12.225202 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.225107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:12.635901 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.635862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:12.670908 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.670871    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:12.672117 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.672091    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:12.822571 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.822536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:12.918319 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.918219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:12.952757 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.952702    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"]
Jul 27 19:02:12.953142 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.953126    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy"
Jul 27 19:02:12.953184 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.953143    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy"
Jul 27 19:02:12.953220 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.953212    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="729dbc2c-7bc9-4ae2-abdc-49e78551583e" containerName="istio-proxy"
Jul 27 19:02:12.956440 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.956409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:12.959434 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.959407    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-27df8036\""
Jul 27 19:02:12.959601 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.959434    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-27df8036-dockercfg-zz559\""
Jul 27 19:02:12.969815 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.969780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"]
Jul 27 19:02:12.981186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.981141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hw4j\" (UniqueName: \"kubernetes.io/projected/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-kube-api-access-5hw4j\") pod \"payload-processing-e2e-derive-27df8036-559dfd78-khqbr\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") " pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:12.981426 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:12.981333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-plugins-config-volume\") pod \"payload-processing-e2e-derive-27df8036-559dfd78-khqbr\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") " pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:13.082383 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.082348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-plugins-config-volume\") pod \"payload-processing-e2e-derive-27df8036-559dfd78-khqbr\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") " pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:13.082611 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.082394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hw4j\" (UniqueName: \"kubernetes.io/projected/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-kube-api-access-5hw4j\") pod \"payload-processing-e2e-derive-27df8036-559dfd78-khqbr\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") " pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:13.083195 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.083164    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-plugins-config-volume\") pod \"payload-processing-e2e-derive-27df8036-559dfd78-khqbr\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") " pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:13.091158 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.091124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hw4j\" (UniqueName: \"kubernetes.io/projected/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-kube-api-access-5hw4j\") pod \"payload-processing-e2e-derive-27df8036-559dfd78-khqbr\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") " pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:13.273005 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.272903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:13.432923 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.432880    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"]
Jul 27 19:02:13.433161 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:02:13.433121    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1b5b32_b915_42f4_b3e0_910bb2e6e455.slice/crio-2acb8122dcb0195fbeaf00627c2e79bc39f5cf9f3867e7181cc4bb7a861104b5 WatchSource:0}: Error finding container 2acb8122dcb0195fbeaf00627c2e79bc39f5cf9f3867e7181cc4bb7a861104b5: Status 404 returned error can't find the container with id 2acb8122dcb0195fbeaf00627c2e79bc39f5cf9f3867e7181cc4bb7a861104b5
Jul 27 19:02:13.677788 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.677724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr" event={"ID":"5f1b5b32-b915-42f4-b3e0-910bb2e6e455","Type":"ContainerStarted","Data":"58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2"}
Jul 27 19:02:13.678000 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.677804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr" event={"ID":"5f1b5b32-b915-42f4-b3e0-910bb2e6e455","Type":"ContainerStarted","Data":"2acb8122dcb0195fbeaf00627c2e79bc39f5cf9f3867e7181cc4bb7a861104b5"}
Jul 27 19:02:13.678000 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.677995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:13.693678 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:13.693601    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr" podStartSLOduration=1.693579119 podStartE2EDuration="1.693579119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:02:13.693522096 +0000 UTC m=+1858.446316518" watchObservedRunningTime="2026-07-27 19:02:13.693579119 +0000 UTC m=+1858.446373543"
Jul 27 19:02:14.056333 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.056296    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:02:14.092938 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.092901    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-certs\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093158 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.092980    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-token\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093158 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093010    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-credential-socket\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093158 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093072    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-socket\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093158 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093098    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7f0c35-8255-4289-9316-e756edd7c4a5-istiod-ca-cert\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093158 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-podinfo\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093434 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093169    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-envoy\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093434 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093197    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9mr6\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-kube-api-access-h9mr6\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093434 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093219    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-data\") pod \"5b7f0c35-8255-4289-9316-e756edd7c4a5\" (UID: \"5b7f0c35-8255-4289-9316-e756edd7c4a5\") "
Jul 27 19:02:14.093434 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093236    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:14.093628 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093592    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.093937 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093707    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7f0c35-8255-4289-9316-e756edd7c4a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:14.093937 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093856    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:14.093937 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.093923    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:14.094654 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.094625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:14.096011 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.095985    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:14.096261 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.096233    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:02:14.097021 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.096993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:14.097164 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.097147    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-kube-api-access-h9mr6" (OuterVolumeSpecName: "kube-api-access-h9mr6") pod "5b7f0c35-8255-4289-9316-e756edd7c4a5" (UID: "5b7f0c35-8255-4289-9316-e756edd7c4a5"). InnerVolumeSpecName "kube-api-access-h9mr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:14.194908 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194865    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.194908 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194906    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b7f0c35-8255-4289-9316-e756edd7c4a5-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.195131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194925    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.195131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194938    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.195131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194953    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9mr6\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-kube-api-access-h9mr6\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.195131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194971    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.195131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194985    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7f0c35-8255-4289-9316-e756edd7c4a5-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.195131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.194998    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b7f0c35-8255-4289-9316-e756edd7c4a5-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:14.691853 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.691808    2578 generic.go:356] "Generic (PLEG): container finished" podID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerID="26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d" exitCode=0
Jul 27 19:02:14.692084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.691906    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"
Jul 27 19:02:14.692084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.691915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" event={"ID":"5b7f0c35-8255-4289-9316-e756edd7c4a5","Type":"ContainerDied","Data":"26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d"}
Jul 27 19:02:14.692084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.692021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n" event={"ID":"5b7f0c35-8255-4289-9316-e756edd7c4a5","Type":"ContainerDied","Data":"7e85b7593915b4d7f0de0ccae75de61e82743b9bf2561b0520d32aaff928fb9e"}
Jul 27 19:02:14.692084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.692055    2578 scope.go:117] "RemoveContainer" containerID="26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d"
Jul 27 19:02:14.704171 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.704144    2578 scope.go:117] "RemoveContainer" containerID="ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac"
Jul 27 19:02:14.714185 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.714159    2578 scope.go:117] "RemoveContainer" containerID="26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d"
Jul 27 19:02:14.714617 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:02:14.714596    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d\": container with ID starting with 26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d not found: ID does not exist" containerID="26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d"
Jul 27 19:02:14.714674 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.714628    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d"} err="failed to get container status \"26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d\": rpc error: code = NotFound desc = could not find container \"26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d\": container with ID starting with 26ae7918e41bf84af3bd8ec93b7b06ea61325ddba353523178e398f33759202d not found: ID does not exist"
Jul 27 19:02:14.714674 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.714648    2578 scope.go:117] "RemoveContainer" containerID="ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac"
Jul 27 19:02:14.715089 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:02:14.715059    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac\": container with ID starting with ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac not found: ID does not exist" containerID="ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac"
Jul 27 19:02:14.715171 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.715100    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac"} err="failed to get container status \"ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac\": rpc error: code = NotFound desc = could not find container \"ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac\": container with ID starting with ef45db1023f643eee237bc65b16faa1c276743db45b51789905b5f533590a4ac not found: ID does not exist"
Jul 27 19:02:14.715536 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.715514    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"]
Jul 27 19:02:14.719437 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:14.719395    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cf4c6eb2-openshift-default-6d4bcc64cd-rnl9n"]
Jul 27 19:02:15.849630 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:15.849588    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" path="/var/lib/kubelet/pods/5b7f0c35-8255-4289-9316-e756edd7c4a5/volumes"
Jul 27 19:02:20.890170 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:20.890132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:23.741780 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:23.741714    2578 generic.go:356] "Generic (PLEG): container finished" podID="59081967-e6a7-44e4-bd88-086f7a40086a" containerID="b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b" exitCode=0
Jul 27 19:02:23.742215 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:23.741796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" event={"ID":"59081967-e6a7-44e4-bd88-086f7a40086a","Type":"ContainerDied","Data":"b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b"}
Jul 27 19:02:23.742283 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:23.742267    2578 scope.go:117] "RemoveContainer" containerID="b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b"
Jul 27 19:02:23.743539 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:23.743504    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:02:23.743640 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:23.743601    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:02:23.743680 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:23.743642    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:02:24.695219 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:24.695190    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:24.750054 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:24.750019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" event={"ID":"59081967-e6a7-44e4-bd88-086f7a40086a","Type":"ContainerStarted","Data":"e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837"}
Jul 27 19:02:24.960337 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:24.960235    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:24.961498 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:24.961469    2578 patch_prober.go:28] interesting pod/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:02:24.961621 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:24.961534    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 27 19:02:25.960930 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:25.960887    2578 patch_prober.go:28] interesting pod/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:02:25.961369 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:25.960947    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 27 19:02:26.961066 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:26.961017    2578 patch_prober.go:28] interesting pod/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:02:26.961474 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:26.961096    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 27 19:02:27.671421 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:27.671359    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:27.961235 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:27.961141    2578 patch_prober.go:28] interesting pod/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:02:27.961235 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:27.961200    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 27 19:02:28.792557 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:28.792518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:28.964730 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:28.964692    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:28.966136 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:28.966106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:47.331107 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.331073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:47.361641 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.361597    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"]
Jul 27 19:02:47.362896 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.361907    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr" podUID="5f1b5b32-b915-42f4-b3e0-910bb2e6e455" containerName="payload-processing" containerID="cri-o://58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2" gracePeriod=30
Jul 27 19:02:47.401245 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.401198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:47.651032 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.651001    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:47.715423 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.715374    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hw4j\" (UniqueName: \"kubernetes.io/projected/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-kube-api-access-5hw4j\") pod \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") "
Jul 27 19:02:47.715632 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.715449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-plugins-config-volume\") pod \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\" (UID: \"5f1b5b32-b915-42f4-b3e0-910bb2e6e455\") "
Jul 27 19:02:47.715905 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.715869    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f1b5b32-b915-42f4-b3e0-910bb2e6e455" (UID: "5f1b5b32-b915-42f4-b3e0-910bb2e6e455"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:47.717809 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.717780    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-kube-api-access-5hw4j" (OuterVolumeSpecName: "kube-api-access-5hw4j") pod "5f1b5b32-b915-42f4-b3e0-910bb2e6e455" (UID: "5f1b5b32-b915-42f4-b3e0-910bb2e6e455"). InnerVolumeSpecName "kube-api-access-5hw4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:47.817035 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.816992    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hw4j\" (UniqueName: \"kubernetes.io/projected/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-kube-api-access-5hw4j\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:47.817035 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.817029    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1b5b32-b915-42f4-b3e0-910bb2e6e455-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:47.880509 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.880402    2578 generic.go:356] "Generic (PLEG): container finished" podID="5f1b5b32-b915-42f4-b3e0-910bb2e6e455" containerID="58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2" exitCode=0
Jul 27 19:02:47.880509 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.880456    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"
Jul 27 19:02:47.880509 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.880498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr" event={"ID":"5f1b5b32-b915-42f4-b3e0-910bb2e6e455","Type":"ContainerDied","Data":"58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2"}
Jul 27 19:02:47.880768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.880554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr" event={"ID":"5f1b5b32-b915-42f4-b3e0-910bb2e6e455","Type":"ContainerDied","Data":"2acb8122dcb0195fbeaf00627c2e79bc39f5cf9f3867e7181cc4bb7a861104b5"}
Jul 27 19:02:47.880768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.880578    2578 scope.go:117] "RemoveContainer" containerID="58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2"
Jul 27 19:02:47.892993 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.892971    2578 scope.go:117] "RemoveContainer" containerID="58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2"
Jul 27 19:02:47.893378 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:02:47.893357    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2\": container with ID starting with 58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2 not found: ID does not exist" containerID="58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2"
Jul 27 19:02:47.893463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.893393    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2"} err="failed to get container status \"58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2\": rpc error: code = NotFound desc = could not find container \"58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2\": container with ID starting with 58e9c520f3fe2f847a5cdc161009f318c8ab304fc932986741ccaba228193eb2 not found: ID does not exist"
Jul 27 19:02:47.897915 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.897837    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"]
Jul 27 19:02:47.899949 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:47.899916    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-27df8036-559dfd78-khqbr"]
Jul 27 19:02:49.852323 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:49.852284    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f1b5b32-b915-42f4-b3e0-910bb2e6e455" path="/var/lib/kubelet/pods/5f1b5b32-b915-42f4-b3e0-910bb2e6e455/volumes"
Jul 27 19:02:51.974156 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:51.974114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:52.103359 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:52.103320    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"]
Jul 27 19:02:52.103560 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:52.103537    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy" containerID="cri-o://e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837" gracePeriod=30
Jul 27 19:02:52.126077 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:52.126029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:52.380522 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:52.380436    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:52.864089 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:52.864056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:52.964308 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:52.964266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:53.063804 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:53.063735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:54.539672 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:54.539636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:02:57.372032 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.371952    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:57.407989 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.407951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59081967-e6a7-44e4-bd88-086f7a40086a-istiod-ca-cert\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408165 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408028    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-data\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408165 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-envoy\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408165 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408084    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-credential-socket\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408165 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-socket\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408165 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408139    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-istio-token\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408441 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408174    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59081967-e6a7-44e4-bd88-086f7a40086a-istio-podinfo\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408441 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408197    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9vpk\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-kube-api-access-d9vpk\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408441 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-certs\") pod \"59081967-e6a7-44e4-bd88-086f7a40086a\" (UID: \"59081967-e6a7-44e4-bd88-086f7a40086a\") "
Jul 27 19:02:57.408607 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408437    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59081967-e6a7-44e4-bd88-086f7a40086a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:02:57.408607 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408558    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59081967-e6a7-44e4-bd88-086f7a40086a-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.408718 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:57.408992 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.408944    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:57.409303 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.409152    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-data" (OuterVolumeSpecName: "istio-data") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:57.409607 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.409576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:57.410975 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.410933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59081967-e6a7-44e4-bd88-086f7a40086a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:02:57.410975 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.410944    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-istio-token" (OuterVolumeSpecName: "istio-token") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:57.411221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.411201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-kube-api-access-d9vpk" (OuterVolumeSpecName: "kube-api-access-d9vpk") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "kube-api-access-d9vpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:02:57.411323 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.411306    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59081967-e6a7-44e4-bd88-086f7a40086a" (UID: "59081967-e6a7-44e4-bd88-086f7a40086a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:02:57.510163 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510126    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.510163 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510159    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.510163 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510171    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.510429 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510181    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.510429 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510189    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59081967-e6a7-44e4-bd88-086f7a40086a-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.510429 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510197    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9vpk\" (UniqueName: \"kubernetes.io/projected/59081967-e6a7-44e4-bd88-086f7a40086a-kube-api-access-d9vpk\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.510429 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510206    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.510429 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.510215    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59081967-e6a7-44e4-bd88-086f7a40086a-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:02:57.935164 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.935127    2578 generic.go:356] "Generic (PLEG): container finished" podID="59081967-e6a7-44e4-bd88-086f7a40086a" containerID="e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837" exitCode=0
Jul 27 19:02:57.935321 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.935182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" event={"ID":"59081967-e6a7-44e4-bd88-086f7a40086a","Type":"ContainerDied","Data":"e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837"}
Jul 27 19:02:57.935321 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.935195    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"
Jul 27 19:02:57.935321 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.935231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn" event={"ID":"59081967-e6a7-44e4-bd88-086f7a40086a","Type":"ContainerDied","Data":"e5481074cad007b0f72b6ab2f2c720146bc4ca8d944978d3c0aee9439c063d59"}
Jul 27 19:02:57.935321 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.935255    2578 scope.go:117] "RemoveContainer" containerID="e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837"
Jul 27 19:02:57.945122 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.945100    2578 scope.go:117] "RemoveContainer" containerID="b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b"
Jul 27 19:02:57.955132 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.955108    2578 scope.go:117] "RemoveContainer" containerID="e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837"
Jul 27 19:02:57.955474 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:02:57.955447    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837\": container with ID starting with e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837 not found: ID does not exist" containerID="e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837"
Jul 27 19:02:57.955530 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.955479    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837"} err="failed to get container status \"e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837\": rpc error: code = NotFound desc = could not find container \"e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837\": container with ID starting with e0213b44345f0f8a731df563ee64d48982d129e64f929e44cc762d806df98837 not found: ID does not exist"
Jul 27 19:02:57.955530 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.955500    2578 scope.go:117] "RemoveContainer" containerID="b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b"
Jul 27 19:02:57.955648 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.955620    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"]
Jul 27 19:02:57.955882 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:02:57.955857    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b\": container with ID starting with b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b not found: ID does not exist" containerID="b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b"
Jul 27 19:02:57.955954 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.955904    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b"} err="failed to get container status \"b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b\": rpc error: code = NotFound desc = could not find container \"b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b\": container with ID starting with b35f972f1fe4fe2cbf0fd60fdb18d857f907a1c12dc954032ccfc7da64edeb0b not found: ID does not exist"
Jul 27 19:02:57.962615 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:57.962579    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-27df8036-openshift-default-b6bf45cb8-xrsgn"]
Jul 27 19:02:59.847234 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:02:59.847190    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" path="/var/lib/kubelet/pods/59081967-e6a7-44e4-bd88-086f7a40086a/volumes"
Jul 27 19:03:00.394157 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:00.394124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:00.503254 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:00.503214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:00.596402 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:00.596363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:00.695077 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:00.694982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:01.126223 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:01.126124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:27.117715 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:27.117679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:33.830666 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:33.830626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:33.942580 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:33.942546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:34.041373 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:34.041336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:49.922978 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:49.922941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:55.820906 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:55.820870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:55.921890 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:55.921853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:03:56.021647 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:03:56.021612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:06.580451 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:06.580363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:07.421268 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:07.421229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:14.506501 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:14.506445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:14.616819 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:14.616783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:14.708172 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:14.708138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:14.807278 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:14.807179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:15.623981 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:15.623942    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:15.782628 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:15.782595    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:17.443903 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:17.443853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:23.809127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:23.809083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:23.926965 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:23.926926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:24.409992 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:24.409955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:30.525902 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:30.525866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:30.663120 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:30.663086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:30.779435 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:30.779339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:31.037576 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.037477    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"]
Jul 27 19:04:31.038041 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038021    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy"
Jul 27 19:04:31.038149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038043    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy"
Jul 27 19:04:31.038149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038063    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1b5b32-b915-42f4-b3e0-910bb2e6e455" containerName="payload-processing"
Jul 27 19:04:31.038149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038071    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1b5b32-b915-42f4-b3e0-910bb2e6e455" containerName="payload-processing"
Jul 27 19:04:31.038149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038080    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy"
Jul 27 19:04:31.038149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038089    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy"
Jul 27 19:04:31.038149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038102    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy"
Jul 27 19:04:31.038149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038110    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy"
Jul 27 19:04:31.038486 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038208    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1b5b32-b915-42f4-b3e0-910bb2e6e455" containerName="payload-processing"
Jul 27 19:04:31.038486 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038222    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy"
Jul 27 19:04:31.038486 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.038233    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy"
Jul 27 19:04:31.041648 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.041618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.044494 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.044467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5863a6bc-openshift-default-dockercfg-kgssr\""
Jul 27 19:04:31.063398 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.063358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"]
Jul 27 19:04:31.074725 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.074690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:31.102640 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istiod-ca-cert\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.102640 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-data\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.102958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-credential-socket\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.102958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-podinfo\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.102958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-socket\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.102958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-token\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.102958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-envoy\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.102958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.102957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtstq\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-kube-api-access-dtstq\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.103204 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.103071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-certs\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.203618 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.203574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-token\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.203618 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.203623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-envoy\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.203931 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.203780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtstq\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-kube-api-access-dtstq\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.203931 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.203918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-certs\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204055 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.203962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istiod-ca-cert\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204055 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-data\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204145 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-credential-socket\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204145 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-podinfo\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204145 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-socket\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204356 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-certs\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204414 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-data\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204534 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-credential-socket\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.204602 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.204544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-socket\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.205034 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.205005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istiod-ca-cert\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.206379 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.206352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-envoy\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.206715 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.206694    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-podinfo\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.214968 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.214940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-token\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.215425 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.215398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtstq\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-kube-api-access-dtstq\") pod \"e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") " pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.353007 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.352899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:31.358011 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.357973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:31.510956 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.510921    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"]
Jul 27 19:04:31.513329 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:04:31.513299    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ac7bf1_07d0_43b1_b25e_6c9a5f2222ab.slice/crio-e789d7b38e37f222ff490fe824b15a196fb39f338d73c446614d8c14315332b1 WatchSource:0}: Error finding container e789d7b38e37f222ff490fe824b15a196fb39f338d73c446614d8c14315332b1: Status 404 returned error can't find the container with id e789d7b38e37f222ff490fe824b15a196fb39f338d73c446614d8c14315332b1
Jul 27 19:04:31.515488 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.515456    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:04:31.515561 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.515528    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:04:31.515561 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:31.515557    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:04:32.394105 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:32.394067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" event={"ID":"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab","Type":"ContainerStarted","Data":"f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb"}
Jul 27 19:04:32.394530 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:32.394128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" event={"ID":"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab","Type":"ContainerStarted","Data":"e789d7b38e37f222ff490fe824b15a196fb39f338d73c446614d8c14315332b1"}
Jul 27 19:04:32.416052 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:32.415993    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podStartSLOduration=1.415976343 podStartE2EDuration="1.415976343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:04:32.414390091 +0000 UTC m=+1997.167184548" watchObservedRunningTime="2026-07-27 19:04:32.415976343 +0000 UTC m=+1997.168770763"
Jul 27 19:04:33.353955 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:33.353915    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:33.359308 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:33.359280    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:33.399052 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:33.399019    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:33.400308 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:33.400286    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:34.389854 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:34.389819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:34.481778 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:34.481722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:34.548688 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:34.548647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:34.653614 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:34.653519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:35.271201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.271164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:35.370345 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.370312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:35.393564 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.393528    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"]
Jul 27 19:04:35.393936 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.393923    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy"
Jul 27 19:04:35.393998 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.393938    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy"
Jul 27 19:04:35.394041 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.394004    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59081967-e6a7-44e4-bd88-086f7a40086a" containerName="istio-proxy"
Jul 27 19:04:35.394041 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.394018    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b7f0c35-8255-4289-9316-e756edd7c4a5" containerName="istio-proxy"
Jul 27 19:04:35.397074 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.397051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.400286 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.400256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5863a6bc-dockercfg-9tr8v\""
Jul 27 19:04:35.400608 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.400586    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5863a6bc\""
Jul 27 19:04:35.419627 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.419593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"]
Jul 27 19:04:35.551187 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.551068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26abc589-03d7-4141-91e6-b9e59754d472-plugins-config-volume\") pod \"payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") " pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.551662 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.551268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnb4r\" (UniqueName: \"kubernetes.io/projected/26abc589-03d7-4141-91e6-b9e59754d472-kube-api-access-nnb4r\") pod \"payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") " pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.652001 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.651949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnb4r\" (UniqueName: \"kubernetes.io/projected/26abc589-03d7-4141-91e6-b9e59754d472-kube-api-access-nnb4r\") pod \"payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") " pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.652001 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.652005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26abc589-03d7-4141-91e6-b9e59754d472-plugins-config-volume\") pod \"payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") " pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.652804 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.652784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26abc589-03d7-4141-91e6-b9e59754d472-plugins-config-volume\") pod \"payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") " pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.661878 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.661853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnb4r\" (UniqueName: \"kubernetes.io/projected/26abc589-03d7-4141-91e6-b9e59754d472-kube-api-access-nnb4r\") pod \"payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") " pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.709208 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.709173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:35.886903 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:35.886863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"]
Jul 27 19:04:35.890529 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:04:35.890495    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26abc589_03d7_4141_91e6_b9e59754d472.slice/crio-8cc2b9de928c506e399cfc3aa4a4d2d196906c485b0e9a14e92a74a3fc758a7f WatchSource:0}: Error finding container 8cc2b9de928c506e399cfc3aa4a4d2d196906c485b0e9a14e92a74a3fc758a7f: Status 404 returned error can't find the container with id 8cc2b9de928c506e399cfc3aa4a4d2d196906c485b0e9a14e92a74a3fc758a7f
Jul 27 19:04:36.416920 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:36.416873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms" event={"ID":"26abc589-03d7-4141-91e6-b9e59754d472","Type":"ContainerStarted","Data":"ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869"}
Jul 27 19:04:36.417126 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:36.416947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms" event={"ID":"26abc589-03d7-4141-91e6-b9e59754d472","Type":"ContainerStarted","Data":"8cc2b9de928c506e399cfc3aa4a4d2d196906c485b0e9a14e92a74a3fc758a7f"}
Jul 27 19:04:36.417126 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:36.417090    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:36.450710 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:36.450650    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms" podStartSLOduration=1.450633194 podStartE2EDuration="1.450633194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:04:36.449095623 +0000 UTC m=+2001.201890062" watchObservedRunningTime="2026-07-27 19:04:36.450633194 +0000 UTC m=+2001.203427614"
Jul 27 19:04:38.886694 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:38.886656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:39.602324 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:39.602291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:39.706110 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:39.706072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:40.376089 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:40.376021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:46.070189 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:46.070146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:46.144864 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:46.144825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:47.423985 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:47.423943    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:48.400772 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.400707    2578 patch_prober.go:28] interesting pod/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 27 19:04:48.400988 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.400816    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 27 19:04:48.481128 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.481091    2578 generic.go:356] "Generic (PLEG): container finished" podID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerID="f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb" exitCode=0
Jul 27 19:04:48.481524 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.481144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" event={"ID":"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab","Type":"ContainerDied","Data":"f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb"}
Jul 27 19:04:48.481567 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.481537    2578 scope.go:117] "RemoveContainer" containerID="f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb"
Jul 27 19:04:48.482688 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.482654    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:04:48.482765 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.482734    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:04:48.482822 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:48.482809    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:04:49.491796 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:49.491718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" event={"ID":"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab","Type":"ContainerStarted","Data":"6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f"}
Jul 27 19:04:50.353443 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:50.353399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:50.353690 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:50.353663    2578 patch_prober.go:28] interesting pod/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 27 19:04:50.353772 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:50.353721    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 27 19:04:51.353927 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:51.353890    2578 patch_prober.go:28] interesting pod/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 27 19:04:51.354343 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:51.353949    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 27 19:04:52.353981 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:52.353943    2578 patch_prober.go:28] interesting pod/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 27 19:04:52.354390 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:52.354014    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 27 19:04:53.354464 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:53.354424    2578 patch_prober.go:28] interesting pod/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 27 19:04:53.354888 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:53.354497    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 27 19:04:54.358649 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:54.358612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:54.359208 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:54.359038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:54.359854 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:54.359834    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:04:56.869239 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:56.869172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:04:56.884507 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:56.884461    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"]
Jul 27 19:04:56.885083 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:56.885025    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms" podUID="26abc589-03d7-4141-91e6-b9e59754d472" containerName="payload-processing" containerID="cri-o://ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869" gracePeriod=30
Jul 27 19:04:57.151783 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.151733    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:57.260990 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.260952    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26abc589-03d7-4141-91e6-b9e59754d472-plugins-config-volume\") pod \"26abc589-03d7-4141-91e6-b9e59754d472\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") "
Jul 27 19:04:57.261180 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.261024    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnb4r\" (UniqueName: \"kubernetes.io/projected/26abc589-03d7-4141-91e6-b9e59754d472-kube-api-access-nnb4r\") pod \"26abc589-03d7-4141-91e6-b9e59754d472\" (UID: \"26abc589-03d7-4141-91e6-b9e59754d472\") "
Jul 27 19:04:57.261420 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.261382    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26abc589-03d7-4141-91e6-b9e59754d472-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26abc589-03d7-4141-91e6-b9e59754d472" (UID: "26abc589-03d7-4141-91e6-b9e59754d472"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:04:57.263391 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.263352    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26abc589-03d7-4141-91e6-b9e59754d472-kube-api-access-nnb4r" (OuterVolumeSpecName: "kube-api-access-nnb4r") pod "26abc589-03d7-4141-91e6-b9e59754d472" (UID: "26abc589-03d7-4141-91e6-b9e59754d472"). InnerVolumeSpecName "kube-api-access-nnb4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:04:57.362097 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.362056    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26abc589-03d7-4141-91e6-b9e59754d472-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:04:57.362097 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.362091    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnb4r\" (UniqueName: \"kubernetes.io/projected/26abc589-03d7-4141-91e6-b9e59754d472-kube-api-access-nnb4r\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:04:57.532619 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.532581    2578 generic.go:356] "Generic (PLEG): container finished" podID="26abc589-03d7-4141-91e6-b9e59754d472" containerID="ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869" exitCode=0
Jul 27 19:04:57.532809 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.532636    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"
Jul 27 19:04:57.532809 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.532668    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms" event={"ID":"26abc589-03d7-4141-91e6-b9e59754d472","Type":"ContainerDied","Data":"ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869"}
Jul 27 19:04:57.532809 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.532729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms" event={"ID":"26abc589-03d7-4141-91e6-b9e59754d472","Type":"ContainerDied","Data":"8cc2b9de928c506e399cfc3aa4a4d2d196906c485b0e9a14e92a74a3fc758a7f"}
Jul 27 19:04:57.532809 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.532783    2578 scope.go:117] "RemoveContainer" containerID="ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869"
Jul 27 19:04:57.542582 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.542516    2578 scope.go:117] "RemoveContainer" containerID="ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869"
Jul 27 19:04:57.542991 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:04:57.542970    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869\": container with ID starting with ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869 not found: ID does not exist" containerID="ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869"
Jul 27 19:04:57.543072 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.543008    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869"} err="failed to get container status \"ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869\": rpc error: code = NotFound desc = could not find container \"ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869\": container with ID starting with ab6877b6252e0a98a56ee8cf853588ecc1458ced091ca666709b95aa9b3c9869 not found: ID does not exist"
Jul 27 19:04:57.559253 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.559211    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"]
Jul 27 19:04:57.563182 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.563147    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5863a6bc-7c6dfc4c66-4sjms"]
Jul 27 19:04:57.846271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:57.846170    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26abc589-03d7-4141-91e6-b9e59754d472" path="/var/lib/kubelet/pods/26abc589-03d7-4141-91e6-b9e59754d472/volumes"
Jul 27 19:04:58.347173 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:04:58.347143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:01.525960 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:01.525923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:01.967895 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:01.967861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:08.298712 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:08.298664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:08.364781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:08.364727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:08.560149 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:08.560050    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"]
Jul 27 19:05:08.560336 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:08.560309    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy" containerID="cri-o://6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f" gracePeriod=30
Jul 27 19:05:08.591005 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:08.590968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:08.811285 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:08.811189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:08.931986 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:08.931951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:09.030139 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:09.030102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:09.155218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:09.155179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:09.361321 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:09.361283    2578 patch_prober.go:28] interesting pod/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 27 19:05:09.361730 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:09.361362    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:05:13.833883 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.833792    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:05:13.914073 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-podinfo\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914073 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-credential-socket\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914332 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914100    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-certs\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914332 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914139    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-socket\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914332 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914182    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-token\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914332 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtstq\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-kube-api-access-dtstq\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914332 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914258    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-data\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914332 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istiod-ca-cert\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914332 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-envoy\") pod \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\" (UID: \"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab\") "
Jul 27 19:05:13.914663 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914415    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:05:13.914663 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914474    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:05:13.914663 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914534    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:05:13.914864 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914767    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:13.914864 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914792    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:13.914864 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914809    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:13.914864 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.914808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:05:13.915872 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.915831    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:05:13.916760 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.916707    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:05:13.916760 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.916718    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:05:13.916760 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.916721    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-kube-api-access-dtstq" (OuterVolumeSpecName: "kube-api-access-dtstq") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "kube-api-access-dtstq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:05:13.916945 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:13.916827    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" (UID: "b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:05:14.015705 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.015648    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:14.015705 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.015695    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtstq\" (UniqueName: \"kubernetes.io/projected/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-kube-api-access-dtstq\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:14.015705 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.015707    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:14.015705 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.015716    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:14.015705 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.015724    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:14.016066 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.015732    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:05:14.617609 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.617576    2578 generic.go:356] "Generic (PLEG): container finished" podID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerID="6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f" exitCode=0
Jul 27 19:05:14.617824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.617633    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"
Jul 27 19:05:14.617824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.617644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" event={"ID":"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab","Type":"ContainerDied","Data":"6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f"}
Jul 27 19:05:14.617824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.617701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p" event={"ID":"b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab","Type":"ContainerDied","Data":"e789d7b38e37f222ff490fe824b15a196fb39f338d73c446614d8c14315332b1"}
Jul 27 19:05:14.617824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.617727    2578 scope.go:117] "RemoveContainer" containerID="6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f"
Jul 27 19:05:14.627832 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.627803    2578 scope.go:117] "RemoveContainer" containerID="f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb"
Jul 27 19:05:14.637904 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.637874    2578 scope.go:117] "RemoveContainer" containerID="6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f"
Jul 27 19:05:14.638630 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:05:14.638599    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f\": container with ID starting with 6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f not found: ID does not exist" containerID="6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f"
Jul 27 19:05:14.638763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.638641    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f"} err="failed to get container status \"6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f\": rpc error: code = NotFound desc = could not find container \"6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f\": container with ID starting with 6c347af7b18fd11a348bfb5bebb06ecc79cee275d36faea3ec8511d15a798b7f not found: ID does not exist"
Jul 27 19:05:14.638763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.638670    2578 scope.go:117] "RemoveContainer" containerID="f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb"
Jul 27 19:05:14.639144 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:05:14.639123    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb\": container with ID starting with f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb not found: ID does not exist" containerID="f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb"
Jul 27 19:05:14.639224 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.639151    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb"} err="failed to get container status \"f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb\": rpc error: code = NotFound desc = could not find container \"f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb\": container with ID starting with f769460d1272bd22ea6463b26302fcf923671cca784e0c0fff420dc6456538cb not found: ID does not exist"
Jul 27 19:05:14.640354 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.640321    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"]
Jul 27 19:05:14.644639 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:14.644602    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5863a6bc-openshift-default-9f656b6d-9nv6p"]
Jul 27 19:05:15.370891 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:15.370851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:15.437663 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:15.437619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:15.527075 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:15.527043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:15.624879 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:15.624772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:15.737288 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:15.737236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:15.846691 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:15.846655    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" path="/var/lib/kubelet/pods/b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab/volumes"
Jul 27 19:05:21.628276 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:21.628232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:21.693164 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:21.693130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:28.469224 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.469189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:28.755735 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.755626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"]
Jul 27 19:05:28.756264 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756244    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy"
Jul 27 19:05:28.756320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756268    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy"
Jul 27 19:05:28.756320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756297    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy"
Jul 27 19:05:28.756320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756308    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy"
Jul 27 19:05:28.756419 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756329    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26abc589-03d7-4141-91e6-b9e59754d472" containerName="payload-processing"
Jul 27 19:05:28.756419 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756338    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26abc589-03d7-4141-91e6-b9e59754d472" containerName="payload-processing"
Jul 27 19:05:28.756419 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756416    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy"
Jul 27 19:05:28.756537 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756430    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26abc589-03d7-4141-91e6-b9e59754d472" containerName="payload-processing"
Jul 27 19:05:28.756537 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.756444    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ac7bf1-07d0-43b1-b25e-6c9a5f2222ab" containerName="istio-proxy"
Jul 27 19:05:28.759024 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.758999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.761601 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.761562    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dcc83a9c-openshift-default-dockercfg-dvqfh\""
Jul 27 19:05:28.775383 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.775349    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"]
Jul 27 19:05:28.786936 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.786893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:28.859104 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a327e8c9-baba-43d7-ae28-547af7c55796-istio-podinfo\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859317 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29ckw\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-kube-api-access-29ckw\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859317 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-data\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859317 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-istio-token\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859516 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-certs\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859516 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a327e8c9-baba-43d7-ae28-547af7c55796-istiod-ca-cert\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859516 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-envoy\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859516 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-socket\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.859516 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.859505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-credential-socket\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960005 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.959961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-socket\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-credential-socket\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a327e8c9-baba-43d7-ae28-547af7c55796-istio-podinfo\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29ckw\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-kube-api-access-29ckw\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960395 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-data\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960395 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-istio-token\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960395 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-certs\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960395 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a327e8c9-baba-43d7-ae28-547af7c55796-istiod-ca-cert\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960395 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-socket\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960648 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-envoy\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960727 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-data\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960839 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-certs\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.960959 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.960925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-credential-socket\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.961112 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.961092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a327e8c9-baba-43d7-ae28-547af7c55796-istiod-ca-cert\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.962866 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.962834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-envoy\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.962981 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.962920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a327e8c9-baba-43d7-ae28-547af7c55796-istio-podinfo\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.968946 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.968914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-istio-token\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:28.969084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:28.968989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29ckw\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-kube-api-access-29ckw\") pod \"e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") " pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:29.071480 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.071387    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:29.171789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.170301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:29.228880 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.228805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"]
Jul 27 19:05:29.231443 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:05:29.231412    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda327e8c9_baba_43d7_ae28_547af7c55796.slice/crio-4089d05bd6b2503602c5e42ae5c0aba49b5702e8dd299e8cd0de3251165aa545 WatchSource:0}: Error finding container 4089d05bd6b2503602c5e42ae5c0aba49b5702e8dd299e8cd0de3251165aa545: Status 404 returned error can't find the container with id 4089d05bd6b2503602c5e42ae5c0aba49b5702e8dd299e8cd0de3251165aa545
Jul 27 19:05:29.233810 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.233761    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:05:29.233898 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.233860    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:05:29.233945 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.233927    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:05:29.698240 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.698193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" event={"ID":"a327e8c9-baba-43d7-ae28-547af7c55796","Type":"ContainerStarted","Data":"282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8"}
Jul 27 19:05:29.698654 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.698261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" event={"ID":"a327e8c9-baba-43d7-ae28-547af7c55796","Type":"ContainerStarted","Data":"4089d05bd6b2503602c5e42ae5c0aba49b5702e8dd299e8cd0de3251165aa545"}
Jul 27 19:05:29.718618 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:29.718541    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podStartSLOduration=1.7185215550000001 podStartE2EDuration="1.718521555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:29.716886367 +0000 UTC m=+2054.469680803" watchObservedRunningTime="2026-07-27 19:05:29.718521555 +0000 UTC m=+2054.471315974"
Jul 27 19:05:30.072474 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:30.072375    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:30.078045 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:30.078014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:30.703251 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:30.703220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:30.704355 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:30.704331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:31.429085 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:31.429031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:31.766223 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:31.766107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:31.895511 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:31.895466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:31.993222 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:31.993183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:32.215393 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.215352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:32.440771 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.440705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:32.538161 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.538058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:32.574503 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.574466    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"]
Jul 27 19:05:32.577362 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.577335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.580006 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.579982    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-dcc83a9c-dockercfg-85srq\""
Jul 27 19:05:32.580159 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.580035    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-dcc83a9c\""
Jul 27 19:05:32.590452 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.590414    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"]
Jul 27 19:05:32.624569 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.624523    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"]
Jul 27 19:05:32.627552 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.627520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:32.638053 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.638014    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"]
Jul 27 19:05:32.696142 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.696092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f91269f-f0b1-423b-b32c-1def58235f56-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") " pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.696356 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.696152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk7pk\" (UniqueName: \"kubernetes.io/projected/6f91269f-f0b1-423b-b32c-1def58235f56-kube-api-access-sk7pk\") pod \"payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") " pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.797326 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.797225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f91269f-f0b1-423b-b32c-1def58235f56-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") " pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.797326 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.797263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk7pk\" (UniqueName: \"kubernetes.io/projected/6f91269f-f0b1-423b-b32c-1def58235f56-kube-api-access-sk7pk\") pod \"payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") " pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.797326 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.797292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:32.797326 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.797313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t22wt\" (UniqueName: \"kubernetes.io/projected/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-kube-api-access-t22wt\") pod \"payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:32.798062 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.798042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f91269f-f0b1-423b-b32c-1def58235f56-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") " pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.806764 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.806713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk7pk\" (UniqueName: \"kubernetes.io/projected/6f91269f-f0b1-423b-b32c-1def58235f56-kube-api-access-sk7pk\") pod \"payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") " pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.889489 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.889445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:32.898454 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.898411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:32.898652 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.898466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t22wt\" (UniqueName: \"kubernetes.io/projected/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-kube-api-access-t22wt\") pod \"payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:32.899517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.899487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:32.908763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.908715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t22wt\" (UniqueName: \"kubernetes.io/projected/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-kube-api-access-t22wt\") pod \"payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:32.940179 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:32.940137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:33.059197 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.058619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"]
Jul 27 19:05:33.061753 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:05:33.061689    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f91269f_f0b1_423b_b32c_1def58235f56.slice/crio-67dcca67f6c542529a4282ffda834fee2c366d370c19b7e83053372412831ea5 WatchSource:0}: Error finding container 67dcca67f6c542529a4282ffda834fee2c366d370c19b7e83053372412831ea5: Status 404 returned error can't find the container with id 67dcca67f6c542529a4282ffda834fee2c366d370c19b7e83053372412831ea5
Jul 27 19:05:33.123534 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.123482    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"]
Jul 27 19:05:33.125635 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:05:33.125595    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd3dbf8_4092_4643_a686_1cebfaa9d37c.slice/crio-c8769b4d50cefdcaa8169490ab259d3bde391fd857451d40bcf7a85e24529cd5 WatchSource:0}: Error finding container c8769b4d50cefdcaa8169490ab259d3bde391fd857451d40bcf7a85e24529cd5: Status 404 returned error can't find the container with id c8769b4d50cefdcaa8169490ab259d3bde391fd857451d40bcf7a85e24529cd5
Jul 27 19:05:33.720756 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.720702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s" event={"ID":"cbd3dbf8-4092-4643-a686-1cebfaa9d37c","Type":"ContainerStarted","Data":"f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654"}
Jul 27 19:05:33.720970 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.720779    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:33.720970 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.720801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s" event={"ID":"cbd3dbf8-4092-4643-a686-1cebfaa9d37c","Type":"ContainerStarted","Data":"c8769b4d50cefdcaa8169490ab259d3bde391fd857451d40bcf7a85e24529cd5"}
Jul 27 19:05:33.722504 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.722475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n" event={"ID":"6f91269f-f0b1-423b-b32c-1def58235f56","Type":"ContainerStarted","Data":"bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22"}
Jul 27 19:05:33.722642 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.722526    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n" event={"ID":"6f91269f-f0b1-423b-b32c-1def58235f56","Type":"ContainerStarted","Data":"67dcca67f6c542529a4282ffda834fee2c366d370c19b7e83053372412831ea5"}
Jul 27 19:05:33.722642 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.722548    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:33.739861 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.739790    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s" podStartSLOduration=1.739765931 podStartE2EDuration="1.739765931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:33.737529827 +0000 UTC m=+2058.490324249" watchObservedRunningTime="2026-07-27 19:05:33.739765931 +0000 UTC m=+2058.492560348"
Jul 27 19:05:33.753547 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:33.753456    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n" podStartSLOduration=1.753441943 podStartE2EDuration="1.753441943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:33.752561555 +0000 UTC m=+2058.505355997" watchObservedRunningTime="2026-07-27 19:05:33.753441943 +0000 UTC m=+2058.506236442"
Jul 27 19:05:36.245151 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:36.245115    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:42.586007 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:42.585959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:44.730323 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:44.730291    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:05:44.730793 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:44.730365    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:05:46.745979 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:46.745920    2578 patch_prober.go:28] interesting pod/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 19:05:46.746510 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:46.745996    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:05:47.800504 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:47.800469    2578 generic.go:356] "Generic (PLEG): container finished" podID="a327e8c9-baba-43d7-ae28-547af7c55796" containerID="282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8" exitCode=0
Jul 27 19:05:47.801084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:47.800532    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" event={"ID":"a327e8c9-baba-43d7-ae28-547af7c55796","Type":"ContainerDied","Data":"282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8"}
Jul 27 19:05:47.801084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:47.801072    2578 scope.go:117] "RemoveContainer" containerID="282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8"
Jul 27 19:05:47.802229 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:47.802192    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:05:47.802335 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:47.802276    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:05:47.802335 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:47.802309    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:05:48.807380 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:48.807338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" event={"ID":"a327e8c9-baba-43d7-ae28-547af7c55796","Type":"ContainerStarted","Data":"f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18"}
Jul 27 19:05:49.072430 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:49.072313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:49.072636 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:49.072456    2578 patch_prober.go:28] interesting pod/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 27 19:05:49.072636 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:49.072506    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 27 19:05:50.072063 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:50.072014    2578 patch_prober.go:28] interesting pod/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 27 19:05:50.072613 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:50.072095    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 27 19:05:51.072776 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:51.072623    2578 patch_prober.go:28] interesting pod/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 27 19:05:51.072776 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:51.072692    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 27 19:05:52.072275 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:52.072230    2578 patch_prober.go:28] interesting pod/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 27 19:05:52.072608 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:52.072573    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 27 19:05:53.075790 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:53.075726    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:53.076311 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:53.076187    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:53.076951 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:53.076931    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:05:59.693925 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:05:59.693885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:46.046627 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:08:46.046585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:30.845618 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:30.845563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:30.910298 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:30.910262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:31.530565 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:31.530524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:34.599968 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.599923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:34.631098 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.631045    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"]
Jul 27 19:09:34.631425 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.631385    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n" podUID="6f91269f-f0b1-423b-b32c-1def58235f56" containerName="payload-processing" containerID="cri-o://bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22" gracePeriod=30
Jul 27 19:09:34.638578 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.638537    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"]
Jul 27 19:09:34.638943 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.638837    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s" podUID="cbd3dbf8-4092-4643-a686-1cebfaa9d37c" containerName="payload-pre-processing" containerID="cri-o://f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654" gracePeriod=30
Jul 27 19:09:34.688304 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.688263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:34.727934 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.727882    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s" podUID="cbd3dbf8-4092-4643-a686-1cebfaa9d37c" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.47:9004: connect: connection refused"
Jul 27 19:09:34.728108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.727882    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n" podUID="6f91269f-f0b1-423b-b32c-1def58235f56" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.46:9004: connect: connection refused"
Jul 27 19:09:34.761255 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.761215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:34.945980 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.945948    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:09:34.950823 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.950780    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:09:34.952403 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.952386    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk7pk\" (UniqueName: \"kubernetes.io/projected/6f91269f-f0b1-423b-b32c-1def58235f56-kube-api-access-sk7pk\") pod \"6f91269f-f0b1-423b-b32c-1def58235f56\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") "
Jul 27 19:09:34.952492 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.952480    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f91269f-f0b1-423b-b32c-1def58235f56-plugins-config-volume\") pod \"6f91269f-f0b1-423b-b32c-1def58235f56\" (UID: \"6f91269f-f0b1-423b-b32c-1def58235f56\") "
Jul 27 19:09:34.952869 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.952842    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f91269f-f0b1-423b-b32c-1def58235f56-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f91269f-f0b1-423b-b32c-1def58235f56" (UID: "6f91269f-f0b1-423b-b32c-1def58235f56"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:09:34.954768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.954715    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f91269f-f0b1-423b-b32c-1def58235f56-kube-api-access-sk7pk" (OuterVolumeSpecName: "kube-api-access-sk7pk") pod "6f91269f-f0b1-423b-b32c-1def58235f56" (UID: "6f91269f-f0b1-423b-b32c-1def58235f56"). InnerVolumeSpecName "kube-api-access-sk7pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:09:34.963592 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.963557    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbd3dbf8-4092-4643-a686-1cebfaa9d37c" containerID="f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654" exitCode=0
Jul 27 19:09:34.963824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.963608    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"
Jul 27 19:09:34.963824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.963636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s" event={"ID":"cbd3dbf8-4092-4643-a686-1cebfaa9d37c","Type":"ContainerDied","Data":"f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654"}
Jul 27 19:09:34.963824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.963689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s" event={"ID":"cbd3dbf8-4092-4643-a686-1cebfaa9d37c","Type":"ContainerDied","Data":"c8769b4d50cefdcaa8169490ab259d3bde391fd857451d40bcf7a85e24529cd5"}
Jul 27 19:09:34.963824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.963711    2578 scope.go:117] "RemoveContainer" containerID="f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654"
Jul 27 19:09:34.965432 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.965402    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f91269f-f0b1-423b-b32c-1def58235f56" containerID="bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22" exitCode=0
Jul 27 19:09:34.965575 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.965449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n" event={"ID":"6f91269f-f0b1-423b-b32c-1def58235f56","Type":"ContainerDied","Data":"bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22"}
Jul 27 19:09:34.965575 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.965501    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n" event={"ID":"6f91269f-f0b1-423b-b32c-1def58235f56","Type":"ContainerDied","Data":"67dcca67f6c542529a4282ffda834fee2c366d370c19b7e83053372412831ea5"}
Jul 27 19:09:34.965680 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.965603    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"
Jul 27 19:09:34.975350 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.975266    2578 scope.go:117] "RemoveContainer" containerID="f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654"
Jul 27 19:09:34.975715 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:09:34.975694    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654\": container with ID starting with f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654 not found: ID does not exist" containerID="f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654"
Jul 27 19:09:34.975889 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.975725    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654"} err="failed to get container status \"f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654\": rpc error: code = NotFound desc = could not find container \"f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654\": container with ID starting with f92924248cdccafe333110b567643ff0c70f9e38876daef7612714c593bee654 not found: ID does not exist"
Jul 27 19:09:34.975889 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.975785    2578 scope.go:117] "RemoveContainer" containerID="bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22"
Jul 27 19:09:34.985115 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.985091    2578 scope.go:117] "RemoveContainer" containerID="bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22"
Jul 27 19:09:34.985461 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:09:34.985437    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22\": container with ID starting with bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22 not found: ID does not exist" containerID="bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22"
Jul 27 19:09:34.985559 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:34.985470    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22"} err="failed to get container status \"bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22\": rpc error: code = NotFound desc = could not find container \"bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22\": container with ID starting with bdc4b296c0f8410f60f38bb1cceaa44477f821b3695f097f42e702f48027ee22 not found: ID does not exist"
Jul 27 19:09:35.003147 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.003108    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"]
Jul 27 19:09:35.007218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.007184    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcc83a9c-79bc4bfcdb-lbl6n"]
Jul 27 19:09:35.053473 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.053438    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t22wt\" (UniqueName: \"kubernetes.io/projected/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-kube-api-access-t22wt\") pod \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") "
Jul 27 19:09:35.053675 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.053496    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-plugins-config-volume\") pod \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\" (UID: \"cbd3dbf8-4092-4643-a686-1cebfaa9d37c\") "
Jul 27 19:09:35.053726 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.053698    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f91269f-f0b1-423b-b32c-1def58235f56-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:09:35.053726 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.053712    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk7pk\" (UniqueName: \"kubernetes.io/projected/6f91269f-f0b1-423b-b32c-1def58235f56-kube-api-access-sk7pk\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:09:35.054012 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.053984    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbd3dbf8-4092-4643-a686-1cebfaa9d37c" (UID: "cbd3dbf8-4092-4643-a686-1cebfaa9d37c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:09:35.055958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.055931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-kube-api-access-t22wt" (OuterVolumeSpecName: "kube-api-access-t22wt") pod "cbd3dbf8-4092-4643-a686-1cebfaa9d37c" (UID: "cbd3dbf8-4092-4643-a686-1cebfaa9d37c"). InnerVolumeSpecName "kube-api-access-t22wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:09:35.154440 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.154399    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t22wt\" (UniqueName: \"kubernetes.io/projected/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-kube-api-access-t22wt\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:09:35.154440 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.154438    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd3dbf8-4092-4643-a686-1cebfaa9d37c-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:09:35.286436 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.286394    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"]
Jul 27 19:09:35.291831 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.291793    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcc83a9c-7ddb7f765b-xdn8s"]
Jul 27 19:09:35.849445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.849394    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f91269f-f0b1-423b-b32c-1def58235f56" path="/var/lib/kubelet/pods/6f91269f-f0b1-423b-b32c-1def58235f56/volumes"
Jul 27 19:09:35.849880 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:35.849813    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd3dbf8-4092-4643-a686-1cebfaa9d37c" path="/var/lib/kubelet/pods/cbd3dbf8-4092-4643-a686-1cebfaa9d37c/volumes"
Jul 27 19:09:39.191312 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:39.191272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:39.619998 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:39.619894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:44.704767 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:09:44.704697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:21.276048 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:21.276004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:22.695370 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:22.695331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:37.288607 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:37.288567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:37.360709 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:37.360673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:37.568079 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:37.567958    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"]
Jul 27 19:10:37.568331 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:37.568289    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy" containerID="cri-o://f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18" gracePeriod=30
Jul 27 19:10:37.587735 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:37.587696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:37.810148 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:37.810097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:38.079248 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:38.079210    2578 patch_prober.go:28] interesting pod/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:10:38.079439 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:38.079269    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:10:39.015588 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:39.015549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:39.120466 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:39.120422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:39.881539 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:39.881498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:39.981817 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:39.981774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:40.079719 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:40.079679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:41.433841 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:41.433794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:42.843326 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:42.843237    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:10:43.002831 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.002791    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a327e8c9-baba-43d7-ae28-547af7c55796-istio-podinfo\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.002831 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.002838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-credential-socket\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003092 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.002866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-envoy\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003092 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.002936    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-istio-token\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003092 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.002965    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-data\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003251 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003086    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a327e8c9-baba-43d7-ae28-547af7c55796-istiod-ca-cert\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003251 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003162    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29ckw\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-kube-api-access-29ckw\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003251 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:43.003251 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-socket\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003251 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003245    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-certs\") pod \"a327e8c9-baba-43d7-ae28-547af7c55796\" (UID: \"a327e8c9-baba-43d7-ae28-547af7c55796\") "
Jul 27 19:10:43.003505 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003451    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:43.003505 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a327e8c9-baba-43d7-ae28-547af7c55796-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:10:43.003617 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003590    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.003670 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003645    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a327e8c9-baba-43d7-ae28-547af7c55796-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.003670 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003661    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.003875 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003852    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:43.003958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.003912    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-data" (OuterVolumeSpecName: "istio-data") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:43.005375 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.005339    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a327e8c9-baba-43d7-ae28-547af7c55796-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:10:43.005718 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.005696    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-kube-api-access-29ckw" (OuterVolumeSpecName: "kube-api-access-29ckw") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "kube-api-access-29ckw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:10:43.005918 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.005900    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:10:43.005984 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.005965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-istio-token" (OuterVolumeSpecName: "istio-token") pod "a327e8c9-baba-43d7-ae28-547af7c55796" (UID: "a327e8c9-baba-43d7-ae28-547af7c55796"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:10:43.104424 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.104327    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a327e8c9-baba-43d7-ae28-547af7c55796-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.104424 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.104365    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.104424 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.104378    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.104424 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.104386    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.104424 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.104397    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29ckw\" (UniqueName: \"kubernetes.io/projected/a327e8c9-baba-43d7-ae28-547af7c55796-kube-api-access-29ckw\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.104424 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.104408    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a327e8c9-baba-43d7-ae28-547af7c55796-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:10:43.305150 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.305110    2578 generic.go:356] "Generic (PLEG): container finished" podID="a327e8c9-baba-43d7-ae28-547af7c55796" containerID="f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18" exitCode=0
Jul 27 19:10:43.305346 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.305168    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"
Jul 27 19:10:43.305346 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.305213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" event={"ID":"a327e8c9-baba-43d7-ae28-547af7c55796","Type":"ContainerDied","Data":"f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18"}
Jul 27 19:10:43.305346 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.305276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp" event={"ID":"a327e8c9-baba-43d7-ae28-547af7c55796","Type":"ContainerDied","Data":"4089d05bd6b2503602c5e42ae5c0aba49b5702e8dd299e8cd0de3251165aa545"}
Jul 27 19:10:43.305346 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.305308    2578 scope.go:117] "RemoveContainer" containerID="f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18"
Jul 27 19:10:43.319954 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.319929    2578 scope.go:117] "RemoveContainer" containerID="282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8"
Jul 27 19:10:43.329327 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.329300    2578 scope.go:117] "RemoveContainer" containerID="f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18"
Jul 27 19:10:43.329668 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:10:43.329644    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18\": container with ID starting with f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18 not found: ID does not exist" containerID="f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18"
Jul 27 19:10:43.329824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.329683    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18"} err="failed to get container status \"f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18\": rpc error: code = NotFound desc = could not find container \"f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18\": container with ID starting with f400689f437d714bc4d725c8c5752b8c1fa5b5f3b4d5b45b6024921a783b6a18 not found: ID does not exist"
Jul 27 19:10:43.329824 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.329714    2578 scope.go:117] "RemoveContainer" containerID="282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8"
Jul 27 19:10:43.330114 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:10:43.330089    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8\": container with ID starting with 282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8 not found: ID does not exist" containerID="282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8"
Jul 27 19:10:43.330154 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.330124    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8"} err="failed to get container status \"282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8\": rpc error: code = NotFound desc = could not find container \"282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8\": container with ID starting with 282aad78ec24182939202552d757fd8518b354bcda9efdf22a7d33b2abfc2cb8 not found: ID does not exist"
Jul 27 19:10:43.345673 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.345626    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"]
Jul 27 19:10:43.356215 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.356129    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dcc83a9c-openshift-default-565664b6dd-gcqkp"]
Jul 27 19:10:43.846674 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:43.846635    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" path="/var/lib/kubelet/pods/a327e8c9-baba-43d7-ae28-547af7c55796/volumes"
Jul 27 19:10:47.888140 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:47.888104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:47.957070 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:47.957025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:48.613737 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:48.613693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:54.891416 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:54.891374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:55.003014 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:55.002969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:55.103258 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:10:55.103209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:05.659385 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:05.659350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:05.940005 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:05.939912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:09.398220 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:09.398185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:26.956235 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:26.956191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:33.917376 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:33.917330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:33.994078 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:33.994032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:34.278949 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.278847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:34.595683 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.595593    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"]
Jul 27 19:11:34.596012 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.595997    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy"
Jul 27 19:11:34.596063 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596013    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy"
Jul 27 19:11:34.596063 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596035    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy"
Jul 27 19:11:34.596063 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596043    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy"
Jul 27 19:11:34.596063 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596053    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f91269f-f0b1-423b-b32c-1def58235f56" containerName="payload-processing"
Jul 27 19:11:34.596063 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596059    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f91269f-f0b1-423b-b32c-1def58235f56" containerName="payload-processing"
Jul 27 19:11:34.596221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596069    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd3dbf8-4092-4643-a686-1cebfaa9d37c" containerName="payload-pre-processing"
Jul 27 19:11:34.596221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596076    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd3dbf8-4092-4643-a686-1cebfaa9d37c" containerName="payload-pre-processing"
Jul 27 19:11:34.596221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596131    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f91269f-f0b1-423b-b32c-1def58235f56" containerName="payload-processing"
Jul 27 19:11:34.596221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596139    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy"
Jul 27 19:11:34.596221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596145    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a327e8c9-baba-43d7-ae28-547af7c55796" containerName="istio-proxy"
Jul 27 19:11:34.596221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.596156    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd3dbf8-4092-4643-a686-1cebfaa9d37c" containerName="payload-pre-processing"
Jul 27 19:11:34.599348 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.599325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.602262 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.602236    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7aabc5-openshift-default-dockercfg-p67b2\""
Jul 27 19:11:34.612821 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.612783    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"]
Jul 27 19:11:34.620467 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.620437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:34.687880 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.687847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6kh\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-kube-api-access-xs6kh\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.687880 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.687899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-envoy\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.688182 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.687937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istiod-ca-cert\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.688182 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.688000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-podinfo\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.688182 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.688018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-token\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.688182 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.688089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-socket\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.688182 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.688139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-data\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.688406 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.688214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-credential-socket\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.688406 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.688241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-certs\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.788843 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.788804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-podinfo\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.788843 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.788842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-token\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.788869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-socket\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.788902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-data\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.788969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-credential-socket\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.788992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-certs\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6kh\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-kube-api-access-xs6kh\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-envoy\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789127 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istiod-ca-cert\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789502 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-credential-socket\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789502 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-data\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789612 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-certs\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789664 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789614    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-socket\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.789837 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.789820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istiod-ca-cert\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.791768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.791723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-envoy\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.791924 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.791902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-podinfo\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.798492 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.798456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-token\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.798792 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.798728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6kh\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-kube-api-access-xs6kh\") pod \"e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") " pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:34.823019 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.822982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:34.911105 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:34.911072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:35.065633 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.065590    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"]
Jul 27 19:11:35.068566 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:11:35.068531    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de1e95b_f41c_4a5e_b4a2_d9eab9140a14.slice/crio-62df7ff1e9a78bd28253588523b60fe86b4256570016860324afd0d43b5a8a40 WatchSource:0}: Error finding container 62df7ff1e9a78bd28253588523b60fe86b4256570016860324afd0d43b5a8a40: Status 404 returned error can't find the container with id 62df7ff1e9a78bd28253588523b60fe86b4256570016860324afd0d43b5a8a40
Jul 27 19:11:35.070710 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.070670    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:11:35.070856 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.070769    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:11:35.070856 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.070807    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:11:35.570637 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.570597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" event={"ID":"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14","Type":"ContainerStarted","Data":"c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80"}
Jul 27 19:11:35.570835 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.570669    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" event={"ID":"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14","Type":"ContainerStarted","Data":"62df7ff1e9a78bd28253588523b60fe86b4256570016860324afd0d43b5a8a40"}
Jul 27 19:11:35.604765 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.600191    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podStartSLOduration=1.600167474 podStartE2EDuration="1.600167474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:35.596641767 +0000 UTC m=+2420.349436204" watchObservedRunningTime="2026-07-27 19:11:35.600167474 +0000 UTC m=+2420.352961894"
Jul 27 19:11:35.911792 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:35.911733    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:36.917519 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:36.917484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:37.581680 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:37.581646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:37.582667 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:37.582641    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:37.629153 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:37.629103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:37.704305 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:37.704271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:37.927281 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:37.927247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:38.401301 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.401264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:38.504470 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.504431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:38.601173 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.601137    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"]
Jul 27 19:11:38.604418 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.604387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:38.604965 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.604948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.608385 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.608358    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-7aabc5\""
Jul 27 19:11:38.608554 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.608423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-7aabc5-dockercfg-fj4cn\""
Jul 27 19:11:38.618089 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.618050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"]
Jul 27 19:11:38.623077 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.623038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7kj9\" (UniqueName: \"kubernetes.io/projected/7fd79585-8141-4732-ad36-f89570124cf7-kube-api-access-f7kj9\") pod \"payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.623274 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.623223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fd79585-8141-4732-ad36-f89570124cf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.632150 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.632110    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"]
Jul 27 19:11:38.636588 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.636555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:38.648896 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.648859    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"]
Jul 27 19:11:38.724514 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.724400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/561905dc-7e6e-4d44-943c-73163fd43d27-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:38.724514 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.724469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7kj9\" (UniqueName: \"kubernetes.io/projected/7fd79585-8141-4732-ad36-f89570124cf7-kube-api-access-f7kj9\") pod \"payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.724914 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.724570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fd79585-8141-4732-ad36-f89570124cf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.724914 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.724599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6vbj\" (UniqueName: \"kubernetes.io/projected/561905dc-7e6e-4d44-943c-73163fd43d27-kube-api-access-w6vbj\") pod \"payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:38.725496 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.725470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fd79585-8141-4732-ad36-f89570124cf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.734428 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.734392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7kj9\" (UniqueName: \"kubernetes.io/projected/7fd79585-8141-4732-ad36-f89570124cf7-kube-api-access-f7kj9\") pod \"payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.825520 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.825480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6vbj\" (UniqueName: \"kubernetes.io/projected/561905dc-7e6e-4d44-943c-73163fd43d27-kube-api-access-w6vbj\") pod \"payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:38.825729 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.825570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/561905dc-7e6e-4d44-943c-73163fd43d27-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:38.826299 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.826278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/561905dc-7e6e-4d44-943c-73163fd43d27-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:38.840286 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.840251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6vbj\" (UniqueName: \"kubernetes.io/projected/561905dc-7e6e-4d44-943c-73163fd43d27-kube-api-access-w6vbj\") pod \"payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:38.918250 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.918200    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:38.950948 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:38.950896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:39.083725 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.083674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"]
Jul 27 19:11:39.086022 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:11:39.085987    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd79585_8141_4732_ad36_f89570124cf7.slice/crio-bf70790ef494849622048d7f65436ca50bde49373eb4ad200ccd7ec1c3e3c29a WatchSource:0}: Error finding container bf70790ef494849622048d7f65436ca50bde49373eb4ad200ccd7ec1c3e3c29a: Status 404 returned error can't find the container with id bf70790ef494849622048d7f65436ca50bde49373eb4ad200ccd7ec1c3e3c29a
Jul 27 19:11:39.115990 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.115958    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"]
Jul 27 19:11:39.123044 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:11:39.123012    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561905dc_7e6e_4d44_943c_73163fd43d27.slice/crio-e5ab4bf1eae41bf55beb6d139813bf040fffcb673c9e2cd6e359dfded3adbc69 WatchSource:0}: Error finding container e5ab4bf1eae41bf55beb6d139813bf040fffcb673c9e2cd6e359dfded3adbc69: Status 404 returned error can't find the container with id e5ab4bf1eae41bf55beb6d139813bf040fffcb673c9e2cd6e359dfded3adbc69
Jul 27 19:11:39.594043 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.593998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx" event={"ID":"7fd79585-8141-4732-ad36-f89570124cf7","Type":"ContainerStarted","Data":"b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c"}
Jul 27 19:11:39.594266 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.594072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx" event={"ID":"7fd79585-8141-4732-ad36-f89570124cf7","Type":"ContainerStarted","Data":"bf70790ef494849622048d7f65436ca50bde49373eb4ad200ccd7ec1c3e3c29a"}
Jul 27 19:11:39.594266 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.594102    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:39.595779 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.595724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc" event={"ID":"561905dc-7e6e-4d44-943c-73163fd43d27","Type":"ContainerStarted","Data":"a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517"}
Jul 27 19:11:39.595959 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.595810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc" event={"ID":"561905dc-7e6e-4d44-943c-73163fd43d27","Type":"ContainerStarted","Data":"e5ab4bf1eae41bf55beb6d139813bf040fffcb673c9e2cd6e359dfded3adbc69"}
Jul 27 19:11:39.595959 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.595903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:39.615293 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.615229    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx" podStartSLOduration=1.615212749 podStartE2EDuration="1.615212749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:39.612946323 +0000 UTC m=+2424.365740762" watchObservedRunningTime="2026-07-27 19:11:39.615212749 +0000 UTC m=+2424.368007168"
Jul 27 19:11:39.631608 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:39.631534    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc" podStartSLOduration=1.631517157 podStartE2EDuration="1.631517157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:39.630092511 +0000 UTC m=+2424.382886947" watchObservedRunningTime="2026-07-27 19:11:39.631517157 +0000 UTC m=+2424.384311577"
Jul 27 19:11:42.135582 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:42.135543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:42.503175 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:42.503062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:42.855524 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:42.855400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:43.244442 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:43.244404    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:46.302208 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:46.302171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:46.405800 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:46.405730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:46.924900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:46.924863    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"]
Jul 27 19:11:46.929950 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:46.929925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:46.934043 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:46.934019    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-954977-serving-cert\""
Jul 27 19:11:46.949102 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:46.949068    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"]
Jul 27 19:11:47.010401 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.010345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4209aa61-2ab9-4934-883f-4ad4a160f83d-maas-api-tls\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.010610 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.010413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7kh2\" (UniqueName: \"kubernetes.io/projected/4209aa61-2ab9-4934-883f-4ad4a160f83d-kube-api-access-m7kh2\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.010610 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.010566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4209aa61-2ab9-4934-883f-4ad4a160f83d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.111945 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.111883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4209aa61-2ab9-4934-883f-4ad4a160f83d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.112168 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.111965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4209aa61-2ab9-4934-883f-4ad4a160f83d-maas-api-tls\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.112168 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.112007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7kh2\" (UniqueName: \"kubernetes.io/projected/4209aa61-2ab9-4934-883f-4ad4a160f83d-kube-api-access-m7kh2\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.113034 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.113010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4209aa61-2ab9-4934-883f-4ad4a160f83d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.114933 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.114903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4209aa61-2ab9-4934-883f-4ad4a160f83d-maas-api-tls\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.127336 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.127305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7kh2\" (UniqueName: \"kubernetes.io/projected/4209aa61-2ab9-4934-883f-4ad4a160f83d-kube-api-access-m7kh2\") pod \"maas-api-e2e-inf-b-954977-79ffb9687d-qflh5\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.141861 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.141819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:47.242516 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.242410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:47.255618 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.255574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:47.488228 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.488186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"]
Jul 27 19:11:47.495939 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:11:47.495826    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4209aa61_2ab9_4934_883f_4ad4a160f83d.slice/crio-a833c04bea87531a331fda9717bbcdd0fb3061030ab659737a0ab6028864be4c WatchSource:0}: Error finding container a833c04bea87531a331fda9717bbcdd0fb3061030ab659737a0ab6028864be4c: Status 404 returned error can't find the container with id a833c04bea87531a331fda9717bbcdd0fb3061030ab659737a0ab6028864be4c
Jul 27 19:11:47.497884 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.497864    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:11:47.595655 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.595614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:47.638512 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.638448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5" event={"ID":"4209aa61-2ab9-4934-883f-4ad4a160f83d","Type":"ContainerStarted","Data":"a833c04bea87531a331fda9717bbcdd0fb3061030ab659737a0ab6028864be4c"}
Jul 27 19:11:47.693786 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.693674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:47.881527 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.881412    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"]
Jul 27 19:11:47.887225 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.887188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:47.892491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.892452    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-954977\""
Jul 27 19:11:47.892491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.892483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-954977-dockercfg-rmrtq\""
Jul 27 19:11:47.899259 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.899223    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"]
Jul 27 19:11:47.922566 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.922462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0d3295-d67e-4f71-b876-6b942e94c22a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:47.922566 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:47.922535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n6bd\" (UniqueName: \"kubernetes.io/projected/ad0d3295-d67e-4f71-b876-6b942e94c22a-kube-api-access-4n6bd\") pod \"payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:48.023244 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.023209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n6bd\" (UniqueName: \"kubernetes.io/projected/ad0d3295-d67e-4f71-b876-6b942e94c22a-kube-api-access-4n6bd\") pod \"payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:48.023404 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.023302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0d3295-d67e-4f71-b876-6b942e94c22a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:48.024072 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.024052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0d3295-d67e-4f71-b876-6b942e94c22a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:48.032098 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.032055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n6bd\" (UniqueName: \"kubernetes.io/projected/ad0d3295-d67e-4f71-b876-6b942e94c22a-kube-api-access-4n6bd\") pod \"payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:48.206701 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.206454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:48.613446 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.613411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"]
Jul 27 19:11:48.616481 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:11:48.616442    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0d3295_d67e_4f71_b876_6b942e94c22a.slice/crio-944781d1a3f712b0afa56aa538b08c24ded37aefdf005bf7b49301d84e970189 WatchSource:0}: Error finding container 944781d1a3f712b0afa56aa538b08c24ded37aefdf005bf7b49301d84e970189: Status 404 returned error can't find the container with id 944781d1a3f712b0afa56aa538b08c24ded37aefdf005bf7b49301d84e970189
Jul 27 19:11:48.646654 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.646601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5" event={"ID":"4209aa61-2ab9-4934-883f-4ad4a160f83d","Type":"ContainerStarted","Data":"dfb4b1e367864aa1288c2bdb73078495bd4b462eddb18daba71f2b4750ac1497"}
Jul 27 19:11:48.646841 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.646735    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:48.647884 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.647859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz" event={"ID":"ad0d3295-d67e-4f71-b876-6b942e94c22a","Type":"ContainerStarted","Data":"944781d1a3f712b0afa56aa538b08c24ded37aefdf005bf7b49301d84e970189"}
Jul 27 19:11:48.668118 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:48.668021    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5" podStartSLOduration=2.207581839 podStartE2EDuration="2.66797939s" totalImagesPullingTime="460.397551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:48.664987655 +0000 UTC m=+2433.417782090" watchObservedRunningTime="2026-07-27 19:11:48.66797939 +0000 UTC m=+2433.420773811"
Jul 27 19:11:49.655066 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:49.655020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz" event={"ID":"ad0d3295-d67e-4f71-b876-6b942e94c22a","Type":"ContainerStarted","Data":"38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca"}
Jul 27 19:11:49.672181 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:49.672119    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz" podStartSLOduration=2.672096051 podStartE2EDuration="2.672096051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:49.671972942 +0000 UTC m=+2434.424767384" watchObservedRunningTime="2026-07-27 19:11:49.672096051 +0000 UTC m=+2434.424890490"
Jul 27 19:11:50.604186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:50.604150    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:11:50.604370 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:50.604245    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:11:50.672490 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:50.672349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:11:50.773797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:50.773720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:52.583583 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.583545    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:11:52.584153 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.583629    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 27 19:11:52.686548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.686514    2578 generic.go:356] "Generic (PLEG): container finished" podID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerID="c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80" exitCode=0
Jul 27 19:11:52.686724 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.686581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" event={"ID":"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14","Type":"ContainerDied","Data":"c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80"}
Jul 27 19:11:52.687188 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.687169    2578 scope.go:117] "RemoveContainer" containerID="c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80"
Jul 27 19:11:52.688503 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.688466    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:11:52.688598 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.688561    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:11:52.688637 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:52.688609    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:11:53.696520 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:53.696482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" event={"ID":"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14","Type":"ContainerStarted","Data":"02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0"}
Jul 27 19:11:53.911979 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:53.911933    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:53.912252 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:53.912228    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:11:53.912322 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:53.912280    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 27 19:11:54.660569 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:54.660539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:11:54.912566 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:54.912456    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:11:54.912566 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:54.912533    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 27 19:11:55.912198 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:55.912145    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:11:55.912412 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:55.912225    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 27 19:11:56.912523 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:56.912482    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 27 19:11:56.912968 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:56.912542    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 27 19:11:57.916274 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:57.916242    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:57.916712 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:57.916529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:11:57.917328 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:11:57.917311    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:12:01.680960 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:12:01.680925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:12:02.422600 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:12:02.422548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:29.596518 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:12:29.596476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:31.744317 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:31.744212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:32.758317 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:32.758275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:33.854257 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:33.854218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:33.957421 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:33.957378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:44.517662 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.517621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:44.547690 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.547637    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"]
Jul 27 19:13:44.547982 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.547953    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc" podUID="561905dc-7e6e-4d44-943c-73163fd43d27" containerName="payload-processing" containerID="cri-o://a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517" gracePeriod=30
Jul 27 19:13:44.556518 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.555512    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"]
Jul 27 19:13:44.556518 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.555798    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx" podUID="7fd79585-8141-4732-ad36-f89570124cf7" containerName="payload-pre-processing" containerID="cri-o://b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c" gracePeriod=30
Jul 27 19:13:44.585951 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.585913    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:44.686922 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.686883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:44.855514 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.855489    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:13:44.859245 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.859216    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:13:44.889759 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.889704    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/561905dc-7e6e-4d44-943c-73163fd43d27-plugins-config-volume\") pod \"561905dc-7e6e-4d44-943c-73163fd43d27\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") "
Jul 27 19:13:44.889759 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.889858    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6vbj\" (UniqueName: \"kubernetes.io/projected/561905dc-7e6e-4d44-943c-73163fd43d27-kube-api-access-w6vbj\") pod \"561905dc-7e6e-4d44-943c-73163fd43d27\" (UID: \"561905dc-7e6e-4d44-943c-73163fd43d27\") "
Jul 27 19:13:44.889759 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.890219    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561905dc-7e6e-4d44-943c-73163fd43d27-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "561905dc-7e6e-4d44-943c-73163fd43d27" (UID: "561905dc-7e6e-4d44-943c-73163fd43d27"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:13:44.893209 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.893174    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561905dc-7e6e-4d44-943c-73163fd43d27-kube-api-access-w6vbj" (OuterVolumeSpecName: "kube-api-access-w6vbj") pod "561905dc-7e6e-4d44-943c-73163fd43d27" (UID: "561905dc-7e6e-4d44-943c-73163fd43d27"). InnerVolumeSpecName "kube-api-access-w6vbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:44.991526 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.991484    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7kj9\" (UniqueName: \"kubernetes.io/projected/7fd79585-8141-4732-ad36-f89570124cf7-kube-api-access-f7kj9\") pod \"7fd79585-8141-4732-ad36-f89570124cf7\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") "
Jul 27 19:13:44.991724 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.991609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fd79585-8141-4732-ad36-f89570124cf7-plugins-config-volume\") pod \"7fd79585-8141-4732-ad36-f89570124cf7\" (UID: \"7fd79585-8141-4732-ad36-f89570124cf7\") "
Jul 27 19:13:44.991885 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.991869    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6vbj\" (UniqueName: \"kubernetes.io/projected/561905dc-7e6e-4d44-943c-73163fd43d27-kube-api-access-w6vbj\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:13:44.991970 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.991886    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/561905dc-7e6e-4d44-943c-73163fd43d27-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:13:44.992085 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.992061    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fd79585-8141-4732-ad36-f89570124cf7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7fd79585-8141-4732-ad36-f89570124cf7" (UID: "7fd79585-8141-4732-ad36-f89570124cf7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:13:44.993777 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:44.993750    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd79585-8141-4732-ad36-f89570124cf7-kube-api-access-f7kj9" (OuterVolumeSpecName: "kube-api-access-f7kj9") pod "7fd79585-8141-4732-ad36-f89570124cf7" (UID: "7fd79585-8141-4732-ad36-f89570124cf7"). InnerVolumeSpecName "kube-api-access-f7kj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:45.092624 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.092529    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7kj9\" (UniqueName: \"kubernetes.io/projected/7fd79585-8141-4732-ad36-f89570124cf7-kube-api-access-f7kj9\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:13:45.092624 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.092560    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fd79585-8141-4732-ad36-f89570124cf7-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:13:45.300682 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.300636    2578 generic.go:356] "Generic (PLEG): container finished" podID="561905dc-7e6e-4d44-943c-73163fd43d27" containerID="a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517" exitCode=0
Jul 27 19:13:45.300682 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.300688    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"
Jul 27 19:13:45.300995 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.300732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc" event={"ID":"561905dc-7e6e-4d44-943c-73163fd43d27","Type":"ContainerDied","Data":"a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517"}
Jul 27 19:13:45.300995 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.300822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc" event={"ID":"561905dc-7e6e-4d44-943c-73163fd43d27","Type":"ContainerDied","Data":"e5ab4bf1eae41bf55beb6d139813bf040fffcb673c9e2cd6e359dfded3adbc69"}
Jul 27 19:13:45.300995 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.300850    2578 scope.go:117] "RemoveContainer" containerID="a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517"
Jul 27 19:13:45.302288 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.302260    2578 generic.go:356] "Generic (PLEG): container finished" podID="7fd79585-8141-4732-ad36-f89570124cf7" containerID="b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c" exitCode=0
Jul 27 19:13:45.302385 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.302307    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"
Jul 27 19:13:45.302385 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.302348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx" event={"ID":"7fd79585-8141-4732-ad36-f89570124cf7","Type":"ContainerDied","Data":"b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c"}
Jul 27 19:13:45.302503 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.302391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx" event={"ID":"7fd79585-8141-4732-ad36-f89570124cf7","Type":"ContainerDied","Data":"bf70790ef494849622048d7f65436ca50bde49373eb4ad200ccd7ec1c3e3c29a"}
Jul 27 19:13:45.311436 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.311409    2578 scope.go:117] "RemoveContainer" containerID="a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517"
Jul 27 19:13:45.311971 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:13:45.311947    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517\": container with ID starting with a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517 not found: ID does not exist" containerID="a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517"
Jul 27 19:13:45.312085 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.311981    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517"} err="failed to get container status \"a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517\": rpc error: code = NotFound desc = could not find container \"a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517\": container with ID starting with a1e8595e762f66a81d847e1eac2b87e79af5bd63b2c20b076cbc434094725517 not found: ID does not exist"
Jul 27 19:13:45.312085 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.312002    2578 scope.go:117] "RemoveContainer" containerID="b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c"
Jul 27 19:13:45.321425 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.321400    2578 scope.go:117] "RemoveContainer" containerID="b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c"
Jul 27 19:13:45.321780 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:13:45.321758    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c\": container with ID starting with b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c not found: ID does not exist" containerID="b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c"
Jul 27 19:13:45.321845 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.321790    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c"} err="failed to get container status \"b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c\": rpc error: code = NotFound desc = could not find container \"b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c\": container with ID starting with b2496fe7a5ff5deaaa5208a21379a49089cf3e34ac596b61f8f1c8936e5d897c not found: ID does not exist"
Jul 27 19:13:45.325970 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.325933    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"]
Jul 27 19:13:45.335763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.335717    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7aabc5-6fd667fc48-lwzdx"]
Jul 27 19:13:45.345303 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.345215    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"]
Jul 27 19:13:45.349477 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.349444    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7aabc5-6bbfb8cc5b-dp8gc"]
Jul 27 19:13:45.847379 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.847336    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561905dc-7e6e-4d44-943c-73163fd43d27" path="/var/lib/kubelet/pods/561905dc-7e6e-4d44-943c-73163fd43d27/volumes"
Jul 27 19:13:45.848567 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:45.848528    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd79585-8141-4732-ad36-f89570124cf7" path="/var/lib/kubelet/pods/7fd79585-8141-4732-ad36-f89570124cf7/volumes"
Jul 27 19:13:47.973150 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:47.973112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:48.406887 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:48.406848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:55.413199 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:55.413152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:55.510239 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:55.510199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:55.729143 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:55.729038    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"]
Jul 27 19:13:55.729348 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:55.729302    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy" containerID="cri-o://02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0" gracePeriod=30
Jul 27 19:13:55.757815 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:55.757734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:56.032633 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:56.032523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:57.919598 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:57.919547    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:13:57.920064 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:13:57.919638    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:14:01.022906 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.022868    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:14:01.159233 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159189    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-podinfo\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-credential-socket\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159268    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-certs\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159304    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-envoy\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159332    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-socket\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159390    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-token\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159432    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istiod-ca-cert\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159793 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159497    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-data\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159793 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs6kh\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-kube-api-access-xs6kh\") pod \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\" (UID: \"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14\") "
Jul 27 19:14:01.159793 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159569    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:01.159793 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:01.159793 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:01.160071 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.159937    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:14:01.160071 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.160004    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.160071 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.160027    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.160071 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.160045    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.160952 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.160926    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-data" (OuterVolumeSpecName: "istio-data") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:01.161976 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.161951    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:14:01.162058 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.162034    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-kube-api-access-xs6kh" (OuterVolumeSpecName: "kube-api-access-xs6kh") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "kube-api-access-xs6kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:01.162262 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.162245    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:14:01.162302 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.162279    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-token" (OuterVolumeSpecName: "istio-token") pod "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" (UID: "1de1e95b-f41c-4a5e-b4a2-d9eab9140a14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:01.260900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.260806    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.260900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.260840    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.260900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.260849    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.260900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.260857    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.260900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.260865    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs6kh\" (UniqueName: \"kubernetes.io/projected/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-kube-api-access-xs6kh\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.260900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.260874    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:01.388186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.388151    2578 generic.go:356] "Generic (PLEG): container finished" podID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerID="02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0" exitCode=0
Jul 27 19:14:01.388386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.388213    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"
Jul 27 19:14:01.388386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.388238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" event={"ID":"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14","Type":"ContainerDied","Data":"02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0"}
Jul 27 19:14:01.388386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.388304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c" event={"ID":"1de1e95b-f41c-4a5e-b4a2-d9eab9140a14","Type":"ContainerDied","Data":"62df7ff1e9a78bd28253588523b60fe86b4256570016860324afd0d43b5a8a40"}
Jul 27 19:14:01.388386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.388331    2578 scope.go:117] "RemoveContainer" containerID="02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0"
Jul 27 19:14:01.399279 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.399255    2578 scope.go:117] "RemoveContainer" containerID="c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80"
Jul 27 19:14:01.408637 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.408615    2578 scope.go:117] "RemoveContainer" containerID="02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0"
Jul 27 19:14:01.409084 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:14:01.409060    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0\": container with ID starting with 02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0 not found: ID does not exist" containerID="02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0"
Jul 27 19:14:01.409166 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.409101    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0"} err="failed to get container status \"02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0\": rpc error: code = NotFound desc = could not find container \"02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0\": container with ID starting with 02c5e96822bc1f2205e68fec4017df79416848351655936c0a4532fcf9efa3b0 not found: ID does not exist"
Jul 27 19:14:01.409166 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.409123    2578 scope.go:117] "RemoveContainer" containerID="c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80"
Jul 27 19:14:01.409481 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:14:01.409452    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80\": container with ID starting with c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80 not found: ID does not exist" containerID="c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80"
Jul 27 19:14:01.409593 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.409489    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80"} err="failed to get container status \"c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80\": rpc error: code = NotFound desc = could not find container \"c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80\": container with ID starting with c259e76429058d1d5678327bb233d5c5fad22ce02c440466702482d8cecc5e80 not found: ID does not exist"
Jul 27 19:14:01.412130 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.412094    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"]
Jul 27 19:14:01.416718 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.416686    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7aabc5-openshift-default-5fcb877d8d-qtx5c"]
Jul 27 19:14:01.846176 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:01.846135    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" path="/var/lib/kubelet/pods/1de1e95b-f41c-4a5e-b4a2-d9eab9140a14/volumes"
Jul 27 19:14:07.269566 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.269463    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"]
Jul 27 19:14:07.270198 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.269832    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5" podUID="4209aa61-2ab9-4934-883f-4ad4a160f83d" containerName="maas-api" containerID="cri-o://dfb4b1e367864aa1288c2bdb73078495bd4b462eddb18daba71f2b4750ac1497" gracePeriod=30
Jul 27 19:14:07.312352 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.312313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:07.350358 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.350317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"]
Jul 27 19:14:07.350600 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.350556    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz" podUID="ad0d3295-d67e-4f71-b876-6b942e94c22a" containerName="payload-processing" containerID="cri-o://38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca" gracePeriod=30
Jul 27 19:14:07.418177 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.418143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:07.419873 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.419841    2578 generic.go:356] "Generic (PLEG): container finished" podID="4209aa61-2ab9-4934-883f-4ad4a160f83d" containerID="dfb4b1e367864aa1288c2bdb73078495bd4b462eddb18daba71f2b4750ac1497" exitCode=0
Jul 27 19:14:07.420057 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.419925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5" event={"ID":"4209aa61-2ab9-4934-883f-4ad4a160f83d","Type":"ContainerDied","Data":"dfb4b1e367864aa1288c2bdb73078495bd4b462eddb18daba71f2b4750ac1497"}
Jul 27 19:14:07.555878 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.555623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:07.609698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.609660    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:14:07.640421 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.640379    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:14:07.722591 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.722554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7kh2\" (UniqueName: \"kubernetes.io/projected/4209aa61-2ab9-4934-883f-4ad4a160f83d-kube-api-access-m7kh2\") pod \"4209aa61-2ab9-4934-883f-4ad4a160f83d\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") "
Jul 27 19:14:07.722828 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.722609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4209aa61-2ab9-4934-883f-4ad4a160f83d-openshift-service-ca\") pod \"4209aa61-2ab9-4934-883f-4ad4a160f83d\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") "
Jul 27 19:14:07.722828 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.722634    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4209aa61-2ab9-4934-883f-4ad4a160f83d-maas-api-tls\") pod \"4209aa61-2ab9-4934-883f-4ad4a160f83d\" (UID: \"4209aa61-2ab9-4934-883f-4ad4a160f83d\") "
Jul 27 19:14:07.723068 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.723045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4209aa61-2ab9-4934-883f-4ad4a160f83d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4209aa61-2ab9-4934-883f-4ad4a160f83d" (UID: "4209aa61-2ab9-4934-883f-4ad4a160f83d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:14:07.725075 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.725045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4209aa61-2ab9-4934-883f-4ad4a160f83d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4209aa61-2ab9-4934-883f-4ad4a160f83d" (UID: "4209aa61-2ab9-4934-883f-4ad4a160f83d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:14:07.725176 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.725050    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4209aa61-2ab9-4934-883f-4ad4a160f83d-kube-api-access-m7kh2" (OuterVolumeSpecName: "kube-api-access-m7kh2") pod "4209aa61-2ab9-4934-883f-4ad4a160f83d" (UID: "4209aa61-2ab9-4934-883f-4ad4a160f83d"). InnerVolumeSpecName "kube-api-access-m7kh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:07.824227 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.824126    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0d3295-d67e-4f71-b876-6b942e94c22a-plugins-config-volume\") pod \"ad0d3295-d67e-4f71-b876-6b942e94c22a\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") "
Jul 27 19:14:07.824227 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.824181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n6bd\" (UniqueName: \"kubernetes.io/projected/ad0d3295-d67e-4f71-b876-6b942e94c22a-kube-api-access-4n6bd\") pod \"ad0d3295-d67e-4f71-b876-6b942e94c22a\" (UID: \"ad0d3295-d67e-4f71-b876-6b942e94c22a\") "
Jul 27 19:14:07.824475 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.824373    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7kh2\" (UniqueName: \"kubernetes.io/projected/4209aa61-2ab9-4934-883f-4ad4a160f83d-kube-api-access-m7kh2\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:07.824475 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.824386    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4209aa61-2ab9-4934-883f-4ad4a160f83d-openshift-service-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:07.824475 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.824395    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4209aa61-2ab9-4934-883f-4ad4a160f83d-maas-api-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:07.824635 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.824531    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0d3295-d67e-4f71-b876-6b942e94c22a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad0d3295-d67e-4f71-b876-6b942e94c22a" (UID: "ad0d3295-d67e-4f71-b876-6b942e94c22a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:14:07.826591 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.826560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0d3295-d67e-4f71-b876-6b942e94c22a-kube-api-access-4n6bd" (OuterVolumeSpecName: "kube-api-access-4n6bd") pod "ad0d3295-d67e-4f71-b876-6b942e94c22a" (UID: "ad0d3295-d67e-4f71-b876-6b942e94c22a"). InnerVolumeSpecName "kube-api-access-4n6bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:14:07.926021 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.925987    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0d3295-d67e-4f71-b876-6b942e94c22a-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:07.926021 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:07.926018    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n6bd\" (UniqueName: \"kubernetes.io/projected/ad0d3295-d67e-4f71-b876-6b942e94c22a-kube-api-access-4n6bd\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:14:08.427564 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.427533    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"
Jul 27 19:14:08.428077 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.427563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5" event={"ID":"4209aa61-2ab9-4934-883f-4ad4a160f83d","Type":"ContainerDied","Data":"a833c04bea87531a331fda9717bbcdd0fb3061030ab659737a0ab6028864be4c"}
Jul 27 19:14:08.428077 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.427639    2578 scope.go:117] "RemoveContainer" containerID="dfb4b1e367864aa1288c2bdb73078495bd4b462eddb18daba71f2b4750ac1497"
Jul 27 19:14:08.429328 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.429298    2578 generic.go:356] "Generic (PLEG): container finished" podID="ad0d3295-d67e-4f71-b876-6b942e94c22a" containerID="38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca" exitCode=0
Jul 27 19:14:08.429473 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.429346    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"
Jul 27 19:14:08.429473 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.429384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz" event={"ID":"ad0d3295-d67e-4f71-b876-6b942e94c22a","Type":"ContainerDied","Data":"38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca"}
Jul 27 19:14:08.429473 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.429437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz" event={"ID":"ad0d3295-d67e-4f71-b876-6b942e94c22a","Type":"ContainerDied","Data":"944781d1a3f712b0afa56aa538b08c24ded37aefdf005bf7b49301d84e970189"}
Jul 27 19:14:08.437958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.437937    2578 scope.go:117] "RemoveContainer" containerID="38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca"
Jul 27 19:14:08.449343 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.449319    2578 scope.go:117] "RemoveContainer" containerID="38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca"
Jul 27 19:14:08.449714 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:14:08.449692    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca\": container with ID starting with 38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca not found: ID does not exist" containerID="38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca"
Jul 27 19:14:08.449796 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.449727    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca"} err="failed to get container status \"38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca\": rpc error: code = NotFound desc = could not find container \"38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca\": container with ID starting with 38e737a7db162ad107a1800d49f000b51d962061d32af94303a6a03bdd7c1aca not found: ID does not exist"
Jul 27 19:14:08.459519 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.459479    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"]
Jul 27 19:14:08.470407 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.470366    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-954977-6c9fcdd446-zq7bz"]
Jul 27 19:14:08.490533 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.490485    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"]
Jul 27 19:14:08.498293 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:08.498254    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-954977-79ffb9687d-qflh5"]
Jul 27 19:14:09.845757 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:09.845706    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4209aa61-2ab9-4934-883f-4ad4a160f83d" path="/var/lib/kubelet/pods/4209aa61-2ab9-4934-883f-4ad4a160f83d/volumes"
Jul 27 19:14:09.846141 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:09.846106    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0d3295-d67e-4f71-b876-6b942e94c22a" path="/var/lib/kubelet/pods/ad0d3295-d67e-4f71-b876-6b942e94c22a/volumes"
Jul 27 19:14:11.214193 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:11.214152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:11.615807 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:11.615714    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:18.353391 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:18.353346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:18.422801 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:18.422759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:18.725604 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:18.725564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:18.899001 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:18.898967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:19.240930 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.240888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:19.533178 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533088    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"]
Jul 27 19:14:19.533548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533500    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4209aa61-2ab9-4934-883f-4ad4a160f83d" containerName="maas-api"
Jul 27 19:14:19.533548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533513    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4209aa61-2ab9-4934-883f-4ad4a160f83d" containerName="maas-api"
Jul 27 19:14:19.533548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533522    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy"
Jul 27 19:14:19.533548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533528    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy"
Jul 27 19:14:19.533548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533538    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd79585-8141-4732-ad36-f89570124cf7" containerName="payload-pre-processing"
Jul 27 19:14:19.533548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533544    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd79585-8141-4732-ad36-f89570124cf7" containerName="payload-pre-processing"
Jul 27 19:14:19.533548 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533551    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561905dc-7e6e-4d44-943c-73163fd43d27" containerName="payload-processing"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533557    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="561905dc-7e6e-4d44-943c-73163fd43d27" containerName="payload-processing"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533565    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533573    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533592    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0d3295-d67e-4f71-b876-6b942e94c22a" containerName="payload-processing"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533597    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0d3295-d67e-4f71-b876-6b942e94c22a" containerName="payload-processing"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533649    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="561905dc-7e6e-4d44-943c-73163fd43d27" containerName="payload-processing"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533656    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533664    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4209aa61-2ab9-4934-883f-4ad4a160f83d" containerName="maas-api"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533673    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd79585-8141-4732-ad36-f89570124cf7" containerName="payload-pre-processing"
Jul 27 19:14:19.533789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.533682    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0d3295-d67e-4f71-b876-6b942e94c22a" containerName="payload-processing"
Jul 27 19:14:19.538639 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.538609    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.544627 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.544597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-cad7f7-openshift-default-dockercfg-p4ldb\""
Jul 27 19:14:19.556915 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.556880    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"]
Jul 27 19:14:19.568262 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.568216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:19.611101 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-certs\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611101 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d80c68b5-90cb-44dd-baac-307e1b193878-istio-podinfo\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d80c68b5-90cb-44dd-baac-307e1b193878-istiod-ca-cert\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-data\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-credential-socket\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-istio-token\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611467 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-envoy\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611467 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-socket\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.611467 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.611422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rswpk\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-kube-api-access-rswpk\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.711946 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.711882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-socket\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.711946 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.711938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rswpk\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-kube-api-access-rswpk\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.711971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-certs\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.711996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d80c68b5-90cb-44dd-baac-307e1b193878-istio-podinfo\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d80c68b5-90cb-44dd-baac-307e1b193878-istiod-ca-cert\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-data\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-credential-socket\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-istio-token\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-envoy\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712549 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-socket\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712549 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-certs\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712723 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-data\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712723 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-credential-socket\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.712930 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.712907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d80c68b5-90cb-44dd-baac-307e1b193878-istiod-ca-cert\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.714826 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.714786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-envoy\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.714982 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.714943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d80c68b5-90cb-44dd-baac-307e1b193878-istio-podinfo\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.737928 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.737881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-istio-token\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.738151 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.738124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rswpk\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-kube-api-access-rswpk\") pod \"e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") " pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.859707 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.859610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:19.868706 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:19.868657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:20.020836 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.020800    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"]
Jul 27 19:14:20.024394 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:14:20.024353    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80c68b5_90cb_44dd_baac_307e1b193878.slice/crio-574185415ceb1b52cf8c0069302f87d936916f03e64c2cb8a0bb0887b43f2652 WatchSource:0}: Error finding container 574185415ceb1b52cf8c0069302f87d936916f03e64c2cb8a0bb0887b43f2652: Status 404 returned error can't find the container with id 574185415ceb1b52cf8c0069302f87d936916f03e64c2cb8a0bb0887b43f2652
Jul 27 19:14:20.026465 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.026426    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:14:20.026562 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.026499    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:14:20.026562 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.026528    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:14:20.492084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.492047    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" event={"ID":"d80c68b5-90cb-44dd-baac-307e1b193878","Type":"ContainerStarted","Data":"5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f"}
Jul 27 19:14:20.492305 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.492108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" event={"ID":"d80c68b5-90cb-44dd-baac-307e1b193878","Type":"ContainerStarted","Data":"574185415ceb1b52cf8c0069302f87d936916f03e64c2cb8a0bb0887b43f2652"}
Jul 27 19:14:20.518331 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.518261    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podStartSLOduration=1.51824294 podStartE2EDuration="1.51824294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:20.515481392 +0000 UTC m=+2585.268275828" watchObservedRunningTime="2026-07-27 19:14:20.51824294 +0000 UTC m=+2585.271037359"
Jul 27 19:14:20.860566 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:20.860462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:21.865350 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:21.865317    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:22.502019 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.501970    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:22.503066 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.503042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:22.531925 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.531881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:22.639812 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.639775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:22.761208 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.761114    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"]
Jul 27 19:14:22.761585 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.761571    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de1e95b-f41c-4a5e-b4a2-d9eab9140a14" containerName="istio-proxy"
Jul 27 19:14:22.764524 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.764501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.767255 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.767222    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-cad7f7-serving-cert\""
Jul 27 19:14:22.779848 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.779813    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"]
Jul 27 19:14:22.792274 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.792226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:22.846469 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.846422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59a13c69-7435-4df6-a244-80f47e26ce30-maas-api-tls\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.846881 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.846851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59a13c69-7435-4df6-a244-80f47e26ce30-openshift-service-ca\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.847028 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.846898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dw4q\" (UniqueName: \"kubernetes.io/projected/59a13c69-7435-4df6-a244-80f47e26ce30-kube-api-access-9dw4q\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.947931 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.947869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59a13c69-7435-4df6-a244-80f47e26ce30-maas-api-tls\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.947931 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.947943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59a13c69-7435-4df6-a244-80f47e26ce30-openshift-service-ca\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.948517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.947965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dw4q\" (UniqueName: \"kubernetes.io/projected/59a13c69-7435-4df6-a244-80f47e26ce30-kube-api-access-9dw4q\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.948652 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.948631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59a13c69-7435-4df6-a244-80f47e26ce30-openshift-service-ca\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.950911 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.950884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59a13c69-7435-4df6-a244-80f47e26ce30-maas-api-tls\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.960031 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.960005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dw4q\" (UniqueName: \"kubernetes.io/projected/59a13c69-7435-4df6-a244-80f47e26ce30-kube-api-access-9dw4q\") pod \"maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:22.983235 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:22.983197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:23.077024 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.076910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:23.244595 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.244553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"]
Jul 27 19:14:23.253241 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:14:23.249936    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a13c69_7435_4df6_a244_80f47e26ce30.slice/crio-0fa55238458e96a1d438b0761db74a0f7bbb77b634799fc6f0460ae2c8c5b63c WatchSource:0}: Error finding container 0fa55238458e96a1d438b0761db74a0f7bbb77b634799fc6f0460ae2c8c5b63c: Status 404 returned error can't find the container with id 0fa55238458e96a1d438b0761db74a0f7bbb77b634799fc6f0460ae2c8c5b63c
Jul 27 19:14:23.449021 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.448973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:23.507958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.507910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6" event={"ID":"59a13c69-7435-4df6-a244-80f47e26ce30","Type":"ContainerStarted","Data":"0fa55238458e96a1d438b0761db74a0f7bbb77b634799fc6f0460ae2c8c5b63c"}
Jul 27 19:14:23.562853 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.562812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:23.614829 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.614787    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"]
Jul 27 19:14:23.619462 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.619439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:23.622813 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.622771    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-cad7f7\""
Jul 27 19:14:23.622997 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.622834    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-cad7f7-dockercfg-tlwd5\""
Jul 27 19:14:23.631377 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.631331    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"]
Jul 27 19:14:23.654490 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.654449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a4831f-289a-4864-b1e1-65101fc16fd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:23.654490 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.654491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b9nw\" (UniqueName: \"kubernetes.io/projected/b4a4831f-289a-4864-b1e1-65101fc16fd7-kube-api-access-5b9nw\") pod \"payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:23.755584 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.755474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a4831f-289a-4864-b1e1-65101fc16fd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:23.755584 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.755517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b9nw\" (UniqueName: \"kubernetes.io/projected/b4a4831f-289a-4864-b1e1-65101fc16fd7-kube-api-access-5b9nw\") pod \"payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:23.756346 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.756317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a4831f-289a-4864-b1e1-65101fc16fd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:23.767038 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.767000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b9nw\" (UniqueName: \"kubernetes.io/projected/b4a4831f-289a-4864-b1e1-65101fc16fd7-kube-api-access-5b9nw\") pod \"payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:23.932106 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:23.932064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:24.093403 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.093362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"]
Jul 27 19:14:24.097533 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:14:24.097486    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a4831f_289a_4864_b1e1_65101fc16fd7.slice/crio-0827f5bdd91daeb5064964b12df89f9342410a355523e864103384f4dd427ccb WatchSource:0}: Error finding container 0827f5bdd91daeb5064964b12df89f9342410a355523e864103384f4dd427ccb: Status 404 returned error can't find the container with id 0827f5bdd91daeb5064964b12df89f9342410a355523e864103384f4dd427ccb
Jul 27 19:14:24.515089 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.515042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6" event={"ID":"59a13c69-7435-4df6-a244-80f47e26ce30","Type":"ContainerStarted","Data":"7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92"}
Jul 27 19:14:24.515325 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.515168    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:24.516792 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.516760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p" event={"ID":"b4a4831f-289a-4864-b1e1-65101fc16fd7","Type":"ContainerStarted","Data":"cad2abf50ae6a015029e25d4a0b244e4d2e9b7786d2313255254974bdc3ae5ed"}
Jul 27 19:14:24.516922 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.516814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p" event={"ID":"b4a4831f-289a-4864-b1e1-65101fc16fd7","Type":"ContainerStarted","Data":"0827f5bdd91daeb5064964b12df89f9342410a355523e864103384f4dd427ccb"}
Jul 27 19:14:24.516922 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.516862    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:24.540111 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.540051    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6" podStartSLOduration=1.9451459 podStartE2EDuration="2.540030508s" totalImagesPullingTime="594.884608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:24.539054174 +0000 UTC m=+2589.291848600" watchObservedRunningTime="2026-07-27 19:14:24.540030508 +0000 UTC m=+2589.292824928"
Jul 27 19:14:24.564419 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:24.564362    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p" podStartSLOduration=1.564344872 podStartE2EDuration="1.564344872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:24.563310838 +0000 UTC m=+2589.316105275" watchObservedRunningTime="2026-07-27 19:14:24.564344872 +0000 UTC m=+2589.317139291"
Jul 27 19:14:26.985183 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:26.985148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:27.548449 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:27.548407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:28.005282 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:28.005242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:28.298439 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:28.298336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:30.528021 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:30.527983    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:14:31.506936 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.506895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:31.681217 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.681139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:31.828894 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.828791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"]
Jul 27 19:14:31.832677 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.832648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:31.841077 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.841048    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5b0fac-serving-cert\""
Jul 27 19:14:31.878785 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.876470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"]
Jul 27 19:14:31.932850 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.932808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:31.934921 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.934891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895bae-2015-41e9-8406-467656734caf-openshift-service-ca\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:31.935051 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.934972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:31.935051 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:31.934997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crjpr\" (UniqueName: \"kubernetes.io/projected/95895bae-2015-41e9-8406-467656734caf-kube-api-access-crjpr\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.036275 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.036231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895bae-2015-41e9-8406-467656734caf-openshift-service-ca\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.036479 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.036325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.036479 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.036356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crjpr\" (UniqueName: \"kubernetes.io/projected/95895bae-2015-41e9-8406-467656734caf-kube-api-access-crjpr\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.036557 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:14:32.036485    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-serving-cert: secret "maas-api-e2e-api-b-5b0fac-serving-cert" not found
Jul 27 19:14:32.036592 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:14:32.036560    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls podName:95895bae-2015-41e9-8406-467656734caf nodeName:}" failed. No retries permitted until 2026-07-27 19:14:32.536538417 +0000 UTC m=+2597.289332827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls") pod "maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq" (UID: "95895bae-2015-41e9-8406-467656734caf") : secret "maas-api-e2e-api-b-5b0fac-serving-cert" not found
Jul 27 19:14:32.036975 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.036952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895bae-2015-41e9-8406-467656734caf-openshift-service-ca\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.057600 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.057564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crjpr\" (UniqueName: \"kubernetes.io/projected/95895bae-2015-41e9-8406-467656734caf-kube-api-access-crjpr\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.426733 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.426687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:32.543112 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.543056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.546905 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.546856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls\") pod \"maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.746714 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.746601    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:32.896426 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.894895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:32.992769 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:32.992512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"]
Jul 27 19:14:33.053120 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.053091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:33.399211 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.399172    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"]
Jul 27 19:14:33.404183 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.404138    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.409875 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.409845    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5b0fac\""
Jul 27 19:14:33.410036 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.410019    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-5b0fac-dockercfg-8prz6\""
Jul 27 19:14:33.422640 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.422605    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"]
Jul 27 19:14:33.451189 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.451147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmhn\" (UniqueName: \"kubernetes.io/projected/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-kube-api-access-6mmhn\") pod \"payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") " pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.451411 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.451221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") " pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.552203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.552159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmhn\" (UniqueName: \"kubernetes.io/projected/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-kube-api-access-6mmhn\") pod \"payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") " pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.552391 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.552233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") " pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.553010 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.552975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") " pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.562101 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.562059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq" event={"ID":"95895bae-2015-41e9-8406-467656734caf","Type":"ContainerStarted","Data":"64286992e6dfff184e20a639f544a9053bd800c1fb16030ab2ff0f135624a866"}
Jul 27 19:14:33.580626 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.580584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmhn\" (UniqueName: \"kubernetes.io/projected/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-kube-api-access-6mmhn\") pod \"payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") " pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.715851 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.715818    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:33.940293 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:33.940261    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"]
Jul 27 19:14:33.942284 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:14:33.942255    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9cc19e7_bbd0_4ecd_87a6_ad6b585ecf16.slice/crio-f74110e4e871e31bb044ac079407f913aa34071f9cd1e4c69e70a13e9ddbc448 WatchSource:0}: Error finding container f74110e4e871e31bb044ac079407f913aa34071f9cd1e4c69e70a13e9ddbc448: Status 404 returned error can't find the container with id f74110e4e871e31bb044ac079407f913aa34071f9cd1e4c69e70a13e9ddbc448
Jul 27 19:14:34.570914 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:34.569835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t" event={"ID":"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16","Type":"ContainerStarted","Data":"ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077"}
Jul 27 19:14:34.570914 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:34.569914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t" event={"ID":"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16","Type":"ContainerStarted","Data":"f74110e4e871e31bb044ac079407f913aa34071f9cd1e4c69e70a13e9ddbc448"}
Jul 27 19:14:34.570914 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:34.570842    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:34.573184 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:34.573151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq" event={"ID":"95895bae-2015-41e9-8406-467656734caf","Type":"ContainerStarted","Data":"418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7"}
Jul 27 19:14:34.574146 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:34.574125    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:34.601960 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:34.601884    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t" podStartSLOduration=1.601858574 podStartE2EDuration="1.601858574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:34.600929824 +0000 UTC m=+2599.353724274" watchObservedRunningTime="2026-07-27 19:14:34.601858574 +0000 UTC m=+2599.354652996"
Jul 27 19:14:34.624391 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:34.624326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq" podStartSLOduration=3.005368281 podStartE2EDuration="3.62430441s" totalImagesPullingTime="618.936129ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:34.621852495 +0000 UTC m=+2599.374646950" watchObservedRunningTime="2026-07-27 19:14:34.62430441 +0000 UTC m=+2599.377098829"
Jul 27 19:14:35.524844 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:35.524800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:14:35.946509 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:35.946475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:38.396113 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.394781    2578 patch_prober.go:28] interesting pod/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:32898->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Jul 27 19:14:38.396113 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.394850    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:32898->10.132.0.53:15021: read: connection reset by peer"
Jul 27 19:14:38.598489 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.598396    2578 generic.go:356] "Generic (PLEG): container finished" podID="d80c68b5-90cb-44dd-baac-307e1b193878" containerID="5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f" exitCode=0
Jul 27 19:14:38.598489 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.598475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" event={"ID":"d80c68b5-90cb-44dd-baac-307e1b193878","Type":"ContainerDied","Data":"5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f"}
Jul 27 19:14:38.599006 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.598984    2578 scope.go:117] "RemoveContainer" containerID="5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f"
Jul 27 19:14:38.600210 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.600176    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:14:38.600330 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.600267    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:14:38.600330 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:38.600318    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:14:39.606234 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:39.606194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" event={"ID":"d80c68b5-90cb-44dd-baac-307e1b193878","Type":"ContainerStarted","Data":"3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8"}
Jul 27 19:14:39.860420 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:39.860311    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:39.860613 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:39.860589    2578 patch_prober.go:28] interesting pod/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 19:14:39.860689 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:39.860654    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 19:14:40.860826 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:40.860780    2578 patch_prober.go:28] interesting pod/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 19:14:40.861263 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:40.860841    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 19:14:41.594763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:41.594714    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:14:41.860446 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:41.860353    2578 patch_prober.go:28] interesting pod/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 19:14:41.860446 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:41.860414    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 19:14:42.860412 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:42.860367    2578 patch_prober.go:28] interesting pod/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 19:14:42.860864 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:42.860432    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 19:14:43.864312 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:43.864282    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:43.864712 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:43.864638    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:43.865624 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:43.865606    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:14:46.590205 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:46.590166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:14:49.868106 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:49.868076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:49.965267 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:14:49.965231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:00.355213 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.355159    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"]
Jul 27 19:15:00.355719 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.355434    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6" podUID="59a13c69-7435-4df6-a244-80f47e26ce30" containerName="maas-api" containerID="cri-o://7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92" gracePeriod=30
Jul 27 19:15:00.387287 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.387248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:00.421935 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.421897    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"]
Jul 27 19:15:00.422143 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.422114    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p" podUID="b4a4831f-289a-4864-b1e1-65101fc16fd7" containerName="payload-pre-processing" containerID="cri-o://cad2abf50ae6a015029e25d4a0b244e4d2e9b7786d2313255254974bdc3ae5ed" gracePeriod=30
Jul 27 19:15:00.488877 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.488845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:00.523226 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.523174    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6" podUID="59a13c69-7435-4df6-a244-80f47e26ce30" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.54:8443/health\": dial tcp 10.132.0.54:8443: connect: connection refused"
Jul 27 19:15:00.590764 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.588710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:00.718228 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.718197    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:15:00.725374 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.725339    2578 generic.go:356] "Generic (PLEG): container finished" podID="59a13c69-7435-4df6-a244-80f47e26ce30" containerID="7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92" exitCode=0
Jul 27 19:15:00.725555 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.725416    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"
Jul 27 19:15:00.725555 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.725424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6" event={"ID":"59a13c69-7435-4df6-a244-80f47e26ce30","Type":"ContainerDied","Data":"7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92"}
Jul 27 19:15:00.725555 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.725485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6" event={"ID":"59a13c69-7435-4df6-a244-80f47e26ce30","Type":"ContainerDied","Data":"0fa55238458e96a1d438b0761db74a0f7bbb77b634799fc6f0460ae2c8c5b63c"}
Jul 27 19:15:00.725690 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.725520    2578 scope.go:117] "RemoveContainer" containerID="7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92"
Jul 27 19:15:00.728017 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.727980    2578 generic.go:356] "Generic (PLEG): container finished" podID="b4a4831f-289a-4864-b1e1-65101fc16fd7" containerID="cad2abf50ae6a015029e25d4a0b244e4d2e9b7786d2313255254974bdc3ae5ed" exitCode=0
Jul 27 19:15:00.728162 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.728144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p" event={"ID":"b4a4831f-289a-4864-b1e1-65101fc16fd7","Type":"ContainerDied","Data":"cad2abf50ae6a015029e25d4a0b244e4d2e9b7786d2313255254974bdc3ae5ed"}
Jul 27 19:15:00.746463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.746418    2578 scope.go:117] "RemoveContainer" containerID="7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92"
Jul 27 19:15:00.746777 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:15:00.746721    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92\": container with ID starting with 7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92 not found: ID does not exist" containerID="7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92"
Jul 27 19:15:00.746863 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.746792    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92"} err="failed to get container status \"7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92\": rpc error: code = NotFound desc = could not find container \"7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92\": container with ID starting with 7a80e9b35425d49618c5995073cf80a24f38dfe0bd7b147c74f2c0750ea78f92 not found: ID does not exist"
Jul 27 19:15:00.749691 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.749665    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:15:00.826638 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.826596    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dw4q\" (UniqueName: \"kubernetes.io/projected/59a13c69-7435-4df6-a244-80f47e26ce30-kube-api-access-9dw4q\") pod \"59a13c69-7435-4df6-a244-80f47e26ce30\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") "
Jul 27 19:15:00.826876 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.826700    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59a13c69-7435-4df6-a244-80f47e26ce30-maas-api-tls\") pod \"59a13c69-7435-4df6-a244-80f47e26ce30\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") "
Jul 27 19:15:00.826876 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.826728    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59a13c69-7435-4df6-a244-80f47e26ce30-openshift-service-ca\") pod \"59a13c69-7435-4df6-a244-80f47e26ce30\" (UID: \"59a13c69-7435-4df6-a244-80f47e26ce30\") "
Jul 27 19:15:00.827160 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.827136    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59a13c69-7435-4df6-a244-80f47e26ce30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59a13c69-7435-4df6-a244-80f47e26ce30" (UID: "59a13c69-7435-4df6-a244-80f47e26ce30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:00.829047 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.829019    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a13c69-7435-4df6-a244-80f47e26ce30-kube-api-access-9dw4q" (OuterVolumeSpecName: "kube-api-access-9dw4q") pod "59a13c69-7435-4df6-a244-80f47e26ce30" (UID: "59a13c69-7435-4df6-a244-80f47e26ce30"). InnerVolumeSpecName "kube-api-access-9dw4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:00.829138 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.829060    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a13c69-7435-4df6-a244-80f47e26ce30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59a13c69-7435-4df6-a244-80f47e26ce30" (UID: "59a13c69-7435-4df6-a244-80f47e26ce30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:15:00.928108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.928007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a4831f-289a-4864-b1e1-65101fc16fd7-plugins-config-volume\") pod \"b4a4831f-289a-4864-b1e1-65101fc16fd7\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") "
Jul 27 19:15:00.928293 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.928130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b9nw\" (UniqueName: \"kubernetes.io/projected/b4a4831f-289a-4864-b1e1-65101fc16fd7-kube-api-access-5b9nw\") pod \"b4a4831f-289a-4864-b1e1-65101fc16fd7\" (UID: \"b4a4831f-289a-4864-b1e1-65101fc16fd7\") "
Jul 27 19:15:00.928368 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.928323    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59a13c69-7435-4df6-a244-80f47e26ce30-maas-api-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:00.928368 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.928336    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59a13c69-7435-4df6-a244-80f47e26ce30-openshift-service-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:00.928368 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.928346    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dw4q\" (UniqueName: \"kubernetes.io/projected/59a13c69-7435-4df6-a244-80f47e26ce30-kube-api-access-9dw4q\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:00.928523 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.928465    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4a4831f-289a-4864-b1e1-65101fc16fd7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b4a4831f-289a-4864-b1e1-65101fc16fd7" (UID: "b4a4831f-289a-4864-b1e1-65101fc16fd7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:00.930563 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:00.930530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a4831f-289a-4864-b1e1-65101fc16fd7-kube-api-access-5b9nw" (OuterVolumeSpecName: "kube-api-access-5b9nw") pod "b4a4831f-289a-4864-b1e1-65101fc16fd7" (UID: "b4a4831f-289a-4864-b1e1-65101fc16fd7"). InnerVolumeSpecName "kube-api-access-5b9nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:01.028892 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.028854    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b9nw\" (UniqueName: \"kubernetes.io/projected/b4a4831f-289a-4864-b1e1-65101fc16fd7-kube-api-access-5b9nw\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:01.028892 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.028890    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a4831f-289a-4864-b1e1-65101fc16fd7-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:01.070192 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.070146    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"]
Jul 27 19:15:01.082498 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.082461    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cad7f7-dcbfbdfc9-bj8j6"]
Jul 27 19:15:01.736003 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.735969    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"
Jul 27 19:15:01.736003 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.735984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p" event={"ID":"b4a4831f-289a-4864-b1e1-65101fc16fd7","Type":"ContainerDied","Data":"0827f5bdd91daeb5064964b12df89f9342410a355523e864103384f4dd427ccb"}
Jul 27 19:15:01.736546 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.736059    2578 scope.go:117] "RemoveContainer" containerID="cad2abf50ae6a015029e25d4a0b244e4d2e9b7786d2313255254974bdc3ae5ed"
Jul 27 19:15:01.767292 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.767252    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"]
Jul 27 19:15:01.773841 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.773803    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-cad7f7-6669bfcfbd-td94p"]
Jul 27 19:15:01.847251 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.847204    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a13c69-7435-4df6-a244-80f47e26ce30" path="/var/lib/kubelet/pods/59a13c69-7435-4df6-a244-80f47e26ce30/volumes"
Jul 27 19:15:01.847680 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:01.847658    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4a4831f-289a-4864-b1e1-65101fc16fd7" path="/var/lib/kubelet/pods/b4a4831f-289a-4864-b1e1-65101fc16fd7/volumes"
Jul 27 19:15:04.690431 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:04.690392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:05.090426 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:05.090322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:11.238991 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:11.238950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:11.338708 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:11.338661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:11.484703 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:11.484658    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"]
Jul 27 19:15:11.484982 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:11.484954    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy" containerID="cri-o://3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8" gracePeriod=30
Jul 27 19:15:11.552376 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:11.552290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:11.743464 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:11.743428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:13.867963 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:13.867925    2578 patch_prober.go:28] interesting pod/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:15:13.868365 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:13.867983    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:15:16.747426 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.747345    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:15:16.763147 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-data\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763147 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763150    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d80c68b5-90cb-44dd-baac-307e1b193878-istio-podinfo\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763186    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d80c68b5-90cb-44dd-baac-307e1b193878-istiod-ca-cert\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763230    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-socket\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763274    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-certs\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763341    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rswpk\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-kube-api-access-rswpk\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763512 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-credential-socket\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763512 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763406    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-envoy\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763512 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-istio-token\") pod \"d80c68b5-90cb-44dd-baac-307e1b193878\" (UID: \"d80c68b5-90cb-44dd-baac-307e1b193878\") "
Jul 27 19:15:16.763686 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d80c68b5-90cb-44dd-baac-307e1b193878-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:16.763857 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763789    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:16.763857 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763806    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:16.764018 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.763942    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:16.764545 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.764469    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-data" (OuterVolumeSpecName: "istio-data") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:16.765992 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.765955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d80c68b5-90cb-44dd-baac-307e1b193878-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:15:16.766121 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.766057    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:15:16.766601 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.766578    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-istio-token" (OuterVolumeSpecName: "istio-token") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:16.766669 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.766611    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-kube-api-access-rswpk" (OuterVolumeSpecName: "kube-api-access-rswpk") pod "d80c68b5-90cb-44dd-baac-307e1b193878" (UID: "d80c68b5-90cb-44dd-baac-307e1b193878"). InnerVolumeSpecName "kube-api-access-rswpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:16.816507 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.816473    2578 generic.go:356] "Generic (PLEG): container finished" podID="d80c68b5-90cb-44dd-baac-307e1b193878" containerID="3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8" exitCode=0
Jul 27 19:15:16.816691 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.816524    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"
Jul 27 19:15:16.816691 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.816557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" event={"ID":"d80c68b5-90cb-44dd-baac-307e1b193878","Type":"ContainerDied","Data":"3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8"}
Jul 27 19:15:16.816691 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.816621    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q" event={"ID":"d80c68b5-90cb-44dd-baac-307e1b193878","Type":"ContainerDied","Data":"574185415ceb1b52cf8c0069302f87d936916f03e64c2cb8a0bb0887b43f2652"}
Jul 27 19:15:16.816691 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.816648    2578 scope.go:117] "RemoveContainer" containerID="3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8"
Jul 27 19:15:16.826522 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.826497    2578 scope.go:117] "RemoveContainer" containerID="5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f"
Jul 27 19:15:16.835942 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.835905    2578 scope.go:117] "RemoveContainer" containerID="3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8"
Jul 27 19:15:16.836325 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:15:16.836294    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8\": container with ID starting with 3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8 not found: ID does not exist" containerID="3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8"
Jul 27 19:15:16.836586 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.836341    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8"} err="failed to get container status \"3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8\": rpc error: code = NotFound desc = could not find container \"3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8\": container with ID starting with 3b40b035d9d0523fd2266c967321c65906e51aa27c8a944fc488d19764d903f8 not found: ID does not exist"
Jul 27 19:15:16.836586 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.836370    2578 scope.go:117] "RemoveContainer" containerID="5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f"
Jul 27 19:15:16.836901 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:15:16.836875    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f\": container with ID starting with 5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f not found: ID does not exist" containerID="5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f"
Jul 27 19:15:16.837124 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.837086    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f"} err="failed to get container status \"5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f\": rpc error: code = NotFound desc = could not find container \"5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f\": container with ID starting with 5fb7f8eb3a03682875b730882f30ef1f52ef20afe79e22743be0358ad3c5063f not found: ID does not exist"
Jul 27 19:15:16.839360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.839332    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"]
Jul 27 19:15:16.844064 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.844032    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-cad7f7-openshift-default-6544df8668-97s4q"]
Jul 27 19:15:16.864588 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864559    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864588 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864586    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d80c68b5-90cb-44dd-baac-307e1b193878-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864596    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d80c68b5-90cb-44dd-baac-307e1b193878-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864609    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864617    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864626    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rswpk\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-kube-api-access-rswpk\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864638    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864646    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d80c68b5-90cb-44dd-baac-307e1b193878-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:16.864781 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:16.864655    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d80c68b5-90cb-44dd-baac-307e1b193878-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:17.846225 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:17.846190    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" path="/var/lib/kubelet/pods/d80c68b5-90cb-44dd-baac-307e1b193878/volumes"
Jul 27 19:15:27.521381 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.521336    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"]
Jul 27 19:15:27.521973 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.521580    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq" podUID="95895bae-2015-41e9-8406-467656734caf" containerName="maas-api" containerID="cri-o://418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7" gracePeriod=30
Jul 27 19:15:27.556797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.556733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:27.577049 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.576970    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"]
Jul 27 19:15:27.577712 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.577366    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t" podUID="c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" containerName="payload-processing" containerID="cri-o://ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077" gracePeriod=30
Jul 27 19:15:27.834763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.834714    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:15:27.871002 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.870971    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:15:27.873223 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.873190    2578 generic.go:356] "Generic (PLEG): container finished" podID="c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" containerID="ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077" exitCode=0
Jul 27 19:15:27.873411 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.873242    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"
Jul 27 19:15:27.873411 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.873269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t" event={"ID":"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16","Type":"ContainerDied","Data":"ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077"}
Jul 27 19:15:27.873411 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.873338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t" event={"ID":"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16","Type":"ContainerDied","Data":"f74110e4e871e31bb044ac079407f913aa34071f9cd1e4c69e70a13e9ddbc448"}
Jul 27 19:15:27.873411 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.873371    2578 scope.go:117] "RemoveContainer" containerID="ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077"
Jul 27 19:15:27.874847 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.874808    2578 generic.go:356] "Generic (PLEG): container finished" podID="95895bae-2015-41e9-8406-467656734caf" containerID="418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7" exitCode=0
Jul 27 19:15:27.874976 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.874861    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"
Jul 27 19:15:27.874976 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.874891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq" event={"ID":"95895bae-2015-41e9-8406-467656734caf","Type":"ContainerDied","Data":"418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7"}
Jul 27 19:15:27.874976 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.874947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq" event={"ID":"95895bae-2015-41e9-8406-467656734caf","Type":"ContainerDied","Data":"64286992e6dfff184e20a639f544a9053bd800c1fb16030ab2ff0f135624a866"}
Jul 27 19:15:27.883431 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.883403    2578 scope.go:117] "RemoveContainer" containerID="ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077"
Jul 27 19:15:27.883814 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:15:27.883788    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077\": container with ID starting with ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077 not found: ID does not exist" containerID="ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077"
Jul 27 19:15:27.883929 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.883822    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077"} err="failed to get container status \"ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077\": rpc error: code = NotFound desc = could not find container \"ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077\": container with ID starting with ecb0533e3f1a037b7917a06def02d7c08d50eb20a96a77600bd3f7bf3e225077 not found: ID does not exist"
Jul 27 19:15:27.883929 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.883848    2578 scope.go:117] "RemoveContainer" containerID="418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7"
Jul 27 19:15:27.894549 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.894520    2578 scope.go:117] "RemoveContainer" containerID="418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7"
Jul 27 19:15:27.895069 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:15:27.895035    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7\": container with ID starting with 418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7 not found: ID does not exist" containerID="418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7"
Jul 27 19:15:27.895193 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.895081    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7"} err="failed to get container status \"418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7\": rpc error: code = NotFound desc = could not find container \"418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7\": container with ID starting with 418fcf6d00b86fe08bec4e92247a159591e2991e60aacaba9bd49a096a5f31c7 not found: ID does not exist"
Jul 27 19:15:27.971802 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.971726    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crjpr\" (UniqueName: \"kubernetes.io/projected/95895bae-2015-41e9-8406-467656734caf-kube-api-access-crjpr\") pod \"95895bae-2015-41e9-8406-467656734caf\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") "
Jul 27 19:15:27.972032 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.971848    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mmhn\" (UniqueName: \"kubernetes.io/projected/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-kube-api-access-6mmhn\") pod \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") "
Jul 27 19:15:27.972032 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.971925    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-plugins-config-volume\") pod \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\" (UID: \"c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16\") "
Jul 27 19:15:27.972032 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.971983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895bae-2015-41e9-8406-467656734caf-openshift-service-ca\") pod \"95895bae-2015-41e9-8406-467656734caf\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") "
Jul 27 19:15:27.972209 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.972034    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls\") pod \"95895bae-2015-41e9-8406-467656734caf\" (UID: \"95895bae-2015-41e9-8406-467656734caf\") "
Jul 27 19:15:27.972396 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.972364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95895bae-2015-41e9-8406-467656734caf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95895bae-2015-41e9-8406-467656734caf" (UID: "95895bae-2015-41e9-8406-467656734caf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:27.972396 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.972382    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" (UID: "c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:15:27.974213 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.974181    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95895bae-2015-41e9-8406-467656734caf-kube-api-access-crjpr" (OuterVolumeSpecName: "kube-api-access-crjpr") pod "95895bae-2015-41e9-8406-467656734caf" (UID: "95895bae-2015-41e9-8406-467656734caf"). InnerVolumeSpecName "kube-api-access-crjpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:27.974213 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.974208    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-kube-api-access-6mmhn" (OuterVolumeSpecName: "kube-api-access-6mmhn") pod "c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" (UID: "c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16"). InnerVolumeSpecName "kube-api-access-6mmhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:15:27.974361 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:27.974227    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95895bae-2015-41e9-8406-467656734caf" (UID: "95895bae-2015-41e9-8406-467656734caf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:15:28.073287 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.073181    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895bae-2015-41e9-8406-467656734caf-maas-api-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:28.073287 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.073216    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crjpr\" (UniqueName: \"kubernetes.io/projected/95895bae-2015-41e9-8406-467656734caf-kube-api-access-crjpr\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:28.073287 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.073231    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mmhn\" (UniqueName: \"kubernetes.io/projected/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-kube-api-access-6mmhn\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:28.073287 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.073244    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:28.073287 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.073256    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895bae-2015-41e9-8406-467656734caf-openshift-service-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:15:28.202942 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.202890    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"]
Jul 27 19:15:28.208900 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.208847    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5b0fac-7d96d7d7f5-v9xbq"]
Jul 27 19:15:28.219268 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.219230    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"]
Jul 27 19:15:28.221223 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.221189    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5b0fac-578bbf5888-c2p8t"]
Jul 27 19:15:28.873266 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:28.873169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:29.846567 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:29.846525    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95895bae-2015-41e9-8406-467656734caf" path="/var/lib/kubelet/pods/95895bae-2015-41e9-8406-467656734caf/volumes"
Jul 27 19:15:29.846941 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:29.846925    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" path="/var/lib/kubelet/pods/c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16/volumes"
Jul 27 19:15:31.961177 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:31.961132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:32.333609 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:32.333498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:38.426642 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:38.426593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:38.527114 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:38.527056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:38.693469 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:38.693379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:38.911346 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:38.911312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:39.288004 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.287967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:39.562390 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562278    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"]
Jul 27 19:15:39.562893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562869    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a4831f-289a-4864-b1e1-65101fc16fd7" containerName="payload-pre-processing"
Jul 27 19:15:39.562893 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562891    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a4831f-289a-4864-b1e1-65101fc16fd7" containerName="payload-pre-processing"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562909    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562917    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562929    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a13c69-7435-4df6-a244-80f47e26ce30" containerName="maas-api"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562938    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a13c69-7435-4df6-a244-80f47e26ce30" containerName="maas-api"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562953    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562961    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562984    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95895bae-2015-41e9-8406-467656734caf" containerName="maas-api"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.562994    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95895bae-2015-41e9-8406-467656734caf" containerName="maas-api"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563013    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" containerName="payload-processing"
Jul 27 19:15:39.563027 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563022    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" containerName="payload-processing"
Jul 27 19:15:39.563491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563109    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy"
Jul 27 19:15:39.563491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563124    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80c68b5-90cb-44dd-baac-307e1b193878" containerName="istio-proxy"
Jul 27 19:15:39.563491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563133    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a4831f-289a-4864-b1e1-65101fc16fd7" containerName="payload-pre-processing"
Jul 27 19:15:39.563491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563143    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59a13c69-7435-4df6-a244-80f47e26ce30" containerName="maas-api"
Jul 27 19:15:39.563491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563152    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="95895bae-2015-41e9-8406-467656734caf" containerName="maas-api"
Jul 27 19:15:39.563491 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.563162    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cc19e7-bbd0-4ecd-87a6-ad6b585ecf16" containerName="payload-processing"
Jul 27 19:15:39.566323 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.566300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.569350 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.569325    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-de344b-openshift-default-dockercfg-9qpjk\""
Jul 27 19:15:39.581912 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.581874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"]
Jul 27 19:15:39.591985 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.591937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:39.689941 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.689896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-certs\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690148 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.689945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-data\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690148 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.689986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-envoy\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690148 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.690031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-podinfo\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690148 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.690080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-credential-socket\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690148 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.690134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-token\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.690204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d4qc\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-kube-api-access-6d4qc\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.690244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-socket\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.690360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.690263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efe03eae-31ed-4bdd-b368-8fb10192616b-istiod-ca-cert\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791098 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-credential-socket\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791300 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-token\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791300 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4qc\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-kube-api-access-6d4qc\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791300 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-socket\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791300 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efe03eae-31ed-4bdd-b368-8fb10192616b-istiod-ca-cert\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791300 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-certs\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791300 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-data\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791619 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-envoy\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791619 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-podinfo\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791619 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-socket\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791619 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-certs\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791815 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-data\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.791815 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.791809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-credential-socket\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.792072 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.792055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efe03eae-31ed-4bdd-b368-8fb10192616b-istiod-ca-cert\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.793905 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.793867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-envoy\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.794024 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.794013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-podinfo\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.802598 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.802567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-token\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.802783 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.802759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d4qc\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-kube-api-access-6d4qc\") pod \"e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") " pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:39.877603 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:39.877499    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:40.050685 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.050644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:40.079198 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.079162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"]
Jul 27 19:15:40.083231 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:15:40.083187    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe03eae_31ed_4bdd_b368_8fb10192616b.slice/crio-6030f431ee254c453ef2e0543e26b41f6bab4d76f39014053c4ee4ebab26d1b2 WatchSource:0}: Error finding container 6030f431ee254c453ef2e0543e26b41f6bab4d76f39014053c4ee4ebab26d1b2: Status 404 returned error can't find the container with id 6030f431ee254c453ef2e0543e26b41f6bab4d76f39014053c4ee4ebab26d1b2
Jul 27 19:15:40.085457 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.085418    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:15:40.085530 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.085493    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:15:40.085571 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.085529    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:15:40.953908 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.953871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" event={"ID":"efe03eae-31ed-4bdd-b368-8fb10192616b","Type":"ContainerStarted","Data":"cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca"}
Jul 27 19:15:40.954318 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.953931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" event={"ID":"efe03eae-31ed-4bdd-b368-8fb10192616b","Type":"ContainerStarted","Data":"6030f431ee254c453ef2e0543e26b41f6bab4d76f39014053c4ee4ebab26d1b2"}
Jul 27 19:15:40.985259 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:40.985198    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" podStartSLOduration=1.985175736 podStartE2EDuration="1.985175736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:40.982685423 +0000 UTC m=+2665.735479845" watchObservedRunningTime="2026-07-27 19:15:40.985175736 +0000 UTC m=+2665.737970156"
Jul 27 19:15:41.878025 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:41.877981    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:41.884163 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:41.884110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:41.959413 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:41.959373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:41.960630 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:41.960612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:15:42.896709 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:42.896651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:42.989408 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:42.989372    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"]
Jul 27 19:15:42.991656 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:42.991590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:42.993499 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:42.993473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:42.996450 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:42.996426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-de344b-serving-cert\""
Jul 27 19:15:43.010216 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.010187    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"]
Jul 27 19:15:43.081599 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.081563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:43.127926 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.127856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.127926 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.127950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d068a63e-d7c1-45f0-bf00-d261479485b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.128202 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.127977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jc92\" (UniqueName: \"kubernetes.io/projected/d068a63e-d7c1-45f0-bf00-d261479485b7-kube-api-access-2jc92\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.229386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.229268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.229386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.229327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d068a63e-d7c1-45f0-bf00-d261479485b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.229386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.229355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jc92\" (UniqueName: \"kubernetes.io/projected/d068a63e-d7c1-45f0-bf00-d261479485b7-kube-api-access-2jc92\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.229685 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:15:43.229417    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-serving-cert: secret "maas-api-e2e-shared-a-de344b-serving-cert" not found
Jul 27 19:15:43.229685 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:15:43.229478    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls podName:d068a63e-d7c1-45f0-bf00-d261479485b7 nodeName:}" failed. No retries permitted until 2026-07-27 19:15:43.729460842 +0000 UTC m=+2668.482255240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls") pod "maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds" (UID: "d068a63e-d7c1-45f0-bf00-d261479485b7") : secret "maas-api-e2e-shared-a-de344b-serving-cert" not found
Jul 27 19:15:43.230078 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.230059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d068a63e-d7c1-45f0-bf00-d261479485b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.241402 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.241364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jc92\" (UniqueName: \"kubernetes.io/projected/d068a63e-d7c1-45f0-bf00-d261479485b7-kube-api-access-2jc92\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.337231 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.337196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:43.620303 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.620207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:43.717993 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.717958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:43.728648 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.728605    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"]
Jul 27 19:15:43.732351 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.732323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:43.734449 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.734414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.735108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.735082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-de344b\""
Jul 27 19:15:43.737159 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.737126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.748762 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.748705    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"]
Jul 27 19:15:43.768188 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.768148    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"]
Jul 27 19:15:43.772345 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.772315    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:43.775175 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.775146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-de344b-dockercfg-55zfb\""
Jul 27 19:15:43.782864 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.782834    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"]
Jul 27 19:15:43.835328 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.835235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84znc\" (UniqueName: \"kubernetes.io/projected/52dedd26-cff4-4c26-af6e-b64ccbd4b039-kube-api-access-84znc\") pod \"payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:43.835553 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.835425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52dedd26-cff4-4c26-af6e-b64ccbd4b039-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:43.904459 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.904417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:43.937059 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.937022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84znc\" (UniqueName: \"kubernetes.io/projected/52dedd26-cff4-4c26-af6e-b64ccbd4b039-kube-api-access-84znc\") pod \"payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:43.937258 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.937128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52dedd26-cff4-4c26-af6e-b64ccbd4b039-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:43.937258 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.937178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec1a243f-1a7b-4e92-ae2a-21c495954a38-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") " pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:43.937258 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.937251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxf65\" (UniqueName: \"kubernetes.io/projected/ec1a243f-1a7b-4e92-ae2a-21c495954a38-kube-api-access-pxf65\") pod \"payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") " pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:43.937963 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.937935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52dedd26-cff4-4c26-af6e-b64ccbd4b039-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:43.945517 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:43.945481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84znc\" (UniqueName: \"kubernetes.io/projected/52dedd26-cff4-4c26-af6e-b64ccbd4b039-kube-api-access-84znc\") pod \"payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:44.038778 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.038702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec1a243f-1a7b-4e92-ae2a-21c495954a38-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") " pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:44.039277 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.038825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxf65\" (UniqueName: \"kubernetes.io/projected/ec1a243f-1a7b-4e92-ae2a-21c495954a38-kube-api-access-pxf65\") pod \"payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") " pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:44.039635 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.039610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec1a243f-1a7b-4e92-ae2a-21c495954a38-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") " pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:44.049103 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.049069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxf65\" (UniqueName: \"kubernetes.io/projected/ec1a243f-1a7b-4e92-ae2a-21c495954a38-kube-api-access-pxf65\") pod \"payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") " pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:44.065689 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.065644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:44.071676 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.071645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"]
Jul 27 19:15:44.078911 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:15:44.078855    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd068a63e_d7c1_45f0_bf00_d261479485b7.slice/crio-c689b00bd99251ed180d7a02d408f2bf2fc5a56e9ee7d8b608edb851dd385f9b WatchSource:0}: Error finding container c689b00bd99251ed180d7a02d408f2bf2fc5a56e9ee7d8b608edb851dd385f9b: Status 404 returned error can't find the container with id c689b00bd99251ed180d7a02d408f2bf2fc5a56e9ee7d8b608edb851dd385f9b
Jul 27 19:15:44.085087 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.085059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:44.245104 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.245061    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"]
Jul 27 19:15:44.247458 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:15:44.247418    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52dedd26_cff4_4c26_af6e_b64ccbd4b039.slice/crio-afe706a973963621964b8fcf130462c46b705b356b09838156f6160a39a2bd92 WatchSource:0}: Error finding container afe706a973963621964b8fcf130462c46b705b356b09838156f6160a39a2bd92: Status 404 returned error can't find the container with id afe706a973963621964b8fcf130462c46b705b356b09838156f6160a39a2bd92
Jul 27 19:15:44.265039 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.265009    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"]
Jul 27 19:15:44.267022 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:15:44.266991    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1a243f_1a7b_4e92_ae2a_21c495954a38.slice/crio-852aadd42485bae21bfe07f652133c868725f1c4371ef2c5976ee92cfa91a04b WatchSource:0}: Error finding container 852aadd42485bae21bfe07f652133c868725f1c4371ef2c5976ee92cfa91a04b: Status 404 returned error can't find the container with id 852aadd42485bae21bfe07f652133c868725f1c4371ef2c5976ee92cfa91a04b
Jul 27 19:15:44.981699 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.981595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk" event={"ID":"ec1a243f-1a7b-4e92-ae2a-21c495954a38","Type":"ContainerStarted","Data":"e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455"}
Jul 27 19:15:44.981699 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.981662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk" event={"ID":"ec1a243f-1a7b-4e92-ae2a-21c495954a38","Type":"ContainerStarted","Data":"852aadd42485bae21bfe07f652133c868725f1c4371ef2c5976ee92cfa91a04b"}
Jul 27 19:15:44.981968 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.981923    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:44.984028 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.983990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8" event={"ID":"52dedd26-cff4-4c26-af6e-b64ccbd4b039","Type":"ContainerStarted","Data":"682994c2fb4499ac4b39c2719d56ec2bc9b1f3aba2a993cf3771f3ba99b9076d"}
Jul 27 19:15:44.984200 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.984054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8" event={"ID":"52dedd26-cff4-4c26-af6e-b64ccbd4b039","Type":"ContainerStarted","Data":"afe706a973963621964b8fcf130462c46b705b356b09838156f6160a39a2bd92"}
Jul 27 19:15:44.984200 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.984109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:44.985847 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.985809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds" event={"ID":"d068a63e-d7c1-45f0-bf00-d261479485b7","Type":"ContainerStarted","Data":"90edd10adf039c8bb18565e59a91ef7f9de6027f0b869a1d0f962124572183c9"}
Jul 27 19:15:44.985953 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.985854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds" event={"ID":"d068a63e-d7c1-45f0-bf00-d261479485b7","Type":"ContainerStarted","Data":"c689b00bd99251ed180d7a02d408f2bf2fc5a56e9ee7d8b608edb851dd385f9b"}
Jul 27 19:15:44.986005 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:44.985991    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:45.006312 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:45.006239    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk" podStartSLOduration=2.006211616 podStartE2EDuration="2.006211616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:45.003597562 +0000 UTC m=+2669.756391983" watchObservedRunningTime="2026-07-27 19:15:45.006211616 +0000 UTC m=+2669.759006019"
Jul 27 19:15:45.023947 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:45.023865    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8" podStartSLOduration=2.023844037 podStartE2EDuration="2.023844037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:45.021797002 +0000 UTC m=+2669.774591431" watchObservedRunningTime="2026-07-27 19:15:45.023844037 +0000 UTC m=+2669.776638457"
Jul 27 19:15:47.376366 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:47.376329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:47.682325 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:47.682292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:48.013182 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:48.013080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:48.773211 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:48.773172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:50.696204 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:50.696172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:50.797770 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:50.797709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:50.956996 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:50.956905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:50.997225 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:50.997193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:15:51.016085 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.016032    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds" podStartSLOduration=8.389863562 podStartE2EDuration="9.016014137s" totalImagesPullingTime="626.150575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:45.049382339 +0000 UTC m=+2669.802176817" watchObservedRunningTime="2026-07-27 19:15:51.016014137 +0000 UTC m=+2675.768808557"
Jul 27 19:15:51.126394 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.126359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:51.505041 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.505008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:51.605228 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.605179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:51.631538 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.631503    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"]
Jul 27 19:15:51.635601 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.635578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:51.638371 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.638345    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-ab99e9\""
Jul 27 19:15:51.638776 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.638757    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-ab99e9-dockercfg-zkqr4\""
Jul 27 19:15:51.652417 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.652386    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"]
Jul 27 19:15:51.708462 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.708416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6bct\" (UniqueName: \"kubernetes.io/projected/647f9fed-7fd4-458e-b5b4-66448332caf3-kube-api-access-z6bct\") pod \"payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:51.709158 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.708470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647f9fed-7fd4-458e-b5b4-66448332caf3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:51.810138 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.810022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6bct\" (UniqueName: \"kubernetes.io/projected/647f9fed-7fd4-458e-b5b4-66448332caf3-kube-api-access-z6bct\") pod \"payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:51.810138 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.810064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647f9fed-7fd4-458e-b5b4-66448332caf3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:51.810865 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.810842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647f9fed-7fd4-458e-b5b4-66448332caf3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:51.819854 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.819815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6bct\" (UniqueName: \"kubernetes.io/projected/647f9fed-7fd4-458e-b5b4-66448332caf3-kube-api-access-z6bct\") pod \"payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:51.948831 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:51.948794    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:52.147509 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:52.147484    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"]
Jul 27 19:15:52.150144 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:15:52.150104    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647f9fed_7fd4_458e_b5b4_66448332caf3.slice/crio-2a295f3c4376eb5fcfa8d1ec407eb9ce685a26626bf5acbced6b6734ac870a00 WatchSource:0}: Error finding container 2a295f3c4376eb5fcfa8d1ec407eb9ce685a26626bf5acbced6b6734ac870a00: Status 404 returned error can't find the container with id 2a295f3c4376eb5fcfa8d1ec407eb9ce685a26626bf5acbced6b6734ac870a00
Jul 27 19:15:53.030226 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:53.030194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5" event={"ID":"647f9fed-7fd4-458e-b5b4-66448332caf3","Type":"ContainerStarted","Data":"3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad"}
Jul 27 19:15:53.030679 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:53.030251    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5" event={"ID":"647f9fed-7fd4-458e-b5b4-66448332caf3","Type":"ContainerStarted","Data":"2a295f3c4376eb5fcfa8d1ec407eb9ce685a26626bf5acbced6b6734ac870a00"}
Jul 27 19:15:53.030679 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:53.030280    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:15:53.050777 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:53.050711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5" podStartSLOduration=2.050697998 podStartE2EDuration="2.050697998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:53.048288381 +0000 UTC m=+2677.801082817" watchObservedRunningTime="2026-07-27 19:15:53.050697998 +0000 UTC m=+2677.803492450"
Jul 27 19:15:55.196221 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:55.196187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:55.992910 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:55.992877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:15:55.993106 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:55.993067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:15:58.000952 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:58.000907    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 19:15:58.001358 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:58.000988    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:15:59.065204 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:59.065120    2578 generic.go:356] "Generic (PLEG): container finished" podID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerID="cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca" exitCode=0
Jul 27 19:15:59.065204 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:59.065164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" event={"ID":"efe03eae-31ed-4bdd-b368-8fb10192616b","Type":"ContainerDied","Data":"cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca"}
Jul 27 19:15:59.065663 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:59.065543    2578 scope.go:117] "RemoveContainer" containerID="cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca"
Jul 27 19:15:59.066610 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:59.066578    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:15:59.066712 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:59.066665    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:15:59.066803 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:15:59.066717    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:16:00.074655 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:00.074609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" event={"ID":"efe03eae-31ed-4bdd-b368-8fb10192616b","Type":"ContainerStarted","Data":"aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47"}
Jul 27 19:16:00.878161 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:00.878112    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:16:00.878401 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:00.878256    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 19:16:00.878401 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:00.878306    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 19:16:01.878970 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:01.878919    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 19:16:01.879484 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:01.879016    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 19:16:02.878470 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:02.878416    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 19:16:02.878708 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:02.878505    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 19:16:03.879020 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:03.878981    2578 patch_prober.go:28] interesting pod/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 19:16:03.879615 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:03.879584    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 19:16:04.038397 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:04.038366    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:16:04.881585 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:04.881555    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:16:04.882018 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:04.881847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:16:04.882736 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:04.882712    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:16:11.218613 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:11.218515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:38.126582 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:38.126545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:38.646376 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:16:38.646344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:33.505890 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:17:33.505853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:33.573394 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:17:33.573355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:38.085091 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:17:38.085001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:47.305107 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:17:47.305069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:53.548200 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:17:53.548168    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:18:30.099890 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:18:30.099845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:21.776731 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:21:21.776669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:24.088815 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:21:24.088779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:48.559470 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:21:48.559428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:11.573803 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:22:11.573668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:51.722413 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:22:51.722359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:51.824454 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:22:51.824419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:12.312608 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:23:12.312570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:13.314278 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:23:13.314240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:23:23.050501 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:23:23.050465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:02.828722 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:24:02.828588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:49.591477 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:24:49.591440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:25.034342 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:25.034256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:26.004835 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:26.004795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:45.599179 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:45.599135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:46.462850 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:46.462814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:46.758918 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:46.758819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:52.964398 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:52.964357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:53.082320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.082277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:53.174862 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.174825    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"]
Jul 27 19:25:53.178654 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.178631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.181497 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.181448    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-d4857a-serving-cert\""
Jul 27 19:25:53.183940 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.183899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:53.199759 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.199703    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"]
Jul 27 19:25:53.266763 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.266652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c02c11-17b4-4081-81dc-33504272dfd3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.266932 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.266734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgthm\" (UniqueName: \"kubernetes.io/projected/28c02c11-17b4-4081-81dc-33504272dfd3-kube-api-access-kgthm\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.266932 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.266865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.368416 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.368375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.368596 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.368455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c02c11-17b4-4081-81dc-33504272dfd3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.368596 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.368511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgthm\" (UniqueName: \"kubernetes.io/projected/28c02c11-17b4-4081-81dc-33504272dfd3-kube-api-access-kgthm\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.368596 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:25:53.368527    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-serving-cert: secret "maas-api-e2e-ipp-a-d4857a-serving-cert" not found
Jul 27 19:25:53.368706 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:25:53.368608    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls podName:28c02c11-17b4-4081-81dc-33504272dfd3 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:53.868589293 +0000 UTC m=+3278.621383694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls") pod "maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6" (UID: "28c02c11-17b4-4081-81dc-33504272dfd3") : secret "maas-api-e2e-ipp-a-d4857a-serving-cert" not found
Jul 27 19:25:53.369146 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.369128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c02c11-17b4-4081-81dc-33504272dfd3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.384452 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.384423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgthm\" (UniqueName: \"kubernetes.io/projected/28c02c11-17b4-4081-81dc-33504272dfd3-kube-api-access-kgthm\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.475079 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.475022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:53.678268 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.678234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:53.779392 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.779330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:25:53.786992 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.786958    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"]
Jul 27 19:25:53.790916 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.790891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:53.793932 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.793911    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d4857a\""
Jul 27 19:25:53.801360 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.801335    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"]
Jul 27 19:25:53.873667 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.873628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.873885 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.873689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwk7\" (UniqueName: \"kubernetes.io/projected/27ee3e60-465b-48e1-b9ab-335d431597a0-kube-api-access-6xwk7\") pod \"payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:53.873885 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.873854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27ee3e60-465b-48e1-b9ab-335d431597a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:53.876669 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.876644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:53.974692 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.974596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwk7\" (UniqueName: \"kubernetes.io/projected/27ee3e60-465b-48e1-b9ab-335d431597a0-kube-api-access-6xwk7\") pod \"payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:53.974692 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.974682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27ee3e60-465b-48e1-b9ab-335d431597a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:53.975371 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.975350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27ee3e60-465b-48e1-b9ab-335d431597a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:53.984263 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:53.984236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwk7\" (UniqueName: \"kubernetes.io/projected/27ee3e60-465b-48e1-b9ab-335d431597a0-kube-api-access-6xwk7\") pod \"payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:54.091865 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:54.091821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:54.103564 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:54.103524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:54.261518 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:54.261433    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"]
Jul 27 19:25:54.262731 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:25:54.262702    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c02c11_17b4_4081_81dc_33504272dfd3.slice/crio-77583c608f5923be6920e5afe29410e4b2696bbcd62a0b44d7731695db7ba3cb WatchSource:0}: Error finding container 77583c608f5923be6920e5afe29410e4b2696bbcd62a0b44d7731695db7ba3cb: Status 404 returned error can't find the container with id 77583c608f5923be6920e5afe29410e4b2696bbcd62a0b44d7731695db7ba3cb
Jul 27 19:25:54.264485 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:54.264466    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:25:54.495659 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:54.495634    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"]
Jul 27 19:25:54.497642 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:25:54.497596    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ee3e60_465b_48e1_b9ab_335d431597a0.slice/crio-873335434f2f30396d59b1a07cb9d0579e09d0e66f57ecf5173c38a4a3f08bc9 WatchSource:0}: Error finding container 873335434f2f30396d59b1a07cb9d0579e09d0e66f57ecf5173c38a4a3f08bc9: Status 404 returned error can't find the container with id 873335434f2f30396d59b1a07cb9d0579e09d0e66f57ecf5173c38a4a3f08bc9
Jul 27 19:25:55.136116 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.136081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6" event={"ID":"28c02c11-17b4-4081-81dc-33504272dfd3","Type":"ContainerStarted","Data":"6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84"}
Jul 27 19:25:55.136608 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.136145    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:25:55.136608 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.136168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6" event={"ID":"28c02c11-17b4-4081-81dc-33504272dfd3","Type":"ContainerStarted","Data":"77583c608f5923be6920e5afe29410e4b2696bbcd62a0b44d7731695db7ba3cb"}
Jul 27 19:25:55.137707 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.137682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb" event={"ID":"27ee3e60-465b-48e1-b9ab-335d431597a0","Type":"ContainerStarted","Data":"dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf"}
Jul 27 19:25:55.137834 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.137729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb" event={"ID":"27ee3e60-465b-48e1-b9ab-335d431597a0","Type":"ContainerStarted","Data":"873335434f2f30396d59b1a07cb9d0579e09d0e66f57ecf5173c38a4a3f08bc9"}
Jul 27 19:25:55.137834 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.137767    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:25:55.157578 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.157521    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6" podStartSLOduration=1.8237734030000001 podStartE2EDuration="2.157504784s" totalImagesPullingTime="333.731381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:55.15380441 +0000 UTC m=+3279.906598848" watchObservedRunningTime="2026-07-27 19:25:55.157504784 +0000 UTC m=+3279.910299203"
Jul 27 19:25:55.177834 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:55.177780    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb" podStartSLOduration=2.1777596790000002 podStartE2EDuration="2.177759679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:55.176282007 +0000 UTC m=+3279.929076428" watchObservedRunningTime="2026-07-27 19:25:55.177759679 +0000 UTC m=+3279.930554093"
Jul 27 19:25:57.469374 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:25:57.469336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:01.149275 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:01.149245    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:26:06.145727 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:06.145691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:26:06.645477 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:06.645444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:08.395428 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:08.395395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:08.748212 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:08.748134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:08.929247 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:08.929219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:11.985118 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:11.985074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:12.120212 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:12.120179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:12.214139 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:12.214109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:12.435271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:12.435236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:12.872811 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:12.872724    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:12.979515 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:12.979481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:13.192775 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.192726    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"]
Jul 27 19:26:13.196687 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.196667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.202482 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.202448    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-2d7b97-dockercfg-xpkkw\""
Jul 27 19:26:13.202957 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.202941    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-2d7b97\""
Jul 27 19:26:13.215162 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.215138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"]
Jul 27 19:26:13.374095 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.374064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27aea398-2c8e-4327-8959-1e303892b2e2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.374266 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.374143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmt5n\" (UniqueName: \"kubernetes.io/projected/27aea398-2c8e-4327-8959-1e303892b2e2-kube-api-access-tmt5n\") pod \"payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.475698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.475608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27aea398-2c8e-4327-8959-1e303892b2e2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.475698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.475680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmt5n\" (UniqueName: \"kubernetes.io/projected/27aea398-2c8e-4327-8959-1e303892b2e2-kube-api-access-tmt5n\") pod \"payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.476401 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.476380    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27aea398-2c8e-4327-8959-1e303892b2e2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.490311 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.490273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmt5n\" (UniqueName: \"kubernetes.io/projected/27aea398-2c8e-4327-8959-1e303892b2e2-kube-api-access-tmt5n\") pod \"payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.507119 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.507091    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:13.652512 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:13.652259    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"]
Jul 27 19:26:13.655040 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:26:13.655007    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27aea398_2c8e_4327_8959_1e303892b2e2.slice/crio-eb95387d421677dd569af98b17115334911bc9cacfa34d7735d66a13c4047b00 WatchSource:0}: Error finding container eb95387d421677dd569af98b17115334911bc9cacfa34d7735d66a13c4047b00: Status 404 returned error can't find the container with id eb95387d421677dd569af98b17115334911bc9cacfa34d7735d66a13c4047b00
Jul 27 19:26:14.239529 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:14.239494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4" event={"ID":"27aea398-2c8e-4327-8959-1e303892b2e2","Type":"ContainerStarted","Data":"ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050"}
Jul 27 19:26:14.240068 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:14.239555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4" event={"ID":"27aea398-2c8e-4327-8959-1e303892b2e2","Type":"ContainerStarted","Data":"eb95387d421677dd569af98b17115334911bc9cacfa34d7735d66a13c4047b00"}
Jul 27 19:26:14.240068 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:14.239630    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:14.259206 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:14.259153    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4" podStartSLOduration=1.2591363740000001 podStartE2EDuration="1.259136374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:14.256483543 +0000 UTC m=+3299.009277976" watchObservedRunningTime="2026-07-27 19:26:14.259136374 +0000 UTC m=+3299.011930867"
Jul 27 19:26:16.482537 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:16.482503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:26:25.246964 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:25.246932    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:26:38.863263 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:38.863184    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xkcqj_0831ed87-7c67-4a74-aabb-de74e5f11230/payload-processing/0.log"
Jul 27 19:26:38.989103 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:38.989070    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4_27aea398-2c8e-4327-8959-1e303892b2e2/payload-processing/0.log"
Jul 27 19:26:42.343388 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:26:42.343350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:23.950070 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:23.950034    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xkcqj_0831ed87-7c67-4a74-aabb-de74e5f11230/payload-processing/0.log"
Jul 27 19:27:24.070079 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.070053    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4_27aea398-2c8e-4327-8959-1e303892b2e2/payload-processing/0.log"
Jul 27 19:27:24.675482 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.675450    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"]
Jul 27 19:27:24.679167 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.679149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.682255 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.682229    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8eed25-openshift-default-dockercfg-nwjsw\""
Jul 27 19:27:24.692630 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.692603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"]
Jul 27 19:27:24.779662 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.779630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-credential-socket\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.779662 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.779670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-podinfo\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.779950 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.779727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.779950 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.779823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-certs\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.779950 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.779861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-token\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.779950 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.779938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-envoy\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.780137 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.780027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcnq2\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-kube-api-access-dcnq2\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.780137 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.780083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-socket\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.780137 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.780113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-data\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.880716 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.880681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcnq2\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-kube-api-access-dcnq2\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.880959 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.880731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-socket\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.880959 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.880780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-data\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.880959 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.880910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-credential-socket\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881124 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.880960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-podinfo\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881124 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881124 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-certs\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881288 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-data\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881288 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-socket\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881288 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-token\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881288 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-envoy\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881466 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-credential-socket\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881466 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-certs\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.881673 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.881654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.883639 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.883608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-envoy\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.883816 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.883678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-podinfo\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.894546 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.894521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-token\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.894701 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.894619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcnq2\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-kube-api-access-dcnq2\") pod \"e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") " pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:24.989798 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:24.989685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:25.165576 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.165550    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"]
Jul 27 19:27:25.167464 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:27:25.167423    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e564735_59ea_40d0_b085_eb2b2b5bc47e.slice/crio-bef1276723dea7d5e60944c718b63da5ee6f86bf52a13b9f2b7e9871dde7627a WatchSource:0}: Error finding container bef1276723dea7d5e60944c718b63da5ee6f86bf52a13b9f2b7e9871dde7627a: Status 404 returned error can't find the container with id bef1276723dea7d5e60944c718b63da5ee6f86bf52a13b9f2b7e9871dde7627a
Jul 27 19:27:25.169841 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.169808    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:27:25.169910 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.169877    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:27:25.169948 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.169926    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:27:25.194552 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.194519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:25.373448 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.373346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:25.605215 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.605182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" event={"ID":"7e564735-59ea-40d0-b085-eb2b2b5bc47e","Type":"ContainerStarted","Data":"464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4"}
Jul 27 19:27:25.605391 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.605241    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" event={"ID":"7e564735-59ea-40d0-b085-eb2b2b5bc47e","Type":"ContainerStarted","Data":"bef1276723dea7d5e60944c718b63da5ee6f86bf52a13b9f2b7e9871dde7627a"}
Jul 27 19:27:25.633167 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.633119    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" podStartSLOduration=1.633103075 podStartE2EDuration="1.633103075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:25.630951504 +0000 UTC m=+3370.383745944" watchObservedRunningTime="2026-07-27 19:27:25.633103075 +0000 UTC m=+3370.385897495"
Jul 27 19:27:25.990958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:25.990860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:26.996203 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:26.996167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:27.616241 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:27.616207    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:27.617161 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:27.617142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:27.622808 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:27.622781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:27.732797 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:27.732768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:29.628024 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.627982    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"]
Jul 27 19:27:29.632243 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.632219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.634730 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.634708    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-8eed25-serving-cert\""
Jul 27 19:27:29.639539 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.639514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"]
Jul 27 19:27:29.657961 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.657924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:29.724698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.724658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c81214-44bf-4756-ba93-4b356973e800-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.725199 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.725131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9c81214-44bf-4756-ba93-4b356973e800-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.725199 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.725183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgfz5\" (UniqueName: \"kubernetes.io/projected/c9c81214-44bf-4756-ba93-4b356973e800-kube-api-access-xgfz5\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.825988 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.825957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9c81214-44bf-4756-ba93-4b356973e800-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.825988 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.825997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgfz5\" (UniqueName: \"kubernetes.io/projected/c9c81214-44bf-4756-ba93-4b356973e800-kube-api-access-xgfz5\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.826229 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.826097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c81214-44bf-4756-ba93-4b356973e800-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.826759 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.826694    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c81214-44bf-4756-ba93-4b356973e800-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.828593 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.828568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9c81214-44bf-4756-ba93-4b356973e800-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.834982 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.834954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgfz5\" (UniqueName: \"kubernetes.io/projected/c9c81214-44bf-4756-ba93-4b356973e800-kube-api-access-xgfz5\") pod \"maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:29.888447 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.888418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:29.949401 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:29.949366    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:30.098186 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:30.098160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:30.099482 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:30.099463    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"]
Jul 27 19:27:30.101230 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:27:30.101200    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c81214_44bf_4756_ba93_4b356973e800.slice/crio-17ebc6d33d885e7d6a22c828474821ced5fc16b999254780492de0a52cae0ec0 WatchSource:0}: Error finding container 17ebc6d33d885e7d6a22c828474821ced5fc16b999254780492de0a52cae0ec0: Status 404 returned error can't find the container with id 17ebc6d33d885e7d6a22c828474821ced5fc16b999254780492de0a52cae0ec0
Jul 27 19:27:30.191550 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:30.191463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:30.639635 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:30.639600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr" event={"ID":"c9c81214-44bf-4756-ba93-4b356973e800","Type":"ContainerStarted","Data":"559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0"}
Jul 27 19:27:30.640156 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:30.639657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr" event={"ID":"c9c81214-44bf-4756-ba93-4b356973e800","Type":"ContainerStarted","Data":"17ebc6d33d885e7d6a22c828474821ced5fc16b999254780492de0a52cae0ec0"}
Jul 27 19:27:30.640156 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:30.639702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:30.658260 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:30.658201    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr" podStartSLOduration=1.235297922 podStartE2EDuration="1.658185315s" totalImagesPullingTime="422.887393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:30.656913084 +0000 UTC m=+3375.409707503" watchObservedRunningTime="2026-07-27 19:27:30.658185315 +0000 UTC m=+3375.410979734"
Jul 27 19:27:32.917990 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:32.917958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:36.651392 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:36.651364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:42.617804 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.617765    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 19:27:42.618207 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.617845    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 19:27:42.733172 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.733097    2578 generic.go:356] "Generic (PLEG): container finished" podID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerID="464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4" exitCode=0
Jul 27 19:27:42.733320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.733165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" event={"ID":"7e564735-59ea-40d0-b085-eb2b2b5bc47e","Type":"ContainerDied","Data":"464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4"}
Jul 27 19:27:42.733597 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.733578    2578 scope.go:117] "RemoveContainer" containerID="464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4"
Jul 27 19:27:42.734786 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.734755    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:27:42.734873 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.734830    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:27:42.734873 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:42.734863    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 27 19:27:43.740489 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:43.740452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" event={"ID":"7e564735-59ea-40d0-b085-eb2b2b5bc47e","Type":"ContainerStarted","Data":"63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e"}
Jul 27 19:27:43.991084 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:43.990970    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:43.991297 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:43.991268    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 19:27:43.991379 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:43.991341    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 19:27:44.991733 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:44.991243    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 19:27:44.991733 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:44.991322    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 19:27:45.990683 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:45.990646    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 19:27:45.991070 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:45.991036    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 19:27:46.990680 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:46.990639    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 19:27:46.991207 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:46.990874    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 19:27:47.994492 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:47.994462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:47.994966 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:47.994766    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:47.995578 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:47.995558    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:27:54.080327 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.080287    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"]
Jul 27 19:27:54.080845 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.080589    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr" podUID="c9c81214-44bf-4756-ba93-4b356973e800" containerName="maas-api" containerID="cri-o://559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0" gracePeriod=30
Jul 27 19:27:54.117596 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.117557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:54.217791 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.217732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:54.277877 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.277842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:54.355834 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.355810    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:54.498620 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.498582    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgfz5\" (UniqueName: \"kubernetes.io/projected/c9c81214-44bf-4756-ba93-4b356973e800-kube-api-access-xgfz5\") pod \"c9c81214-44bf-4756-ba93-4b356973e800\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") "
Jul 27 19:27:54.498837 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.498670    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9c81214-44bf-4756-ba93-4b356973e800-maas-api-tls\") pod \"c9c81214-44bf-4756-ba93-4b356973e800\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") "
Jul 27 19:27:54.498837 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.498780    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c81214-44bf-4756-ba93-4b356973e800-openshift-service-ca\") pod \"c9c81214-44bf-4756-ba93-4b356973e800\" (UID: \"c9c81214-44bf-4756-ba93-4b356973e800\") "
Jul 27 19:27:54.499179 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.499154    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c81214-44bf-4756-ba93-4b356973e800-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9c81214-44bf-4756-ba93-4b356973e800" (UID: "c9c81214-44bf-4756-ba93-4b356973e800"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:27:54.500993 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.500972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9c81214-44bf-4756-ba93-4b356973e800-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9c81214-44bf-4756-ba93-4b356973e800" (UID: "c9c81214-44bf-4756-ba93-4b356973e800"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:27:54.501056 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.501022    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c81214-44bf-4756-ba93-4b356973e800-kube-api-access-xgfz5" (OuterVolumeSpecName: "kube-api-access-xgfz5") pod "c9c81214-44bf-4756-ba93-4b356973e800" (UID: "c9c81214-44bf-4756-ba93-4b356973e800"). InnerVolumeSpecName "kube-api-access-xgfz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:27:54.599707 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.599617    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9c81214-44bf-4756-ba93-4b356973e800-maas-api-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:27:54.599707 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.599649    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c81214-44bf-4756-ba93-4b356973e800-openshift-service-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:27:54.599707 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.599662    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgfz5\" (UniqueName: \"kubernetes.io/projected/c9c81214-44bf-4756-ba93-4b356973e800-kube-api-access-xgfz5\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:27:54.807222 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.807187    2578 generic.go:356] "Generic (PLEG): container finished" podID="c9c81214-44bf-4756-ba93-4b356973e800" containerID="559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0" exitCode=0
Jul 27 19:27:54.807364 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.807242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr" event={"ID":"c9c81214-44bf-4756-ba93-4b356973e800","Type":"ContainerDied","Data":"559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0"}
Jul 27 19:27:54.807364 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.807247    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"
Jul 27 19:27:54.807364 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.807308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr" event={"ID":"c9c81214-44bf-4756-ba93-4b356973e800","Type":"ContainerDied","Data":"17ebc6d33d885e7d6a22c828474821ced5fc16b999254780492de0a52cae0ec0"}
Jul 27 19:27:54.807364 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.807329    2578 scope.go:117] "RemoveContainer" containerID="559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0"
Jul 27 19:27:54.817384 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.817360    2578 scope.go:117] "RemoveContainer" containerID="559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0"
Jul 27 19:27:54.817720 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:27:54.817699    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0\": container with ID starting with 559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0 not found: ID does not exist" containerID="559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0"
Jul 27 19:27:54.817802 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.817729    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0"} err="failed to get container status \"559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0\": rpc error: code = NotFound desc = could not find container \"559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0\": container with ID starting with 559a6c16c59e2bf52d7158e47fb169a5eee42216bc17867a860e5eafe44a45a0 not found: ID does not exist"
Jul 27 19:27:54.828713 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.828685    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"]
Jul 27 19:27:54.832218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:54.832189    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8eed25-54c684b65b-2lmlr"]
Jul 27 19:27:55.847414 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:55.847377    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9c81214-44bf-4756-ba93-4b356973e800" path="/var/lib/kubelet/pods/c9c81214-44bf-4756-ba93-4b356973e800/volumes"
Jul 27 19:27:58.928637 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:58.928603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:59.330997 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:27:59.330915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:05.665722 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:05.665689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:05.766382 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:05.766353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:05.951120 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:05.951035    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"]
Jul 27 19:28:05.951304 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:05.951262    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy" containerID="cri-o://63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e" gracePeriod=30
Jul 27 19:28:06.010629 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:06.010598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:06.302905 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:06.302789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:11.211015 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.210950    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:28:11.261056 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261025    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-envoy\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261056 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261060    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-certs\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261278 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-podinfo\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261278 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-data\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261278 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261160    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istiod-ca-cert\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261278 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261208    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-socket\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261482 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261310    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-token\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261482 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261339    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcnq2\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-kube-api-access-dcnq2\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261482 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261387    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-credential-socket\") pod \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\" (UID: \"7e564735-59ea-40d0-b085-eb2b2b5bc47e\") "
Jul 27 19:28:11.261646 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261567    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:11.262065 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261817    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:28:11.262065 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.261838    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:28:11.262065 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.262033    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:28:11.262314 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.262095    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.262314 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.262118    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.262314 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.262119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:28:11.262314 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.262133    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.263445 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.263416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:28:11.264108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.264088    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:28:11.264197 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.264125    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:11.264197 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.264173    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-kube-api-access-dcnq2" (OuterVolumeSpecName: "kube-api-access-dcnq2") pod "7e564735-59ea-40d0-b085-eb2b2b5bc47e" (UID: "7e564735-59ea-40d0-b085-eb2b2b5bc47e"). InnerVolumeSpecName "kube-api-access-dcnq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:11.362997 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.362960    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.362997 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.362992    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcnq2\" (UniqueName: \"kubernetes.io/projected/7e564735-59ea-40d0-b085-eb2b2b5bc47e-kube-api-access-dcnq2\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.362997 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.363002    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.363241 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.363010    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.363241 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.363020    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.363241 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.363028    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e564735-59ea-40d0-b085-eb2b2b5bc47e-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:11.904537 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.904499    2578 generic.go:356] "Generic (PLEG): container finished" podID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerID="63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e" exitCode=0
Jul 27 19:28:11.904698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.904554    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"
Jul 27 19:28:11.904698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.904586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" event={"ID":"7e564735-59ea-40d0-b085-eb2b2b5bc47e","Type":"ContainerDied","Data":"63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e"}
Jul 27 19:28:11.904698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.904666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx" event={"ID":"7e564735-59ea-40d0-b085-eb2b2b5bc47e","Type":"ContainerDied","Data":"bef1276723dea7d5e60944c718b63da5ee6f86bf52a13b9f2b7e9871dde7627a"}
Jul 27 19:28:11.904698 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.904693    2578 scope.go:117] "RemoveContainer" containerID="63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e"
Jul 27 19:28:11.914379 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.914357    2578 scope.go:117] "RemoveContainer" containerID="464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4"
Jul 27 19:28:11.924236 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.924216    2578 scope.go:117] "RemoveContainer" containerID="63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e"
Jul 27 19:28:11.924336 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.924323    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"]
Jul 27 19:28:11.924548 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:28:11.924524    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e\": container with ID starting with 63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e not found: ID does not exist" containerID="63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e"
Jul 27 19:28:11.924594 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.924563    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e"} err="failed to get container status \"63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e\": rpc error: code = NotFound desc = could not find container \"63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e\": container with ID starting with 63fa10c0e0c3dbc5f07efd57186abc170ca1b18aa248e0a8321c8d49effd804e not found: ID does not exist"
Jul 27 19:28:11.924640 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.924591    2578 scope.go:117] "RemoveContainer" containerID="464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4"
Jul 27 19:28:11.924906 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:28:11.924889    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4\": container with ID starting with 464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4 not found: ID does not exist" containerID="464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4"
Jul 27 19:28:11.924951 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.924916    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4"} err="failed to get container status \"464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4\": rpc error: code = NotFound desc = could not find container \"464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4\": container with ID starting with 464c16f841829a28302320e675562ec1ff7f90669834753dc9811be24ec580f4 not found: ID does not exist"
Jul 27 19:28:11.926349 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:11.926330    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8eed25-openshift-default-6d9f8496bb-nrcwx"]
Jul 27 19:28:13.847113 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:13.847074    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" path="/var/lib/kubelet/pods/7e564735-59ea-40d0-b085-eb2b2b5bc47e/volumes"
Jul 27 19:28:28.382173 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.382135    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"]
Jul 27 19:28:28.382682 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.382369    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6" podUID="28c02c11-17b4-4081-81dc-33504272dfd3" containerName="maas-api" containerID="cri-o://6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84" gracePeriod=30
Jul 27 19:28:28.418292 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.418266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:28.445130 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.445095    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"]
Jul 27 19:28:28.445398 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.445371    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb" podUID="27ee3e60-465b-48e1-b9ab-335d431597a0" containerName="payload-pre-processing" containerID="cri-o://dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf" gracePeriod=30
Jul 27 19:28:28.519966 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.519937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:28.730030 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.730000    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:28:28.743097 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.743069    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:28:28.841642 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.841614    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xwk7\" (UniqueName: \"kubernetes.io/projected/27ee3e60-465b-48e1-b9ab-335d431597a0-kube-api-access-6xwk7\") pod \"27ee3e60-465b-48e1-b9ab-335d431597a0\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") "
Jul 27 19:28:28.841859 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.841656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27ee3e60-465b-48e1-b9ab-335d431597a0-plugins-config-volume\") pod \"27ee3e60-465b-48e1-b9ab-335d431597a0\" (UID: \"27ee3e60-465b-48e1-b9ab-335d431597a0\") "
Jul 27 19:28:28.841859 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.841791    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls\") pod \"28c02c11-17b4-4081-81dc-33504272dfd3\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") "
Jul 27 19:28:28.841859 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.841835    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c02c11-17b4-4081-81dc-33504272dfd3-openshift-service-ca\") pod \"28c02c11-17b4-4081-81dc-33504272dfd3\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") "
Jul 27 19:28:28.842048 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.841934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgthm\" (UniqueName: \"kubernetes.io/projected/28c02c11-17b4-4081-81dc-33504272dfd3-kube-api-access-kgthm\") pod \"28c02c11-17b4-4081-81dc-33504272dfd3\" (UID: \"28c02c11-17b4-4081-81dc-33504272dfd3\") "
Jul 27 19:28:28.842181 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.842155    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ee3e60-465b-48e1-b9ab-335d431597a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27ee3e60-465b-48e1-b9ab-335d431597a0" (UID: "27ee3e60-465b-48e1-b9ab-335d431597a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:28.842256 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.842229    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28c02c11-17b4-4081-81dc-33504272dfd3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28c02c11-17b4-4081-81dc-33504272dfd3" (UID: "28c02c11-17b4-4081-81dc-33504272dfd3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:28.842314 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.842295    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27ee3e60-465b-48e1-b9ab-335d431597a0-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:28.844046 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.844021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28c02c11-17b4-4081-81dc-33504272dfd3" (UID: "28c02c11-17b4-4081-81dc-33504272dfd3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:28:28.844626 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.844608    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c02c11-17b4-4081-81dc-33504272dfd3-kube-api-access-kgthm" (OuterVolumeSpecName: "kube-api-access-kgthm") pod "28c02c11-17b4-4081-81dc-33504272dfd3" (UID: "28c02c11-17b4-4081-81dc-33504272dfd3"). InnerVolumeSpecName "kube-api-access-kgthm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:28.844702 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.844666    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ee3e60-465b-48e1-b9ab-335d431597a0-kube-api-access-6xwk7" (OuterVolumeSpecName: "kube-api-access-6xwk7") pod "27ee3e60-465b-48e1-b9ab-335d431597a0" (UID: "27ee3e60-465b-48e1-b9ab-335d431597a0"). InnerVolumeSpecName "kube-api-access-6xwk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:28.943795 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.943684    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xwk7\" (UniqueName: \"kubernetes.io/projected/27ee3e60-465b-48e1-b9ab-335d431597a0-kube-api-access-6xwk7\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:28.943795 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.943711    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c02c11-17b4-4081-81dc-33504272dfd3-maas-api-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:28.943795 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.943720    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c02c11-17b4-4081-81dc-33504272dfd3-openshift-service-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:28.943795 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.943730    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgthm\" (UniqueName: \"kubernetes.io/projected/28c02c11-17b4-4081-81dc-33504272dfd3-kube-api-access-kgthm\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:28:28.999249 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.999209    2578 generic.go:356] "Generic (PLEG): container finished" podID="28c02c11-17b4-4081-81dc-33504272dfd3" containerID="6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84" exitCode=0
Jul 27 19:28:28.999425 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.999263    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"
Jul 27 19:28:28.999425 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.999305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6" event={"ID":"28c02c11-17b4-4081-81dc-33504272dfd3","Type":"ContainerDied","Data":"6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84"}
Jul 27 19:28:28.999425 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.999366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6" event={"ID":"28c02c11-17b4-4081-81dc-33504272dfd3","Type":"ContainerDied","Data":"77583c608f5923be6920e5afe29410e4b2696bbcd62a0b44d7731695db7ba3cb"}
Jul 27 19:28:28.999425 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:28.999390    2578 scope.go:117] "RemoveContainer" containerID="6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84"
Jul 27 19:28:29.000714 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.000693    2578 generic.go:356] "Generic (PLEG): container finished" podID="27ee3e60-465b-48e1-b9ab-335d431597a0" containerID="dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf" exitCode=0
Jul 27 19:28:29.000836 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.000729    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"
Jul 27 19:28:29.000836 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.000766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb" event={"ID":"27ee3e60-465b-48e1-b9ab-335d431597a0","Type":"ContainerDied","Data":"dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf"}
Jul 27 19:28:29.000836 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.000816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb" event={"ID":"27ee3e60-465b-48e1-b9ab-335d431597a0","Type":"ContainerDied","Data":"873335434f2f30396d59b1a07cb9d0579e09d0e66f57ecf5173c38a4a3f08bc9"}
Jul 27 19:28:29.008789 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.008766    2578 scope.go:117] "RemoveContainer" containerID="6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84"
Jul 27 19:28:29.009072 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:28:29.009056    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84\": container with ID starting with 6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84 not found: ID does not exist" containerID="6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84"
Jul 27 19:28:29.009133 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.009082    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84"} err="failed to get container status \"6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84\": rpc error: code = NotFound desc = could not find container \"6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84\": container with ID starting with 6fa42c7753e7667e3f943c37b67e791c1a1634a21c4283a4795db65cb498db84 not found: ID does not exist"
Jul 27 19:28:29.009133 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.009098    2578 scope.go:117] "RemoveContainer" containerID="dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf"
Jul 27 19:28:29.017819 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.017798    2578 scope.go:117] "RemoveContainer" containerID="dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf"
Jul 27 19:28:29.018113 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:28:29.018091    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf\": container with ID starting with dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf not found: ID does not exist" containerID="dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf"
Jul 27 19:28:29.018210 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.018119    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf"} err="failed to get container status \"dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf\": rpc error: code = NotFound desc = could not find container \"dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf\": container with ID starting with dc726ff2e0abeb88129e9e664e67b4fe8aa2ecae5ed6157fc30a30a3cb3db8bf not found: ID does not exist"
Jul 27 19:28:29.025175 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.025152    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"]
Jul 27 19:28:29.028690 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.028667    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d4857a-74b497fc55-qfqw6"]
Jul 27 19:28:29.039859 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.039825    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"]
Jul 27 19:28:29.041782 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.041757    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d4857a-6b9dd85f88-chztb"]
Jul 27 19:28:29.846413 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.846315    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ee3e60-465b-48e1-b9ab-335d431597a0" path="/var/lib/kubelet/pods/27ee3e60-465b-48e1-b9ab-335d431597a0/volumes"
Jul 27 19:28:29.846942 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:29.846920    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28c02c11-17b4-4081-81dc-33504272dfd3" path="/var/lib/kubelet/pods/28c02c11-17b4-4081-81dc-33504272dfd3/volumes"
Jul 27 19:28:30.136197 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:30.136171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:30.516880 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:30.516804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:35.597034 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:28:35.596996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:11.651526 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:11.651493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:13.477485 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:13.477450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:19.811202 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:19.811166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:35.297368 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:35.297333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:35.556321 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:35.556238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:35.660398 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:35.660371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:35.837660 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:35.837577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:38.127166 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:38.127070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:47.540950 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.540912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:47.577102 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.577065    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"]
Jul 27 19:29:47.577366 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.577324    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4" podUID="27aea398-2c8e-4327-8959-1e303892b2e2" containerName="payload-processing" containerID="cri-o://ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050" gracePeriod=30
Jul 27 19:29:47.637543 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.637461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:47.737711 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.737680    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:47.849210 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.849184    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:29:47.928119 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.928088    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmt5n\" (UniqueName: \"kubernetes.io/projected/27aea398-2c8e-4327-8959-1e303892b2e2-kube-api-access-tmt5n\") pod \"27aea398-2c8e-4327-8959-1e303892b2e2\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") "
Jul 27 19:29:47.928326 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.928168    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27aea398-2c8e-4327-8959-1e303892b2e2-plugins-config-volume\") pod \"27aea398-2c8e-4327-8959-1e303892b2e2\" (UID: \"27aea398-2c8e-4327-8959-1e303892b2e2\") "
Jul 27 19:29:47.928595 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.928571    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27aea398-2c8e-4327-8959-1e303892b2e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27aea398-2c8e-4327-8959-1e303892b2e2" (UID: "27aea398-2c8e-4327-8959-1e303892b2e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:29:47.930414 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:47.930387    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27aea398-2c8e-4327-8959-1e303892b2e2-kube-api-access-tmt5n" (OuterVolumeSpecName: "kube-api-access-tmt5n") pod "27aea398-2c8e-4327-8959-1e303892b2e2" (UID: "27aea398-2c8e-4327-8959-1e303892b2e2"). InnerVolumeSpecName "kube-api-access-tmt5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:48.028873 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.028841    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmt5n\" (UniqueName: \"kubernetes.io/projected/27aea398-2c8e-4327-8959-1e303892b2e2-kube-api-access-tmt5n\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:29:48.028873 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.028865    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27aea398-2c8e-4327-8959-1e303892b2e2-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:29:48.418276 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.418240    2578 generic.go:356] "Generic (PLEG): container finished" podID="27aea398-2c8e-4327-8959-1e303892b2e2" containerID="ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050" exitCode=0
Jul 27 19:29:48.418450 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.418295    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"
Jul 27 19:29:48.418450 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.418323    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4" event={"ID":"27aea398-2c8e-4327-8959-1e303892b2e2","Type":"ContainerDied","Data":"ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050"}
Jul 27 19:29:48.418450 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.418381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4" event={"ID":"27aea398-2c8e-4327-8959-1e303892b2e2","Type":"ContainerDied","Data":"eb95387d421677dd569af98b17115334911bc9cacfa34d7735d66a13c4047b00"}
Jul 27 19:29:48.418450 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.418405    2578 scope.go:117] "RemoveContainer" containerID="ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050"
Jul 27 19:29:48.428035 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.428017    2578 scope.go:117] "RemoveContainer" containerID="ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050"
Jul 27 19:29:48.428294 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:29:48.428275    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050\": container with ID starting with ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050 not found: ID does not exist" containerID="ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050"
Jul 27 19:29:48.428374 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.428302    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050"} err="failed to get container status \"ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050\": rpc error: code = NotFound desc = could not find container \"ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050\": container with ID starting with ff4f755c3ca67f88ac147d6a9c74ed4504c04f7d234876f9986d08516ac15050 not found: ID does not exist"
Jul 27 19:29:48.442421 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.442393    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"]
Jul 27 19:29:48.450179 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:48.450149    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2d7b97-595757ffcd-t5lm4"]
Jul 27 19:29:49.848311 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:49.848282    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27aea398-2c8e-4327-8959-1e303892b2e2" path="/var/lib/kubelet/pods/27aea398-2c8e-4327-8959-1e303892b2e2/volumes"
Jul 27 19:29:51.040933 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:51.040903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:51.441161 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:51.441132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:58.164619 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:58.164590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:58.265006 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:58.264970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:58.437096 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:58.436988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:58.641632 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:29:58.641600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:10.147658 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.147614    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"]
Jul 27 19:30:10.148174 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.147937    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds" podUID="d068a63e-d7c1-45f0-bf00-d261479485b7" containerName="maas-api" containerID="cri-o://90edd10adf039c8bb18565e59a91ef7f9de6027f0b869a1d0f962124572183c9" gracePeriod=30
Jul 27 19:30:10.177501 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.177469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:10.214929 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.214891    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"]
Jul 27 19:30:10.215198 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.215170    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk" podUID="ec1a243f-1a7b-4e92-ae2a-21c495954a38" containerName="payload-processing" containerID="cri-o://e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455" gracePeriod=30
Jul 27 19:30:10.219850 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.219817    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"]
Jul 27 19:30:10.220079 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.220048    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8" podUID="52dedd26-cff4-4c26-af6e-b64ccbd4b039" containerName="payload-pre-processing" containerID="cri-o://682994c2fb4499ac4b39c2719d56ec2bc9b1f3aba2a993cf3771f3ba99b9076d" gracePeriod=30
Jul 27 19:30:10.258525 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.258493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:10.349456 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.349425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:10.531664 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.531638    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:30:10.532110 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.532061    2578 generic.go:356] "Generic (PLEG): container finished" podID="d068a63e-d7c1-45f0-bf00-d261479485b7" containerID="90edd10adf039c8bb18565e59a91ef7f9de6027f0b869a1d0f962124572183c9" exitCode=0
Jul 27 19:30:10.532110 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.532096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds" event={"ID":"d068a63e-d7c1-45f0-bf00-d261479485b7","Type":"ContainerDied","Data":"90edd10adf039c8bb18565e59a91ef7f9de6027f0b869a1d0f962124572183c9"}
Jul 27 19:30:10.532306 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.532155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds" event={"ID":"d068a63e-d7c1-45f0-bf00-d261479485b7","Type":"ContainerDied","Data":"c689b00bd99251ed180d7a02d408f2bf2fc5a56e9ee7d8b608edb851dd385f9b"}
Jul 27 19:30:10.532306 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.532181    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c689b00bd99251ed180d7a02d408f2bf2fc5a56e9ee7d8b608edb851dd385f9b"
Jul 27 19:30:10.533561 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.533535    2578 generic.go:356] "Generic (PLEG): container finished" podID="ec1a243f-1a7b-4e92-ae2a-21c495954a38" containerID="e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455" exitCode=0
Jul 27 19:30:10.533697 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.533574    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"
Jul 27 19:30:10.533697 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.533618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk" event={"ID":"ec1a243f-1a7b-4e92-ae2a-21c495954a38","Type":"ContainerDied","Data":"e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455"}
Jul 27 19:30:10.533697 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.533687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk" event={"ID":"ec1a243f-1a7b-4e92-ae2a-21c495954a38","Type":"ContainerDied","Data":"852aadd42485bae21bfe07f652133c868725f1c4371ef2c5976ee92cfa91a04b"}
Jul 27 19:30:10.533873 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.533716    2578 scope.go:117] "RemoveContainer" containerID="e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455"
Jul 27 19:30:10.535215 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.535194    2578 generic.go:356] "Generic (PLEG): container finished" podID="52dedd26-cff4-4c26-af6e-b64ccbd4b039" containerID="682994c2fb4499ac4b39c2719d56ec2bc9b1f3aba2a993cf3771f3ba99b9076d" exitCode=0
Jul 27 19:30:10.535318 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.535245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8" event={"ID":"52dedd26-cff4-4c26-af6e-b64ccbd4b039","Type":"ContainerDied","Data":"682994c2fb4499ac4b39c2719d56ec2bc9b1f3aba2a993cf3771f3ba99b9076d"}
Jul 27 19:30:10.535636 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.535616    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:30:10.542886 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.542868    2578 scope.go:117] "RemoveContainer" containerID="e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455"
Jul 27 19:30:10.543212 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:30:10.543177    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455\": container with ID starting with e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455 not found: ID does not exist" containerID="e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455"
Jul 27 19:30:10.543302 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.543212    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455"} err="failed to get container status \"e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455\": rpc error: code = NotFound desc = could not find container \"e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455\": container with ID starting with e574d92ba960615cea0290e16a0aaa77bb1dde961f37ddbbaf6f4d658b948455 not found: ID does not exist"
Jul 27 19:30:10.546968 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.546949    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:30:10.651181 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651146    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jc92\" (UniqueName: \"kubernetes.io/projected/d068a63e-d7c1-45f0-bf00-d261479485b7-kube-api-access-2jc92\") pod \"d068a63e-d7c1-45f0-bf00-d261479485b7\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") "
Jul 27 19:30:10.651181 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651189    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec1a243f-1a7b-4e92-ae2a-21c495954a38-plugins-config-volume\") pod \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") "
Jul 27 19:30:10.651418 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651224    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52dedd26-cff4-4c26-af6e-b64ccbd4b039-plugins-config-volume\") pod \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") "
Jul 27 19:30:10.651418 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651266    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxf65\" (UniqueName: \"kubernetes.io/projected/ec1a243f-1a7b-4e92-ae2a-21c495954a38-kube-api-access-pxf65\") pod \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\" (UID: \"ec1a243f-1a7b-4e92-ae2a-21c495954a38\") "
Jul 27 19:30:10.651418 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651292    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84znc\" (UniqueName: \"kubernetes.io/projected/52dedd26-cff4-4c26-af6e-b64ccbd4b039-kube-api-access-84znc\") pod \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\" (UID: \"52dedd26-cff4-4c26-af6e-b64ccbd4b039\") "
Jul 27 19:30:10.651418 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651349    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d068a63e-d7c1-45f0-bf00-d261479485b7-openshift-service-ca\") pod \"d068a63e-d7c1-45f0-bf00-d261479485b7\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") "
Jul 27 19:30:10.651418 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651392    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls\") pod \"d068a63e-d7c1-45f0-bf00-d261479485b7\" (UID: \"d068a63e-d7c1-45f0-bf00-d261479485b7\") "
Jul 27 19:30:10.651722 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52dedd26-cff4-4c26-af6e-b64ccbd4b039-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "52dedd26-cff4-4c26-af6e-b64ccbd4b039" (UID: "52dedd26-cff4-4c26-af6e-b64ccbd4b039"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:10.651843 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d068a63e-d7c1-45f0-bf00-d261479485b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d068a63e-d7c1-45f0-bf00-d261479485b7" (UID: "d068a63e-d7c1-45f0-bf00-d261479485b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:10.651843 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651836    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52dedd26-cff4-4c26-af6e-b64ccbd4b039-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:10.652055 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.651998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec1a243f-1a7b-4e92-ae2a-21c495954a38-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec1a243f-1a7b-4e92-ae2a-21c495954a38" (UID: "ec1a243f-1a7b-4e92-ae2a-21c495954a38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:10.653681 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.653646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52dedd26-cff4-4c26-af6e-b64ccbd4b039-kube-api-access-84znc" (OuterVolumeSpecName: "kube-api-access-84znc") pod "52dedd26-cff4-4c26-af6e-b64ccbd4b039" (UID: "52dedd26-cff4-4c26-af6e-b64ccbd4b039"). InnerVolumeSpecName "kube-api-access-84znc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:10.653681 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.653668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec1a243f-1a7b-4e92-ae2a-21c495954a38-kube-api-access-pxf65" (OuterVolumeSpecName: "kube-api-access-pxf65") pod "ec1a243f-1a7b-4e92-ae2a-21c495954a38" (UID: "ec1a243f-1a7b-4e92-ae2a-21c495954a38"). InnerVolumeSpecName "kube-api-access-pxf65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:10.653681 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.653673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d068a63e-d7c1-45f0-bf00-d261479485b7-kube-api-access-2jc92" (OuterVolumeSpecName: "kube-api-access-2jc92") pod "d068a63e-d7c1-45f0-bf00-d261479485b7" (UID: "d068a63e-d7c1-45f0-bf00-d261479485b7"). InnerVolumeSpecName "kube-api-access-2jc92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:10.653892 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.653725    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d068a63e-d7c1-45f0-bf00-d261479485b7" (UID: "d068a63e-d7c1-45f0-bf00-d261479485b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:30:10.753108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.753017    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d068a63e-d7c1-45f0-bf00-d261479485b7-openshift-service-ca\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:10.753108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.753050    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d068a63e-d7c1-45f0-bf00-d261479485b7-maas-api-tls\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:10.753108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.753061    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jc92\" (UniqueName: \"kubernetes.io/projected/d068a63e-d7c1-45f0-bf00-d261479485b7-kube-api-access-2jc92\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:10.753108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.753071    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec1a243f-1a7b-4e92-ae2a-21c495954a38-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:10.753108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.753080    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxf65\" (UniqueName: \"kubernetes.io/projected/ec1a243f-1a7b-4e92-ae2a-21c495954a38-kube-api-access-pxf65\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:10.753108 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.753089    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84znc\" (UniqueName: \"kubernetes.io/projected/52dedd26-cff4-4c26-af6e-b64ccbd4b039-kube-api-access-84znc\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:10.857228 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.857191    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"]
Jul 27 19:30:10.863180 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:10.863153    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-de344b-649465f6bb-ql5nk"]
Jul 27 19:30:11.541921 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.541835    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"
Jul 27 19:30:11.541921 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.541861    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"
Jul 27 19:30:11.541921 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.541860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8" event={"ID":"52dedd26-cff4-4c26-af6e-b64ccbd4b039","Type":"ContainerDied","Data":"afe706a973963621964b8fcf130462c46b705b356b09838156f6160a39a2bd92"}
Jul 27 19:30:11.541921 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.541923    2578 scope.go:117] "RemoveContainer" containerID="682994c2fb4499ac4b39c2719d56ec2bc9b1f3aba2a993cf3771f3ba99b9076d"
Jul 27 19:30:11.585206 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.585165    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"]
Jul 27 19:30:11.588931 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.588903    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-de344b-6b7d65c884-bwhds"]
Jul 27 19:30:11.615694 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.615644    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"]
Jul 27 19:30:11.620917 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.620885    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-de344b-7879dd576-f2zd8"]
Jul 27 19:30:11.846508 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.846406    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52dedd26-cff4-4c26-af6e-b64ccbd4b039" path="/var/lib/kubelet/pods/52dedd26-cff4-4c26-af6e-b64ccbd4b039/volumes"
Jul 27 19:30:11.846954 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.846932    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d068a63e-d7c1-45f0-bf00-d261479485b7" path="/var/lib/kubelet/pods/d068a63e-d7c1-45f0-bf00-d261479485b7/volumes"
Jul 27 19:30:11.847326 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:11.847307    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec1a243f-1a7b-4e92-ae2a-21c495954a38" path="/var/lib/kubelet/pods/ec1a243f-1a7b-4e92-ae2a-21c495954a38/volumes"
Jul 27 19:30:13.838110 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:13.838050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:14.211363 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:14.211331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:16.248303 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:16.248271    2578 scope.go:117] "RemoveContainer" containerID="90edd10adf039c8bb18565e59a91ef7f9de6027f0b869a1d0f962124572183c9"
Jul 27 19:30:20.840801 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:20.840771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:20.942008 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:20.941971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:21.085363 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:21.085329    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"]
Jul 27 19:30:21.085654 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:21.085599    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy" containerID="cri-o://aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47" gracePeriod=30
Jul 27 19:30:21.112006 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:21.111926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:21.330028 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:21.329989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:26.347730 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.347704    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:30:26.507998 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.507963    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efe03eae-31ed-4bdd-b368-8fb10192616b-istiod-ca-cert\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508006    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-data\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-certs\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-credential-socket\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508097    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-podinfo\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-socket\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508136    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-envoy\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-token\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508201 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d4qc\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-kube-api-access-6d4qc\") pod \"efe03eae-31ed-4bdd-b368-8fb10192616b\" (UID: \"efe03eae-31ed-4bdd-b368-8fb10192616b\") "
Jul 27 19:30:26.508626 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:26.508626 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe03eae-31ed-4bdd-b368-8fb10192616b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:26.508626 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:26.508817 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508661    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-credential-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.508817 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508679    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-socket\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.508817 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508693    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efe03eae-31ed-4bdd-b368-8fb10192616b-istiod-ca-cert\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.508817 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508805    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:26.509019 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.508945    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-data" (OuterVolumeSpecName: "istio-data") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:26.510644 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.510617    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-token" (OuterVolumeSpecName: "istio-token") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:26.510804 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.510726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:26.511029 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.511006    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-kube-api-access-6d4qc" (OuterVolumeSpecName: "kube-api-access-6d4qc") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "kube-api-access-6d4qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:26.511207 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.511187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "efe03eae-31ed-4bdd-b368-8fb10192616b" (UID: "efe03eae-31ed-4bdd-b368-8fb10192616b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:30:26.609569 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.609534    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-workload-certs\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.609569 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.609562    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-podinfo\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.609569 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.609570    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-envoy\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.609569 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.609579    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-token\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.609916 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.609586    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d4qc\" (UniqueName: \"kubernetes.io/projected/efe03eae-31ed-4bdd-b368-8fb10192616b-kube-api-access-6d4qc\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.609916 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.609595    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efe03eae-31ed-4bdd-b368-8fb10192616b-istio-data\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:26.615243 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.615215    2578 generic.go:356] "Generic (PLEG): container finished" podID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerID="aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47" exitCode=0
Jul 27 19:30:26.615384 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.615264    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"
Jul 27 19:30:26.615384 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.615300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" event={"ID":"efe03eae-31ed-4bdd-b368-8fb10192616b","Type":"ContainerDied","Data":"aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47"}
Jul 27 19:30:26.615384 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.615354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5" event={"ID":"efe03eae-31ed-4bdd-b368-8fb10192616b","Type":"ContainerDied","Data":"6030f431ee254c453ef2e0543e26b41f6bab4d76f39014053c4ee4ebab26d1b2"}
Jul 27 19:30:26.615384 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.615377    2578 scope.go:117] "RemoveContainer" containerID="aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47"
Jul 27 19:30:26.625565 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.625546    2578 scope.go:117] "RemoveContainer" containerID="cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca"
Jul 27 19:30:26.634255 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.634232    2578 scope.go:117] "RemoveContainer" containerID="aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47"
Jul 27 19:30:26.634563 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:30:26.634543    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47\": container with ID starting with aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47 not found: ID does not exist" containerID="aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47"
Jul 27 19:30:26.634632 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.634575    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47"} err="failed to get container status \"aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47\": rpc error: code = NotFound desc = could not find container \"aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47\": container with ID starting with aa1a85ee6fcbd6c6140e7759ccce10631b96c7b7b334671e241a4aaedd0e7e47 not found: ID does not exist"
Jul 27 19:30:26.634632 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.634597    2578 scope.go:117] "RemoveContainer" containerID="cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca"
Jul 27 19:30:26.634978 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:30:26.634954    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca\": container with ID starting with cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca not found: ID does not exist" containerID="cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca"
Jul 27 19:30:26.635102 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.634981    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca"} err="failed to get container status \"cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca\": rpc error: code = NotFound desc = could not find container \"cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca\": container with ID starting with cf9a2bac93fe1896284bac87b993a0a1620167ba18da2dcf783e901ff9458dca not found: ID does not exist"
Jul 27 19:30:26.640144 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.640119    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"]
Jul 27 19:30:26.644460 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:26.644437    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-de344b-openshift-default-79f565d56-9jnm5"]
Jul 27 19:30:27.846403 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:27.846371    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" path="/var/lib/kubelet/pods/efe03eae-31ed-4bdd-b368-8fb10192616b/volumes"
Jul 27 19:30:32.741668 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:32.741633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:32.763647 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:32.763594    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"]
Jul 27 19:30:32.764418 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:32.763927    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5" podUID="647f9fed-7fd4-458e-b5b4-66448332caf3" containerName="payload-processing" containerID="cri-o://3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad" gracePeriod=30
Jul 27 19:30:32.841048 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:32.841016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:32.909220 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:32.909051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:33.027196 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.027170    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:30:33.065494 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.065466    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647f9fed-7fd4-458e-b5b4-66448332caf3-plugins-config-volume\") pod \"647f9fed-7fd4-458e-b5b4-66448332caf3\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") "
Jul 27 19:30:33.065688 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.065508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6bct\" (UniqueName: \"kubernetes.io/projected/647f9fed-7fd4-458e-b5b4-66448332caf3-kube-api-access-z6bct\") pod \"647f9fed-7fd4-458e-b5b4-66448332caf3\" (UID: \"647f9fed-7fd4-458e-b5b4-66448332caf3\") "
Jul 27 19:30:33.065908 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.065885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/647f9fed-7fd4-458e-b5b4-66448332caf3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "647f9fed-7fd4-458e-b5b4-66448332caf3" (UID: "647f9fed-7fd4-458e-b5b4-66448332caf3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:30:33.067703 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.067681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647f9fed-7fd4-458e-b5b4-66448332caf3-kube-api-access-z6bct" (OuterVolumeSpecName: "kube-api-access-z6bct") pod "647f9fed-7fd4-458e-b5b4-66448332caf3" (UID: "647f9fed-7fd4-458e-b5b4-66448332caf3"). InnerVolumeSpecName "kube-api-access-z6bct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:33.166577 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.166543    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647f9fed-7fd4-458e-b5b4-66448332caf3-plugins-config-volume\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:33.166577 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.166571    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6bct\" (UniqueName: \"kubernetes.io/projected/647f9fed-7fd4-458e-b5b4-66448332caf3-kube-api-access-z6bct\") on node \"ip-10-0-140-183.ec2.internal\" DevicePath \"\""
Jul 27 19:30:33.651537 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.651503    2578 generic.go:356] "Generic (PLEG): container finished" podID="647f9fed-7fd4-458e-b5b4-66448332caf3" containerID="3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad" exitCode=0
Jul 27 19:30:33.651768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.651548    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"
Jul 27 19:30:33.651768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.651598    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5" event={"ID":"647f9fed-7fd4-458e-b5b4-66448332caf3","Type":"ContainerDied","Data":"3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad"}
Jul 27 19:30:33.651768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.651655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5" event={"ID":"647f9fed-7fd4-458e-b5b4-66448332caf3","Type":"ContainerDied","Data":"2a295f3c4376eb5fcfa8d1ec407eb9ce685a26626bf5acbced6b6734ac870a00"}
Jul 27 19:30:33.651768 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.651685    2578 scope.go:117] "RemoveContainer" containerID="3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad"
Jul 27 19:30:33.661429 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.661405    2578 scope.go:117] "RemoveContainer" containerID="3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad"
Jul 27 19:30:33.661729 ip-10-0-140-183 kubenswrapper[2578]: E0727 19:30:33.661709    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad\": container with ID starting with 3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad not found: ID does not exist" containerID="3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad"
Jul 27 19:30:33.661817 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.661755    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad"} err="failed to get container status \"3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad\": rpc error: code = NotFound desc = could not find container \"3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad\": container with ID starting with 3ba1580fa91ee984436dc5b5747cef3e524876e195adc557632d303b3292daad not found: ID does not exist"
Jul 27 19:30:33.673194 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.673166    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"]
Jul 27 19:30:33.678022 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.677988    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ab99e9-5579cb4d86-dzgt5"]
Jul 27 19:30:33.846057 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:33.846025    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="647f9fed-7fd4-458e-b5b4-66448332caf3" path="/var/lib/kubelet/pods/647f9fed-7fd4-458e-b5b4-66448332caf3/volumes"
Jul 27 19:30:36.561799 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:36.561769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:36.921161 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:36.921124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:43.023543 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:43.023507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:43.124796 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:43.124763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:43.398125 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:43.398092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:43.523049 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:43.523021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:49.380096 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:49.380068    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fcbb5cd48-rhxst_49acff4f-4b4c-496b-bc02-3db361ca992b/manager/0.log"
Jul 27 19:30:49.981955 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:49.981927    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-zz254_8747b503-f35e-480d-aba1-89de1923d6b9/copy-manifests/0.log"
Jul 27 19:30:49.988065 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:49.988044    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-zz254_8747b503-f35e-480d-aba1-89de1923d6b9/manager/0.log"
Jul 27 19:30:50.308356 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:50.308276    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-557776f786-xjmbc_c8cb1cc8-b10e-4f90-8a52-9d5482e12efe/maas-api/0.log"
Jul 27 19:30:50.417408 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:50.417376    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rszr2_50f3fd04-abf4-4418-be58-e2c1a88c35d6/postgres/0.log"
Jul 27 19:30:52.913411 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:52.913378    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zqnk6_3a36e35a-dce3-4736-9a58-78379134614e/discovery/0.log"
Jul 27 19:30:53.245776 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:53.245680    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wl9sv_3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8/istio-proxy/1.log"
Jul 27 19:30:53.359262 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:53.359229    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tzknq_cf1aadb2-c3ce-4244-8f65-4964210b4656/payload-pre-processing/0.log"
Jul 27 19:30:53.475485 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:53.475456    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xkcqj_0831ed87-7c67-4a74-aabb-de74e5f11230/payload-processing/0.log"
Jul 27 19:30:54.027920 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:54.027892    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-njdwt_da650cd3-5d88-48af-85c0-1c9ce13b3813/main/0.log"
Jul 27 19:30:54.246701 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:54.246672    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9rxh9_0a65e7ff-0fbc-4d71-9b03-4b9ecf77949c/main/0.log"
Jul 27 19:30:59.468516 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:59.468477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:30:59.573098 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:30:59.573056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:31:02.342426 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:02.342396    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tz4mt_de4b30cd-714b-41c3-b773-df50158ef8b0/global-pull-secret-syncer/0.log"
Jul 27 19:31:02.435500 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:02.435467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log"
Jul 27 19:31:02.581213 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:02.581183    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-183.ec2.internal_599976f5344e0a57673ed671b42428c7/haproxy/0.log"
Jul 27 19:31:09.174939 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.174913    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48b07cac-468f-4fc5-8d71-10b42e6bb5d7/alertmanager/0.log"
Jul 27 19:31:09.198697 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.198669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48b07cac-468f-4fc5-8d71-10b42e6bb5d7/config-reloader/0.log"
Jul 27 19:31:09.219954 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.219924    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48b07cac-468f-4fc5-8d71-10b42e6bb5d7/kube-rbac-proxy-web/0.log"
Jul 27 19:31:09.244605 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.244575    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48b07cac-468f-4fc5-8d71-10b42e6bb5d7/kube-rbac-proxy/0.log"
Jul 27 19:31:09.270732 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.270712    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48b07cac-468f-4fc5-8d71-10b42e6bb5d7/kube-rbac-proxy-metric/0.log"
Jul 27 19:31:09.300222 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.300192    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48b07cac-468f-4fc5-8d71-10b42e6bb5d7/prom-label-proxy/0.log"
Jul 27 19:31:09.322667 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.322644    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48b07cac-468f-4fc5-8d71-10b42e6bb5d7/init-config-reloader/0.log"
Jul 27 19:31:09.719354 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.719322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bdvsb_3dd006ff-488c-4726-8240-285e5eeb1039/node-exporter/0.log"
Jul 27 19:31:09.786672 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.786642    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bdvsb_3dd006ff-488c-4726-8240-285e5eeb1039/kube-rbac-proxy/0.log"
Jul 27 19:31:09.810241 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.810224    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bdvsb_3dd006ff-488c-4726-8240-285e5eeb1039/init-textfile/0.log"
Jul 27 19:31:09.997074 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:09.997045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11b85bba-2689-4d5f-958f-bf0ec35a32a1/prometheus/0.log"
Jul 27 19:31:10.024114 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:10.024092    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11b85bba-2689-4d5f-958f-bf0ec35a32a1/config-reloader/0.log"
Jul 27 19:31:10.047166 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:10.047139    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11b85bba-2689-4d5f-958f-bf0ec35a32a1/thanos-sidecar/0.log"
Jul 27 19:31:10.069876 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:10.069844    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11b85bba-2689-4d5f-958f-bf0ec35a32a1/kube-rbac-proxy-web/0.log"
Jul 27 19:31:10.094125 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:10.094094    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11b85bba-2689-4d5f-958f-bf0ec35a32a1/kube-rbac-proxy/0.log"
Jul 27 19:31:10.119979 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:10.119909    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11b85bba-2689-4d5f-958f-bf0ec35a32a1/kube-rbac-proxy-thanos/0.log"
Jul 27 19:31:10.144042 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:10.144017    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11b85bba-2689-4d5f-958f-bf0ec35a32a1/init-config-reloader/0.log"
Jul 27 19:31:10.222513 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:10.222431    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-s6v72_7e801566-d2c6-4032-8673-3d3585d3e5b0/prometheus-operator-admission-webhook/0.log"
Jul 27 19:31:12.796877 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.796845    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"]
Jul 27 19:31:12.797271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797205    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d068a63e-d7c1-45f0-bf00-d261479485b7" containerName="maas-api"
Jul 27 19:31:12.797271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797218    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d068a63e-d7c1-45f0-bf00-d261479485b7" containerName="maas-api"
Jul 27 19:31:12.797271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797235    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy"
Jul 27 19:31:12.797271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797244    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy"
Jul 27 19:31:12.797271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797255    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy"
Jul 27 19:31:12.797271 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797261    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797274    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797281    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797288    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52dedd26-cff4-4c26-af6e-b64ccbd4b039" containerName="payload-pre-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797294    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="52dedd26-cff4-4c26-af6e-b64ccbd4b039" containerName="payload-pre-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797300    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c81214-44bf-4756-ba93-4b356973e800" containerName="maas-api"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797305    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c81214-44bf-4756-ba93-4b356973e800" containerName="maas-api"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797315    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec1a243f-1a7b-4e92-ae2a-21c495954a38" containerName="payload-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797320    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec1a243f-1a7b-4e92-ae2a-21c495954a38" containerName="payload-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797326    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647f9fed-7fd4-458e-b5b4-66448332caf3" containerName="payload-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797331    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="647f9fed-7fd4-458e-b5b4-66448332caf3" containerName="payload-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797338    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ee3e60-465b-48e1-b9ab-335d431597a0" containerName="payload-pre-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797343    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ee3e60-465b-48e1-b9ab-335d431597a0" containerName="payload-pre-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797349    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c02c11-17b4-4081-81dc-33504272dfd3" containerName="maas-api"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797353    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c02c11-17b4-4081-81dc-33504272dfd3" containerName="maas-api"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797362    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27aea398-2c8e-4327-8959-1e303892b2e2" containerName="payload-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797367    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27aea398-2c8e-4327-8959-1e303892b2e2" containerName="payload-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797372    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797378    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797457    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec1a243f-1a7b-4e92-ae2a-21c495954a38" containerName="payload-processing"
Jul 27 19:31:12.797463 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797464    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="647f9fed-7fd4-458e-b5b4-66448332caf3" containerName="payload-processing"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797470    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c02c11-17b4-4081-81dc-33504272dfd3" containerName="maas-api"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797481    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27aea398-2c8e-4327-8959-1e303892b2e2" containerName="payload-processing"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797489    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797494    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="52dedd26-cff4-4c26-af6e-b64ccbd4b039" containerName="payload-pre-processing"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797498    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797503    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d068a63e-d7c1-45f0-bf00-d261479485b7" containerName="maas-api"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797508    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9c81214-44bf-4756-ba93-4b356973e800" containerName="maas-api"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797514    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e564735-59ea-40d0-b085-eb2b2b5bc47e" containerName="istio-proxy"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797520    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe03eae-31ed-4bdd-b368-8fb10192616b" containerName="istio-proxy"
Jul 27 19:31:12.798218 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.797525    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ee3e60-465b-48e1-b9ab-335d431597a0" containerName="payload-pre-processing"
Jul 27 19:31:12.800460 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.800443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:12.802821 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.802785    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdk7g\"/\"openshift-service-ca.crt\""
Jul 27 19:31:12.802989 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.802890    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdk7g\"/\"kube-root-ca.crt\""
Jul 27 19:31:12.803078 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.803018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jdk7g\"/\"default-dockercfg-tdhxf\""
Jul 27 19:31:12.808927 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.808902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"]
Jul 27 19:31:12.929169 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.929137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-podres\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:12.929354 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.929193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-sys\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:12.929354 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.929214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt6dl\" (UniqueName: \"kubernetes.io/projected/b0d43193-dbb3-4c43-9925-0df2b465a874-kube-api-access-xt6dl\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:12.929354 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.929291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-proc\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:12.929354 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:12.929327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-lib-modules\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-sys\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030131 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt6dl\" (UniqueName: \"kubernetes.io/projected/b0d43193-dbb3-4c43-9925-0df2b465a874-kube-api-access-xt6dl\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030372 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-proc\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030372 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-sys\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030372 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-lib-modules\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030480 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-lib-modules\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030480 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-proc\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030480 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-podres\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.030593 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.030488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0d43193-dbb3-4c43-9925-0df2b465a874-podres\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.038878 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.038843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt6dl\" (UniqueName: \"kubernetes.io/projected/b0d43193-dbb3-4c43-9925-0df2b465a874-kube-api-access-xt6dl\") pod \"perf-node-gather-daemonset-cxwld\" (UID: \"b0d43193-dbb3-4c43-9925-0df2b465a874\") " pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.111936 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.111838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.248320 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.248293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"]
Jul 27 19:31:13.250130 ip-10-0-140-183 kubenswrapper[2578]: W0727 19:31:13.250101    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb0d43193_dbb3_4c43_9925_0df2b465a874.slice/crio-1cd1683a18fdc201a58e252c198e5d0e71a27a4ffb37b6b612deecea8fb5ca63 WatchSource:0}: Error finding container 1cd1683a18fdc201a58e252c198e5d0e71a27a4ffb37b6b612deecea8fb5ca63: Status 404 returned error can't find the container with id 1cd1683a18fdc201a58e252c198e5d0e71a27a4ffb37b6b612deecea8fb5ca63
Jul 27 19:31:13.760386 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.760361    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-6km22_8a4246af-5408-48ea-b7a9-e5b279467391/volume-data-source-validator/0.log"
Jul 27 19:31:13.852726 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.852690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld" event={"ID":"b0d43193-dbb3-4c43-9925-0df2b465a874","Type":"ContainerStarted","Data":"72008668bad5375bc407fc168eddf12150941ff76df4941ece1942cf8240b5c0"}
Jul 27 19:31:13.853217 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.852900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:13.853217 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.852946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld" event={"ID":"b0d43193-dbb3-4c43-9925-0df2b465a874","Type":"ContainerStarted","Data":"1cd1683a18fdc201a58e252c198e5d0e71a27a4ffb37b6b612deecea8fb5ca63"}
Jul 27 19:31:13.871391 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:13.871336    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld" podStartSLOduration=1.871320897 podStartE2EDuration="1.871320897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:13.868684263 +0000 UTC m=+3598.621478696" watchObservedRunningTime="2026-07-27 19:31:13.871320897 +0000 UTC m=+3598.624115316"
Jul 27 19:31:14.868830 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:14.868796    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xkv5j_9df4217e-b5e2-4b6d-8238-628f5f776e02/dns/0.log"
Jul 27 19:31:14.888773 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:14.888729    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xkv5j_9df4217e-b5e2-4b6d-8238-628f5f776e02/kube-rbac-proxy/0.log"
Jul 27 19:31:14.957528 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:14.957487    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rmw5t_830bcb19-c11b-4ee5-937f-a73e2a9dd471/dns-node-resolver/0.log"
Jul 27 19:31:15.577612 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:15.577573    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6m7b_bb04b79a-b40e-442e-a47b-305589da104b/node-ca/0.log"
Jul 27 19:31:16.733051 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:16.733015    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zqnk6_3a36e35a-dce3-4736-9a58-78379134614e/discovery/0.log"
Jul 27 19:31:16.891896 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:16.891864    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wl9sv_3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8/istio-proxy/0.log"
Jul 27 19:31:16.918358 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:16.918328    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wl9sv_3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8/istio-proxy/1.log"
Jul 27 19:31:16.982605 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:16.982570    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tzknq_cf1aadb2-c3ce-4244-8f65-4964210b4656/payload-pre-processing/0.log"
Jul 27 19:31:17.039350 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:17.039238    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xkcqj_0831ed87-7c67-4a74-aabb-de74e5f11230/payload-processing/0.log"
Jul 27 19:31:17.940688 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:17.940658    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-52gct_0643253c-9b39-4111-889a-784b29c45810/serve-healthcheck-canary/0.log"
Jul 27 19:31:18.498306 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:18.498273    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cknmb_6c727ac3-12c3-4601-ac01-2de59f4e13e0/kube-rbac-proxy/0.log"
Jul 27 19:31:18.518057 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:18.518032    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cknmb_6c727ac3-12c3-4601-ac01-2de59f4e13e0/exporter/0.log"
Jul 27 19:31:18.542328 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:18.542303    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cknmb_6c727ac3-12c3-4601-ac01-2de59f4e13e0/extractor/0.log"
Jul 27 19:31:19.867146 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:19.867118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jdk7g/perf-node-gather-daemonset-cxwld"
Jul 27 19:31:21.286061 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:21.286025    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fcbb5cd48-rhxst_49acff4f-4b4c-496b-bc02-3db361ca992b/manager/0.log"
Jul 27 19:31:21.633983 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:21.633944    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-zz254_8747b503-f35e-480d-aba1-89de1923d6b9/manager/0.log"
Jul 27 19:31:21.658043 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:21.658017    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfd8c75b7-zz254_8747b503-f35e-480d-aba1-89de1923d6b9/copy-manifests/0.log"
Jul 27 19:31:23.107249 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:23.107222    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c45656c54-qgsmm_224bbe5a-546a-4612-adb2-142fd4619c15/manager/0.log"
Jul 27 19:31:23.502660 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:23.502605    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zqnk6_3a36e35a-dce3-4736-9a58-78379134614e/discovery/0.log"
Jul 27 19:31:23.554663 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:23.554631    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wl9sv_3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8/istio-proxy/0.log"
Jul 27 19:31:23.581364 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:23.581336    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wl9sv_3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8/istio-proxy/1.log"
Jul 27 19:31:23.601125 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:23.601093    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tzknq_cf1aadb2-c3ce-4244-8f65-4964210b4656/payload-pre-processing/0.log"
Jul 27 19:31:23.620890 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:23.620858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xkcqj_0831ed87-7c67-4a74-aabb-de74e5f11230/payload-processing/0.log"
Jul 27 19:31:25.204312 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:25.204281    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zqnk6_3a36e35a-dce3-4736-9a58-78379134614e/discovery/0.log"
Jul 27 19:31:25.255615 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:25.255588    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wl9sv_3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8/istio-proxy/0.log"
Jul 27 19:31:25.284629 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:25.284592    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-wl9sv_3f9367c4-d8fb-43a8-9213-0ea8c73cd7c8/istio-proxy/1.log"
Jul 27 19:31:25.307374 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:25.307338    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tzknq_cf1aadb2-c3ce-4244-8f65-4964210b4656/payload-pre-processing/0.log"
Jul 27 19:31:25.327958 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:25.327934    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xkcqj_0831ed87-7c67-4a74-aabb-de74e5f11230/payload-processing/0.log"
Jul 27 19:31:28.147080 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:28.147051    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bpws7_c65f77d4-a224-40cc-8408-95a68a6b5f2e/migrator/0.log"
Jul 27 19:31:28.174890 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:28.174868    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bpws7_c65f77d4-a224-40cc-8408-95a68a6b5f2e/graceful-termination/0.log"
Jul 27 19:31:29.539336 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:29.539307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-94l5z_d8357e81-06b2-4de5-ab63-c892670eb034/kube-multus/0.log"
Jul 27 19:31:29.824613 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:29.824533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:31:29.896141 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:29.896111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6x5c9_661a9910-3e3e-4f30-98e9-94af99114f60/konnectivity-agent/0.log" limit=1024
Jul 27 19:31:29.928375 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:29.928347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rm94j_9c7f4a92-e49c-4746-9c75-456db03d8e80/kube-multus-additional-cni-plugins/0.log"
Jul 27 19:31:29.948412 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:29.948384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rm94j_9c7f4a92-e49c-4746-9c75-456db03d8e80/egress-router-binary-copy/0.log"
Jul 27 19:31:29.968641 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:29.968620    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rm94j_9c7f4a92-e49c-4746-9c75-456db03d8e80/cni-plugins/0.log"
Jul 27 19:31:29.991687 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:29.991664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rm94j_9c7f4a92-e49c-4746-9c75-456db03d8e80/bond-cni-plugin/0.log"
Jul 27 19:31:30.015662 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:30.015637    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rm94j_9c7f4a92-e49c-4746-9c75-456db03d8e80/routeoverride-cni/0.log"
Jul 27 19:31:30.038585 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:30.038562    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rm94j_9c7f4a92-e49c-4746-9c75-456db03d8e80/whereabouts-cni-bincopy/0.log"
Jul 27 19:31:30.062094 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:30.062068    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rm94j_9c7f4a92-e49c-4746-9c75-456db03d8e80/whereabouts-cni/0.log"
Jul 27 19:31:30.149010 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:30.148985    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-blpjc_2cf845a2-262b-48ee-9bac-2211c75c10f0/network-metrics-daemon/0.log"
Jul 27 19:31:30.176540 ip-10-0-140-183 kubenswrapper[2578]: I0727 19:31:30.176518    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-blpjc_2cf845a2-262b-48ee-9bac-2211c75c10f0/kube-rbac-proxy/0.log"