Jul 24 19:32:34.164336 ip-10-0-140-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 19:32:34.164350 ip-10-0-140-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 19:32:34.164359 ip-10-0-140-118 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 19:32:34.164790 ip-10-0-140-118 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 19:32:44.337946 ip-10-0-140-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 19:32:44.337967 ip-10-0-140-118 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ffa814637fd54a0fb76becf3822da3c9 --
Jul 24 19:34:19.745132 ip-10-0-140-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 19:34:20.198760 ip-10-0-140-118 kubenswrapper[2541]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:34:20.198760 ip-10-0-140-118 kubenswrapper[2541]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 19:34:20.198760 ip-10-0-140-118 kubenswrapper[2541]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:34:20.198760 ip-10-0-140-118 kubenswrapper[2541]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 19:34:20.198760 ip-10-0-140-118 kubenswrapper[2541]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:34:20.201504 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.201401    2541 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 19:34:20.208274 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208251    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:20.208274 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208271    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:20.208274 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208275    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:20.208274 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208278    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208282    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208284    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208287    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208291    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208294    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208297    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208300    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208302    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208307    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208311    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208325    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208329    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208331    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208334    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208337    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208339    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208342    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208345    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208347    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:20.208403 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208349    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208352    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208354    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208357    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208360    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208364    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208368    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208371    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208374    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208377    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208380    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208382    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208387    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208390    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208393    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208396    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208399    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208402    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208404    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:20.208901 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208407    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208410    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208412    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208415    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208418    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208421    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208424    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208426    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208429    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208432    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208435    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208438    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208440    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208442    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208445    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208447    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208450    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208452    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208455    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:20.209355 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208457    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208460    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208463    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208465    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208468    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208471    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208473    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208476    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208479    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208482    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208485    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208488    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208491    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208493    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208496    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208498    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208500    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208503    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208505    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208508    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:20.209832 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208510    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208513    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208515    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208518    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208520    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208523    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208525    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208528    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208530    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208533    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208535    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208538    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208540    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208543    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208546    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208549    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208552    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.208556    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209317    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209324    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:20.210372 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209328    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209331    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209334    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209337    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209340    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209343    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209345    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209348    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209350    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209353    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209356    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209359    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209362    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209365    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209368    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209370    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209373    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209375    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209378    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209381    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:20.210884 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209384    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209386    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209390    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209395    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209398    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209401    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209404    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209406    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209409    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209412    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209415    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209418    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209421    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209424    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209426    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209429    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209431    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209434    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209436    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:20.211392 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209440    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209443    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209445    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209448    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209450    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209453    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209456    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209458    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209461    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209463    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209466    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209468    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209471    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209474    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209476    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209479    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209481    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209484    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209487    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209489    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:20.211889 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209492    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209495    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209497    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209500    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209503    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209506    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209509    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209511    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209513    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209516    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209519    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209521    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209524    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209526    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209529    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209531    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209533    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209536    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209538    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209541    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:20.212373 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209544    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209546    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209549    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209551    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209553    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209556    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209558    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209562    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209566    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209570    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209573    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209576    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209579    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209582    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209584    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209587    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209590    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.209592    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210014    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:20.212882 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210020    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210023    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210026    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210029    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210032    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210034    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210037    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210040    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210042    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210045    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210048    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210050    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210053    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210056    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210059    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210062    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210064    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210067    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210070    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210074    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:20.213341 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210077    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210079    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210082    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210085    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210088    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210091    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210093    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210096    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210098    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210101    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210104    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210107    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210109    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210111    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210114    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210116    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210119    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210121    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210124    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210126    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:20.213840 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210130    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210132    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210135    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210137    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210140    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210143    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210145    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210148    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210150    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210153    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210155    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210158    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210160    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210163    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210165    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210169    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210171    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210174    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210178    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:20.214346 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210181    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210184    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210186    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210189    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210192    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210195    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210198    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210201    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210203    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210206    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210209    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210211    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210214    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210216    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210218    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210221    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210224    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210227    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210229    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210232    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:20.214846 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210235    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210237    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210240    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210242    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210244    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210247    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210249    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210252    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210255    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210257    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210260    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210262    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210265    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210267    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210270    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210273    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210276    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210278    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.210282    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210366    2541 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 19:34:20.215367 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210374    2541 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210381    2541 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210386    2541 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210391    2541 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210395    2541 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210399    2541 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210404    2541 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210407    2541 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210410    2541 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210414    2541 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210417    2541 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210421    2541 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210425    2541 flags.go:64] FLAG: --cgroup-root=""
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210428    2541 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210431    2541 flags.go:64] FLAG: --client-ca-file=""
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210434    2541 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210437    2541 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210442    2541 flags.go:64] FLAG: --cluster-domain=""
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210445    2541 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210449    2541 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210452    2541 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210455    2541 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210459    2541 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 19:34:20.215888 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210462    2541 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210465    2541 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210468    2541 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210471    2541 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210475    2541 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210478    2541 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210482    2541 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210485    2541 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210490    2541 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210493    2541 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210495    2541 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210498    2541 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210501    2541 flags.go:64] FLAG: --enable-server="true"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210504    2541 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210509    2541 flags.go:64] FLAG: --event-burst="100"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210512    2541 flags.go:64] FLAG: --event-qps="50"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210515    2541 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210518    2541 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210521    2541 flags.go:64] FLAG: --eviction-hard=""
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210525    2541 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210528    2541 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210531    2541 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210535    2541 flags.go:64] FLAG: --eviction-soft=""
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210538    2541 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210540    2541 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 19:34:20.216442 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210544    2541 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210546    2541 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210549    2541 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210552    2541 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210555    2541 flags.go:64] FLAG: --feature-gates=""
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210560    2541 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210562    2541 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210565    2541 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210568    2541 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210571    2541 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210575    2541 flags.go:64] FLAG: --help="false"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210577    2541 flags.go:64] FLAG: --hostname-override="ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210581    2541 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210584    2541 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210587    2541 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210590    2541 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210594    2541 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210597    2541 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210600    2541 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210603    2541 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210606    2541 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210609    2541 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210612    2541 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210615    2541 flags.go:64] FLAG: --kube-reserved=""
Jul 24 19:34:20.217156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210617    2541 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210620    2541 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210623    2541 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210626    2541 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210629    2541 flags.go:64] FLAG: --lock-file=""
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210632    2541 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210637    2541 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210640    2541 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210646    2541 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210649    2541 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210652    2541 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210654    2541 flags.go:64] FLAG: --logging-format="text"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210657    2541 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210661    2541 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210664    2541 flags.go:64] FLAG: --manifest-url=""
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210667    2541 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210671    2541 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210674    2541 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210678    2541 flags.go:64] FLAG: --max-pods="110"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210682    2541 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210684    2541 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210687    2541 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210690    2541 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210694    2541 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210697    2541 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 19:34:20.217913 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210699    2541 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210707    2541 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210709    2541 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210712    2541 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210715    2541 flags.go:64] FLAG: --pod-cidr=""
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210718    2541 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210724    2541 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210727    2541 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210730    2541 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210733    2541 flags.go:64] FLAG: --port="10250"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210736    2541 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210739    2541 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0844c8d21380036b7"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210742    2541 flags.go:64] FLAG: --qos-reserved=""
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210745    2541 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210750    2541 flags.go:64] FLAG: --register-node="true"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210753    2541 flags.go:64] FLAG: --register-with-taints=""
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210757    2541 flags.go:64] FLAG: --registry-burst="10"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210760    2541 flags.go:64] FLAG: --registry-qps="5"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210762    2541 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210779    2541 flags.go:64] FLAG: --reserved-memory=""
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210782    2541 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210786    2541 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210789    2541 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210792    2541 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210796    2541 flags.go:64] FLAG: --runonce="false"
Jul 24 19:34:20.218581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210798    2541 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210803    2541 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210806    2541 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210809    2541 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210812    2541 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210815    2541 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210818    2541 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210822    2541 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210824    2541 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210827    2541 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210830    2541 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210833    2541 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210836    2541 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210840    2541 flags.go:64] FLAG: --system-cgroups=""
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210842    2541 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210848    2541 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210851    2541 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210853    2541 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210858    2541 flags.go:64] FLAG: --tls-min-version=""
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210861    2541 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210863    2541 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210867    2541 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210871    2541 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210874    2541 flags.go:64] FLAG: --v="2"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210879    2541 flags.go:64] FLAG: --version="false"
Jul 24 19:34:20.219252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210883    2541 flags.go:64] FLAG: --vmodule=""
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210886    2541 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.210890    2541 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211008    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211013    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211017    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211020    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211023    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211028    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211030    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211033    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211036    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211038    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211041    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211044    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211047    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211050    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211052    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211055    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:20.220172 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211057    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211060    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211062    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211065    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211068    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211070    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211073    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211075    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211078    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211082    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211085    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211088    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211091    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211093    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211096    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211099    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211101    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211104    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211107    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211109    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:20.220918 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211112    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211116    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211120    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211122    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211125    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211128    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211131    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211134    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211137    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211139    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211142    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211145    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211149    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211152    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211154    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211157    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211159    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211162    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211164    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:20.221528 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211167    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211169    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211173    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211184    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211187    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211191    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211194    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211197    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211200    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211202    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211205    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211208    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211210    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211213    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211217    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211220    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211223    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211225    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211228    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:20.222078 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211230    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211233    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211236    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211238    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211241    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211243    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211246    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211248    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211251    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211253    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211256    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211260    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211263    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211266    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211269    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211273    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211276    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211279    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211282    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211286    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:20.222571 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211288    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211291    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211294    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211296    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.211299    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.212060    2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.221987    2541 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.222008    2541 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.222036    2541 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.222043    2541 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222106    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222112    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222115    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222118    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222121    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:20.223187 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222125    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222129    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222132    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222135    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222138    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222141    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222143    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222146    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222148    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222151    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222154    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222157    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222159    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222162    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222164    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222167    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222171    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222173    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222176    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222179    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:20.223556 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222182    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222185    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222187    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222190    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222193    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222196    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222198    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222201    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222204    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222206    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222209    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222212    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222214    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222217    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222220    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222222    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222226    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222230    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222233    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:20.224066 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222235    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222238    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222241    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222243    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222246    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222249    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222251    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222254    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222257    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222259    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222262    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222265    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222268    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222271    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222275    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222278    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222282    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222285    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222288    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222291    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:20.224533 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222294    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222297    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222300    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222303    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222305    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222308    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222311    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222313    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222316    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222318    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222321    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222324    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222327    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222329    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222332    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222335    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222339    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222342    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222345    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222348    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:20.225041 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222351    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222353    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222356    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222359    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222362    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222365    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222368    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222370    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222373    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222377    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222379    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222382    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222384    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222388    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222391    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:20.225586 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.222396    2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222541    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222546    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222549    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222553    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222556    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222558    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222561    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222564    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222567    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222570    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222573    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222576    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222579    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222582    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222585    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222588    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222591    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222593    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222596    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:20.226014 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222599    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222601    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222604    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222606    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222609    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222611    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222615    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222618    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222620    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222622    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222625    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222628    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222630    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222633    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222635    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222638    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222641    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222643    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222646    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:20.226495 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222648    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222651    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222653    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222656    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222658    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222661    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222664    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222667    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222670    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222672    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222675    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222678    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222682    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222685    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222688    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222690    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222693    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222696    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222698    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222701    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:20.226976 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222704    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222706    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222709    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222712    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222714    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222717    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222720    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222722    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222725    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222727    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222731    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222734    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222737    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222740    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222743    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222745    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222748    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222750    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222753    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:20.227472 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222755    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222758    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222761    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222778    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222783    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222786    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222788    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222791    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222794    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222797    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222799    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222802    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222805    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222807    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222810    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222813    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222815    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222819    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222823    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:20.227943 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222826    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:20.228397 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222829    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:20.228397 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:20.222832    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:20.228397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.222836    2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:34:20.228397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.222978    2541 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 19:34:20.363036 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.363006    2541 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 19:34:20.365012 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.364996    2541 server.go:1019] "Starting client certificate rotation"
Jul 24 19:34:20.365132 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.365110    2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:34:20.365201 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.365168    2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:34:20.367961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.367941    2541 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:34:20.371309 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.371282    2541 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:34:20.381351 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.381326    2541 log.go:25] "Validated CRI v1 runtime API"
Jul 24 19:34:20.384176 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.384158    2541 log.go:25] "Validated CRI v1 image API"
Jul 24 19:34:20.385063 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.385036    2541 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 19:34:20.387924 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.387900    2541 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 dd70ba57-3ed1-417f-8082-a40580e47804:/dev/nvme0n1p3 ea31f244-1f1f-43a5-9aff-68b43be131ce:/dev/nvme0n1p4]
Jul 24 19:34:20.388047 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.387924    2541 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 19:34:20.395322 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.395147    2541 manager.go:216] Machine: {Timestamp:2026-07-24 19:34:20.393496274 +0000 UTC m=+0.517835423 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3128521 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b16a2af730545b5980f9fc7f0125a SystemUUID:ec2b16a2-af73-0545-b598-0f9fc7f0125a BootID:ffa81463-7fd5-4a0f-b76b-ecf3822da3c9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:59:a6:d5:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:59:a6:d5:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:aa:21:97:a8:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 19:34:20.395322 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.395309    2541 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 19:34:20.395474 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.395425    2541 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 19:34:20.395695 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.395679    2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:34:20.398991 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.398963    2541 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 19:34:20.399140 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.398996    2541 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 19:34:20.399906 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.399894    2541 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 19:34:20.399940 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.399909    2541 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 19:34:20.399940 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.399917    2541 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:34:20.399940 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.399932    2541 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:34:20.401232 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.401221    2541 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 19:34:20.404377 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.404356    2541 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:34:20.404506 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.404496    2541 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 19:34:20.404539 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.404528    2541 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 19:34:20.404539 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.404539    2541 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 19:34:20.404605 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.404550    2541 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 19:34:20.404605 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.404560    2541 kubelet.go:398] "Adding apiserver pod source"
Jul 24 19:34:20.404605 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.404568    2541 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 19:34:20.405061 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.405046    2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:34:20.405127 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.405071    2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:34:20.407665 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.407647    2541 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 19:34:20.410225 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.410211    2541 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 19:34:20.410270 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.410243    2541 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 19:34:20.412344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412331    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 19:34:20.412390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412348    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 19:34:20.412390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412354    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 19:34:20.412390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412360    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 19:34:20.412390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412369    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 19:34:20.412390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412374    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 19:34:20.412390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412383    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 19:34:20.412390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412389    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 19:34:20.412563 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412397    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 19:34:20.412563 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412405    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 19:34:20.412563 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412420    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 19:34:20.412563 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.412426    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 19:34:20.413335 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.413325    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 19:34:20.413335 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.413334    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 19:34:20.416126 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.416106    2541 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 19:34:20.416221 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.416188    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 19:34:20.416312 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.416292    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 19:34:20.416658 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.416645    2541 server.go:1268] "Started kubelet"
Jul 24 19:34:20.416762 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.416730    2541 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 19:34:20.416839 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.416824    2541 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 19:34:20.416942 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.416733    2541 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 19:34:20.417649 ip-10-0-140-118 systemd[1]: Started Kubernetes Kubelet.
Jul 24 19:34:20.419124 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.419107    2541 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 19:34:20.419327 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.419313    2541 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 19:34:20.421676 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.421654    2541 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 19:34:20.423921 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.422798    2541 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-118.ec2.internal.18c550cb110855ae  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-118.ec2.internal,UID:ip-10-0-140-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-118.ec2.internal,},FirstTimestamp:2026-07-24 19:34:20.416611758 +0000 UTC m=+0.540950906,LastTimestamp:2026-07-24 19:34:20.416611758 +0000 UTC m=+0.540950906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-118.ec2.internal,}"
Jul 24 19:34:20.433453 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.433418    2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 19:34:20.433569 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.433427    2541 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 19:34:20.433643 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.433625    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:20.434398 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434374    2541 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 19:34:20.434398 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434396    2541 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 19:34:20.434519 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434409    2541 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 19:34:20.434519 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434490    2541 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 19:34:20.434519 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434502    2541 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 19:34:20.434709 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434693    2541 factory.go:55] Registering systemd factory
Jul 24 19:34:20.434709 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434710    2541 factory.go:223] Registration of the systemd container factory successfully
Jul 24 19:34:20.434961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434948    2541 factory.go:153] Registering CRI-O factory
Jul 24 19:34:20.434961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.434961    2541 factory.go:223] Registration of the crio container factory successfully
Jul 24 19:34:20.435069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.435003    2541 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 19:34:20.435069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.435030    2541 factory.go:103] Registering Raw factory
Jul 24 19:34:20.435069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.435055    2541 manager.go:1196] Started watching for new ooms in manager
Jul 24 19:34:20.435824 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.435803    2541 manager.go:349] Starting recovery of all containers
Jul 24 19:34:20.443919 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.443870    2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 19:34:20.444040 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.444004    2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5c4cv"
Jul 24 19:34:20.446577 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.446545    2541 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 19:34:20.446685 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.446572    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 19:34:20.447628 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.447601    2541 manager.go:354] Recovery completed
Jul 24 19:34:20.449156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.449103    2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5c4cv"
Jul 24 19:34:20.452107 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.452094    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:20.454121 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.453957    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:20.454193 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.454136    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:20.454193 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.454148    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:20.454720 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.454705    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:20.454812 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.454707    2541 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 19:34:20.454812 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.454733    2541 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 19:34:20.454812 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.454748    2541 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:34:20.456456 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.456441    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:20.456536 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.456466    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:20.456536 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.456480    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:20.457491 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.457478    2541 policy_none.go:49] "None policy: Start"
Jul 24 19:34:20.457528 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.457494    2541 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 19:34:20.457528 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.457507    2541 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 19:34:20.459545 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.459533    2541 policy_none.go:47] "Start"
Jul 24 19:34:20.499645 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.499626    2541 manager.go:337] "Starting Device Plugin manager"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.499661    2541 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.499672    2541 server.go:87] "Starting device plugin registration server"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.499981    2541 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.499996    2541 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.500098    2541 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.500169    2541 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.500176    2541 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.500732    2541 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 19:34:20.516758 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.500794    2541 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:20.572695 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.572661    2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 19:34:20.572833 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.572709    2541 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 19:34:20.572833 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.572732    2541 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 19:34:20.572833 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.572775    2541 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 19:34:20.575293 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.575275    2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:20.600224 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.600200    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:20.601192 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.601165    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:20.601265 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.601202    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:20.601265 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.601216    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:20.601265 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.601241    2541 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.612169 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.612149    2541 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.612270 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.612178    2541 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-118.ec2.internal\": node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:20.631173 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.631143    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:20.673536 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.673489    2541 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"]
Jul 24 19:34:20.673653 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.673576    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:20.675192 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.675167    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:20.675294 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.675212    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:20.675294 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.675227    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:20.677556 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.677539    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:20.677655 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.677641    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.677707 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.677673    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:20.678302 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.678285    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:20.678368 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.678317    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:20.678368 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.678328    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:20.678428 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.678285    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:20.678428 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.678391    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:20.678428 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.678409    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:20.680726 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.680712    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.680824 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.680735    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:20.681475 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.681460    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:20.681567 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.681481    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:20.681567 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.681490    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:20.694336 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.694318    2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-118.ec2.internal\" not found" node="ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.698736 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.698718    2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-118.ec2.internal\" not found" node="ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.732290 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.732227    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:20.833494 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.833449    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:20.835897 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.835871    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2361c9c159847def10336548e796fbdb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-118.ec2.internal\" (UID: \"2361c9c159847def10336548e796fbdb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.835973 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.835907    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5440c6100f019cdf70dcd1b74e4583f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"5440c6100f019cdf70dcd1b74e4583f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.835973 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.835927    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5440c6100f019cdf70dcd1b74e4583f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"5440c6100f019cdf70dcd1b74e4583f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.934813 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:20.934757    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:20.936023 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.936002    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2361c9c159847def10336548e796fbdb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-118.ec2.internal\" (UID: \"2361c9c159847def10336548e796fbdb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.936076 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.936030    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5440c6100f019cdf70dcd1b74e4583f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"5440c6100f019cdf70dcd1b74e4583f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.936076 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.936047    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5440c6100f019cdf70dcd1b74e4583f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"5440c6100f019cdf70dcd1b74e4583f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.936154 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.936079    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5440c6100f019cdf70dcd1b74e4583f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"5440c6100f019cdf70dcd1b74e4583f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.936154 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.936098    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2361c9c159847def10336548e796fbdb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-118.ec2.internal\" (UID: \"2361c9c159847def10336548e796fbdb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:20.936154 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:20.936107    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5440c6100f019cdf70dcd1b74e4583f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"5440c6100f019cdf70dcd1b74e4583f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:21.001212 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.001124    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:21.002314 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.002294    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:21.035032 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:21.034994    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:21.140786 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:21.140729    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:21.243089 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:21.243052    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:21.343781 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:21.343677    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:21.364337 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.364311    2541 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 19:34:21.364474 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.364457    2541 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 19:34:21.444889 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:21.444854    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:21.456058 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.456021    2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 19:29:21 +0000 UTC" deadline="2028-02-27 10:44:01.644183666 +0000 UTC"
Jul 24 19:34:21.456058 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.456056    2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13983h9m40.188131056s"
Jul 24 19:34:21.527133 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.527091    2541 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:21.545486 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:21.545446    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:21.621869 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:21.621823    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2361c9c159847def10336548e796fbdb.slice/crio-47c1d020a07676d130fcfa33b2c59fe901224731e60a98a3bfcf96c428573371 WatchSource:0}: Error finding container 47c1d020a07676d130fcfa33b2c59fe901224731e60a98a3bfcf96c428573371: Status 404 returned error can't find the container with id 47c1d020a07676d130fcfa33b2c59fe901224731e60a98a3bfcf96c428573371
Jul 24 19:34:21.627441 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.627418    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:34:21.632591 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:21.632564    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5440c6100f019cdf70dcd1b74e4583f3.slice/crio-71eec59621c073c2e9b1881b7dea39fd29d69f608ac5088adcba1c28f16ea437 WatchSource:0}: Error finding container 71eec59621c073c2e9b1881b7dea39fd29d69f608ac5088adcba1c28f16ea437: Status 404 returned error can't find the container with id 71eec59621c073c2e9b1881b7dea39fd29d69f608ac5088adcba1c28f16ea437
Jul 24 19:34:21.645625 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:21.645593    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 24 19:34:21.691527 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.691495    2541 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:21.735854 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.735817    2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:21.750102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.750070    2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:34:21.751125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.751110    2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 24 19:34:21.760227 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.760207    2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:34:21.936792 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:21.936682    2541 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:22.407364 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.407268    2541 apiserver.go:52] "Watching apiserver"
Jul 24 19:34:22.416029 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.415787    2541 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 19:34:22.416315 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.416288    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-k4qpn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal","openshift-multus/multus-additional-cni-plugins-gwp5p","openshift-network-diagnostics/network-check-target-h2z9w","openshift-ovn-kubernetes/ovnkube-node-t7l4c","kube-system/global-pull-secret-syncer-56r2d","kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4s5zr","openshift-dns/node-resolver-276zs","openshift-multus/multus-4zznj","openshift-multus/network-metrics-daemon-pbgmc","openshift-network-operator/iptables-alerter-6z8dz","kube-system/konnectivity-agent-vkxlc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"]
Jul 24 19:34:22.419135 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.419107    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.421842 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.421589    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.422300 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.422175    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 19:34:22.424056 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.423558    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 19:34:22.424056 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.423703    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 19:34:22.424056 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.423912    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kkljn\""
Jul 24 19:34:22.424056 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.423928    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 19:34:22.424316 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.424069    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.424422 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.424396    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 19:34:22.428909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.426996    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 19:34:22.428909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.427246    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r5vpf\""
Jul 24 19:34:22.428909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.427528    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 19:34:22.428909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.427924    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:22.428909 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.427993    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:22.428909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.428434    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5gzgh\""
Jul 24 19:34:22.428909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.428688    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 19:34:22.430697 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.430228    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.432448 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.432369    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.432601 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.432443    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:22.434016 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.433994    2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 19:34:22.434898 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.434877    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 19:34:22.435328 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.435307    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 19:34:22.435745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.435725    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 19:34:22.436019 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.436001    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 19:34:22.436252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.436234    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 19:34:22.436509 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.436491    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 19:34:22.436781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.436744    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jr95r\""
Jul 24 19:34:22.439372 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.439339    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.439948 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.439928    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.442059 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.442039    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 19:34:22.442365 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.442348    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.442744 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.442725    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 19:34:22.443083 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.443059    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 19:34:22.443364 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.443345    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 19:34:22.443476 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.443454    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lpf67\""
Jul 24 19:34:22.443559 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.443475    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 19:34:22.443621 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.443353    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fpjtv\""
Jul 24 19:34:22.444475 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.444451    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.445153 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.445134    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:34:22.446062 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.445491    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p2fh2\""
Jul 24 19:34:22.446062 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.445724    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 19:34:22.448284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.447286    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 19:34:22.448284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.447726    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 19:34:22.448284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.447763    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6kqlf\""
Jul 24 19:34:22.448284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.447996    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 19:34:22.448284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.448198    2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:34:22.448284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.448215    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:22.448284 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.448280    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:22.449421 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449396    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02036468-9e21-4e65-aa8a-cff992d3d777-tmp-dir\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.449524 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449442    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bccf34b6-e75f-4764-8977-363456c349e6-agent-certs\") pod \"konnectivity-agent-vkxlc\" (UID: \"bccf34b6-e75f-4764-8977-363456c349e6\") " pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.449524 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449469    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.449524 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449495    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee7909a-f7dd-401a-b862-7803a4934e3b-cni-binary-copy\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.449524 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449520    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cnibin\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.449745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449562    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.449745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449592    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.449745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449621    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-system-cni-dir\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.449745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449649    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.449745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449690    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2bv\" (UniqueName: \"kubernetes.io/projected/2ddd4a06-4cec-41af-a784-2249b3e39fa5-kube-api-access-pj2bv\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.449745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449716    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-node-log\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.449745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449739    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovnkube-config\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449769    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02036468-9e21-4e65-aa8a-cff992d3d777-hosts-file\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449813    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449853    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-kubelet\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449881    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8pm\" (UniqueName: \"kubernetes.io/projected/fee7909a-f7dd-401a-b862-7803a4934e3b-kube-api-access-hl8pm\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449905    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449929    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-systemd\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449956    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.449980    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-registration-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450004    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-run-netns\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450043    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/459ff394-f5bd-4502-b106-c57e6f6cb884-dbus\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450086    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450117    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltzcs\" (UniqueName: \"kubernetes.io/projected/02036468-9e21-4e65-aa8a-cff992d3d777-kube-api-access-ltzcs\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.450139 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450143    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-ovn\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450159    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450173    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450196    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-env-overrides\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450221    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndfrn\" (UniqueName: \"kubernetes.io/projected/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-kube-api-access-ndfrn\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450248    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-socket-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450274    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-cnibin\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450313    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-cni-bin\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450340    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-multus-certs\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450374    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-log-socket\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450401    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/459ff394-f5bd-4502-b106-c57e6f6cb884-kubelet-config\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450427    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ltch\" (UniqueName: \"kubernetes.io/projected/fe46ffe7-d157-4874-8405-e477e9b6b9f7-kube-api-access-2ltch\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450450    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-system-cni-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450494    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-os-release\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450518    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-netns\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450544    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-daemon-config\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450570    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-slash\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.450793 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450593    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-etc-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450742    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-sys-fs\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450771    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-cni-multus\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450796    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-var-lib-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450820    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-k8s-cni-cncf-io\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450861    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-conf-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450888    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-hostroot\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450916    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450941    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovnkube-script-lib\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450964    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-cni-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.450988    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-kubelet\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451012    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-cni-netd\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451036    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451059    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-etc-kubernetes\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451087    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-os-release\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451123    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-systemd-units\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.451690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451204    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bccf34b6-e75f-4764-8977-363456c349e6-konnectivity-ca\") pod \"konnectivity-agent-vkxlc\" (UID: \"bccf34b6-e75f-4764-8977-363456c349e6\") " pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.452515 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451301    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-device-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.452515 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451348    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-socket-dir-parent\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.452515 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451377    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-cni-bin\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.452515 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.451400    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovn-node-metrics-cert\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.452515 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.452500    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:34:22.454245 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.454201    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 19:34:22.454461 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.454445    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 19:34:22.454796 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.454637    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gmvcn\""
Jul 24 19:34:22.469188 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.469145    2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ndw24"
Jul 24 19:34:22.478727 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.478692    2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ndw24"
Jul 24 19:34:22.535439 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.535408    2541 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 19:34:22.552004 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.551970    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdnf6\" (UniqueName: \"kubernetes.io/projected/2e294aca-708a-449e-b630-15fafab287d4-kube-api-access-bdnf6\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.552164 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552022    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-socket-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.552164 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552062    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-cnibin\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552164 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552090    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-cni-bin\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552164 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552118    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-multus-certs\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552164 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552143    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-log-socket\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552163    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-cni-bin\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552176    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-cnibin\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552163    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-socket-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552170    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-modprobe-d\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552203    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-multus-certs\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552230    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-log-socket\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552234    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-host\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552271    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/459ff394-f5bd-4502-b106-c57e6f6cb884-kubelet-config\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552293    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltch\" (UniqueName: \"kubernetes.io/projected/fe46ffe7-d157-4874-8405-e477e9b6b9f7-kube-api-access-2ltch\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552309    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-system-cni-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552327    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-os-release\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552327    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/459ff394-f5bd-4502-b106-c57e6f6cb884-kubelet-config\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552349    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-netns\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552381    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-system-cni-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552397 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552390    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-netns\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552416    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-daemon-config\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552428    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-os-release\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552452    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-slash\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552475    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-etc-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552488    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-slash\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552491    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-sys-fs\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552516    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-etc-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552515    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-cni-multus\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552541    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-cni-multus\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552552    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-var-lib-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552579    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-sys-fs\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552583    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-sys\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552604    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-var-lib-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552606    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb3d1179-ce80-4527-b6f6-5719469a8ab2-host\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552631    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-k8s-cni-cncf-io\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552653    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-conf-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.552978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552671    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysctl-conf\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552691    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-systemd\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552692    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-run-k8s-cni-cncf-io\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552715    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-hostroot\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552723    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-conf-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552750    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-hostroot\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552776    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552834    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552856    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovnkube-script-lib\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552875    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysconfig\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552890    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-var-lib-kubelet\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.552994    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e294aca-708a-449e-b630-15fafab287d4-etc-tuned\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553040    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztwhb\" (UniqueName: \"kubernetes.io/projected/bb3d1179-ce80-4527-b6f6-5719469a8ab2-kube-api-access-ztwhb\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553038    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-daemon-config\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553067    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6800a62c-9a09-4bdc-b739-90171804f37d-host-slash\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553120    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-cni-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553139    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-kubelet\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.553570 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553156    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-cni-netd\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553210    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-kubelet\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553225    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srv9c\" (UniqueName: \"kubernetes.io/projected/6800a62c-9a09-4bdc-b739-90171804f37d-kube-api-access-srv9c\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553252    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-run\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553255    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-cni-dir\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553265    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-cni-netd\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553294    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553325    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-etc-kubernetes\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553350    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-os-release\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553376    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-systemd-units\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553391    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-etc-kubernetes\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553402    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bccf34b6-e75f-4764-8977-363456c349e6-konnectivity-ca\") pod \"konnectivity-agent-vkxlc\" (UID: \"bccf34b6-e75f-4764-8977-363456c349e6\") " pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553428    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-device-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553444    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-systemd-units\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553454    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-socket-dir-parent\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553429    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-os-release\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553535    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-device-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.554356 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553536    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovnkube-script-lib\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553540    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-multus-socket-dir-parent\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553559    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-cni-bin\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553600    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-cni-bin\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553601    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovn-node-metrics-cert\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553688    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-kubernetes\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553717    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e294aca-708a-449e-b630-15fafab287d4-tmp\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553743    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02036468-9e21-4e65-aa8a-cff992d3d777-tmp-dir\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553768    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bccf34b6-e75f-4764-8977-363456c349e6-agent-certs\") pod \"konnectivity-agent-vkxlc\" (UID: \"bccf34b6-e75f-4764-8977-363456c349e6\") " pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553835    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553862    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee7909a-f7dd-401a-b862-7803a4934e3b-cni-binary-copy\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553886    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cnibin\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553913    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553914    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bccf34b6-e75f-4764-8977-363456c349e6-konnectivity-ca\") pod \"konnectivity-agent-vkxlc\" (UID: \"bccf34b6-e75f-4764-8977-363456c349e6\") " pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553956    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cnibin\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.553949    2541 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.554000    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:22.555085 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.554067    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret podName:459ff394-f5bd-4502-b106-c57e6f6cb884 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:23.054046771 +0000 UTC m=+3.178385907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret") pod "global-pull-secret-syncer-56r2d" (UID: "459ff394-f5bd-4502-b106-c57e6f6cb884") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.554106    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.554129    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02036468-9e21-4e65-aa8a-cff992d3d777-tmp-dir\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.554152    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.554189    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-system-cni-dir\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.554219    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.555442    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.555501    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2bv\" (UniqueName: \"kubernetes.io/projected/2ddd4a06-4cec-41af-a784-2249b3e39fa5-kube-api-access-pj2bv\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.555538    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-node-log\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.555567    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovnkube-config\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.555604    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysctl-d\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.555636    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-lib-modules\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.555950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.555750    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02036468-9e21-4e65-aa8a-cff992d3d777-hosts-file\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.556581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.556060    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fee7909a-f7dd-401a-b862-7803a4934e3b-cni-binary-copy\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.556581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.556250    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02036468-9e21-4e65-aa8a-cff992d3d777-hosts-file\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.556694 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.556634    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-node-log\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.557414    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovnkube-config\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.557947    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-ovn-node-metrics-cert\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558092    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ddd4a06-4cec-41af-a784-2249b3e39fa5-system-cni-dir\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558144    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bccf34b6-e75f-4764-8977-363456c349e6-agent-certs\") pod \"konnectivity-agent-vkxlc\" (UID: \"bccf34b6-e75f-4764-8977-363456c349e6\") " pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558146    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558203    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-kubelet\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558213    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558233    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558274    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8pm\" (UniqueName: \"kubernetes.io/projected/fee7909a-f7dd-401a-b862-7803a4934e3b-kube-api-access-hl8pm\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558280    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fee7909a-f7dd-401a-b862-7803a4934e3b-host-var-lib-kubelet\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558311    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558338    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-systemd\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558370    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558405    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-registration-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558436    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-run-netns\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558470    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:22.560699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558499    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6hw\" (UniqueName: \"kubernetes.io/projected/77763871-5b8d-4026-b916-770abf823589-kube-api-access-gj6hw\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558524    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-openvswitch\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558534    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6800a62c-9a09-4bdc-b739-90171804f37d-iptables-alerter-script\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558569    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/459ff394-f5bd-4502-b106-c57e6f6cb884-dbus\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558590    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-run-netns\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558623    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558664    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb3d1179-ce80-4527-b6f6-5719469a8ab2-serviceca\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558690    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/459ff394-f5bd-4502-b106-c57e6f6cb884-dbus\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558705    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltzcs\" (UniqueName: \"kubernetes.io/projected/02036468-9e21-4e65-aa8a-cff992d3d777-kube-api-access-ltzcs\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558740    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-ovn\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558747    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe46ffe7-d157-4874-8405-e477e9b6b9f7-registration-dir\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558773    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558807    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-env-overrides\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.558837    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndfrn\" (UniqueName: \"kubernetes.io/projected/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-kube-api-access-ndfrn\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.559106    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.559246    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ddd4a06-4cec-41af-a784-2249b3e39fa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.559330    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-systemd\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.561688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.559392    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.562458 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.559440    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-run-ovn\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.562458 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.559865    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-env-overrides\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.562458 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.561480    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:22.562458 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.561501    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:22.562458 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.561516    2541 projected.go:196] Error preparing data for projected volume kube-api-access-f8hsq for pod openshift-network-diagnostics/network-check-target-h2z9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:22.562458 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.561581    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq podName:760abb63-cf10-4984-b24e-4090bb0d0015 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:23.061562997 +0000 UTC m=+3.185902148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f8hsq" (UniqueName: "kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq") pod "network-check-target-h2z9w" (UID: "760abb63-cf10-4984-b24e-4090bb0d0015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:22.564268 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.564236    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ltch\" (UniqueName: \"kubernetes.io/projected/fe46ffe7-d157-4874-8405-e477e9b6b9f7-kube-api-access-2ltch\") pod \"aws-ebs-csi-driver-node-2rwkp\" (UID: \"fe46ffe7-d157-4874-8405-e477e9b6b9f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.565589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.565565    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2bv\" (UniqueName: \"kubernetes.io/projected/2ddd4a06-4cec-41af-a784-2249b3e39fa5-kube-api-access-pj2bv\") pod \"multus-additional-cni-plugins-gwp5p\" (UID: \"2ddd4a06-4cec-41af-a784-2249b3e39fa5\") " pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.566699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.566667    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8pm\" (UniqueName: \"kubernetes.io/projected/fee7909a-f7dd-401a-b862-7803a4934e3b-kube-api-access-hl8pm\") pod \"multus-4zznj\" (UID: \"fee7909a-f7dd-401a-b862-7803a4934e3b\") " pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.567548 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.567524    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltzcs\" (UniqueName: \"kubernetes.io/projected/02036468-9e21-4e65-aa8a-cff992d3d777-kube-api-access-ltzcs\") pod \"node-resolver-276zs\" (UID: \"02036468-9e21-4e65-aa8a-cff992d3d777\") " pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.567722 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.567689    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndfrn\" (UniqueName: \"kubernetes.io/projected/fb58d1b5-2629-4d25-b7e9-abdf3e274e8c-kube-api-access-ndfrn\") pod \"ovnkube-node-t7l4c\" (UID: \"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.577201 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.577150    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" event={"ID":"5440c6100f019cdf70dcd1b74e4583f3","Type":"ContainerStarted","Data":"71eec59621c073c2e9b1881b7dea39fd29d69f608ac5088adcba1c28f16ea437"}
Jul 24 19:34:22.578396 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.578368    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal" event={"ID":"2361c9c159847def10336548e796fbdb","Type":"ContainerStarted","Data":"47c1d020a07676d130fcfa33b2c59fe901224731e60a98a3bfcf96c428573371"}
Jul 24 19:34:22.605659 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.605626    2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:22.660172 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660082    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-kubernetes\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660172 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660124    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e294aca-708a-449e-b630-15fafab287d4-tmp\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660172 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660161    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysctl-d\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660465 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660186    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-lib-modules\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660465 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660231    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:22.660465 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660242    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-kubernetes\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660465 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660255    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6hw\" (UniqueName: \"kubernetes.io/projected/77763871-5b8d-4026-b916-770abf823589-kube-api-access-gj6hw\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:22.660465 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660448    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6800a62c-9a09-4bdc-b739-90171804f37d-iptables-alerter-script\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660480    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb3d1179-ce80-4527-b6f6-5719469a8ab2-serviceca\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660511    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdnf6\" (UniqueName: \"kubernetes.io/projected/2e294aca-708a-449e-b630-15fafab287d4-kube-api-access-bdnf6\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660542    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-modprobe-d\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660400    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-lib-modules\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660568    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-host\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660614    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-host\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660628    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-sys\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660659    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb3d1179-ce80-4527-b6f6-5719469a8ab2-host\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660688    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysctl-conf\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660718    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-systemd\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.660781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660768    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysconfig\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660792    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-var-lib-kubelet\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660831    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e294aca-708a-449e-b630-15fafab287d4-etc-tuned\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660864    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztwhb\" (UniqueName: \"kubernetes.io/projected/bb3d1179-ce80-4527-b6f6-5719469a8ab2-kube-api-access-ztwhb\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660890    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6800a62c-9a09-4bdc-b739-90171804f37d-host-slash\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660926    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srv9c\" (UniqueName: \"kubernetes.io/projected/6800a62c-9a09-4bdc-b739-90171804f37d-kube-api-access-srv9c\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660944    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-modprobe-d\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660356    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysctl-d\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.660952    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-run\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.660358    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661090    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysconfig\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:22.661099    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:23.161078954 +0000 UTC m=+3.285418090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661136    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6800a62c-9a09-4bdc-b739-90171804f37d-iptables-alerter-script\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661217    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-systemd\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661251    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-etc-sysctl-conf\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661269    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-sys\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661307    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6800a62c-9a09-4bdc-b739-90171804f37d-host-slash\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.661344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661309    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb3d1179-ce80-4527-b6f6-5719469a8ab2-host\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.662238 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661356    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-var-lib-kubelet\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.662238 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661385    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb3d1179-ce80-4527-b6f6-5719469a8ab2-serviceca\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.662238 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.661449    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e294aca-708a-449e-b630-15fafab287d4-run\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.663551 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.663530    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e294aca-708a-449e-b630-15fafab287d4-etc-tuned\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.663654 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.663599    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e294aca-708a-449e-b630-15fafab287d4-tmp\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.673168 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.673141    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6hw\" (UniqueName: \"kubernetes.io/projected/77763871-5b8d-4026-b916-770abf823589-kube-api-access-gj6hw\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:22.673657 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.673628    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srv9c\" (UniqueName: \"kubernetes.io/projected/6800a62c-9a09-4bdc-b739-90171804f37d-kube-api-access-srv9c\") pod \"iptables-alerter-6z8dz\" (UID: \"6800a62c-9a09-4bdc-b739-90171804f37d\") " pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:22.674021 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.674004    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdnf6\" (UniqueName: \"kubernetes.io/projected/2e294aca-708a-449e-b630-15fafab287d4-kube-api-access-bdnf6\") pod \"tuned-4s5zr\" (UID: \"2e294aca-708a-449e-b630-15fafab287d4\") " pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.674106 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.674021    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztwhb\" (UniqueName: \"kubernetes.io/projected/bb3d1179-ce80-4527-b6f6-5719469a8ab2-kube-api-access-ztwhb\") pod \"node-ca-k4qpn\" (UID: \"bb3d1179-ce80-4527-b6f6-5719469a8ab2\") " pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.734048 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.734002    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zznj"
Jul 24 19:34:22.750276 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.750244    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:22.770132 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.770096    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gwp5p"
Jul 24 19:34:22.778347 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.778322    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:22.787479 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.787452    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-276zs"
Jul 24 19:34:22.795628 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.795601    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp"
Jul 24 19:34:22.804961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.804931    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4s5zr"
Jul 24 19:34:22.813080 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.813051    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4qpn"
Jul 24 19:34:22.820026 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:22.820002    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6z8dz"
Jul 24 19:34:23.064245 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:23.064145    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:23.064245 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:23.064200    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:23.064482 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.064350    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:23.064482 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.064373    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:23.064482 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.064386    2541 projected.go:196] Error preparing data for projected volume kube-api-access-f8hsq for pod openshift-network-diagnostics/network-check-target-h2z9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:23.064482 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.064394    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:23.064482 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.064452    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq podName:760abb63-cf10-4984-b24e-4090bb0d0015 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:24.064432157 +0000 UTC m=+4.188771311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8hsq" (UniqueName: "kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq") pod "network-check-target-h2z9w" (UID: "760abb63-cf10-4984-b24e-4090bb0d0015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:23.064482 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.064475    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret podName:459ff394-f5bd-4502-b106-c57e6f6cb884 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:24.064464038 +0000 UTC m=+4.188803174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret") pod "global-pull-secret-syncer-56r2d" (UID: "459ff394-f5bd-4502-b106-c57e6f6cb884") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:23.165586 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:23.165544    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:23.165772 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.165693    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:23.165839 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.165800    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:24.16576328 +0000 UTC m=+4.290102415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:23.482904 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:23.482813    2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:29:22 +0000 UTC" deadline="2028-01-09 20:00:53.71331638 +0000 UTC"
Jul 24 19:34:23.482904 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:23.482847    2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12816h26m30.230472507s"
Jul 24 19:34:23.573880 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:23.573837    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:23.574074 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:23.573970    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:23.612113 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.612073    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6800a62c_9a09_4bdc_b739_90171804f37d.slice/crio-914514fae088673f6f6e040ddff5eac51e3653b31df8d7f78c4ed61bc714782a WatchSource:0}: Error finding container 914514fae088673f6f6e040ddff5eac51e3653b31df8d7f78c4ed61bc714782a: Status 404 returned error can't find the container with id 914514fae088673f6f6e040ddff5eac51e3653b31df8d7f78c4ed61bc714782a
Jul 24 19:34:23.617540 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.617510    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb58d1b5_2629_4d25_b7e9_abdf3e274e8c.slice/crio-fe85e62ac379bf5c89648f4d7ed5cadccb47b1ef1ae6e4698dca199a32ada8d5 WatchSource:0}: Error finding container fe85e62ac379bf5c89648f4d7ed5cadccb47b1ef1ae6e4698dca199a32ada8d5: Status 404 returned error can't find the container with id fe85e62ac379bf5c89648f4d7ed5cadccb47b1ef1ae6e4698dca199a32ada8d5
Jul 24 19:34:23.621720 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.621671    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3d1179_ce80_4527_b6f6_5719469a8ab2.slice/crio-c00e1832a8df52c69a1630a56e16ed4e8aa32d5086dfdf54167d0ded11256f84 WatchSource:0}: Error finding container c00e1832a8df52c69a1630a56e16ed4e8aa32d5086dfdf54167d0ded11256f84: Status 404 returned error can't find the container with id c00e1832a8df52c69a1630a56e16ed4e8aa32d5086dfdf54167d0ded11256f84
Jul 24 19:34:23.622525 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.622429    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe46ffe7_d157_4874_8405_e477e9b6b9f7.slice/crio-c12d88e39f3226c6aadc32c50a0b803e9ad275d0afc291214d7c678207ce4a39 WatchSource:0}: Error finding container c12d88e39f3226c6aadc32c50a0b803e9ad275d0afc291214d7c678207ce4a39: Status 404 returned error can't find the container with id c12d88e39f3226c6aadc32c50a0b803e9ad275d0afc291214d7c678207ce4a39
Jul 24 19:34:23.624123 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.623953    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02036468_9e21_4e65_aa8a_cff992d3d777.slice/crio-290afa5ec5bbd0d5cbc05a96180c4e8e00c807f142ae9fb7bddaf67b2c86ce1a WatchSource:0}: Error finding container 290afa5ec5bbd0d5cbc05a96180c4e8e00c807f142ae9fb7bddaf67b2c86ce1a: Status 404 returned error can't find the container with id 290afa5ec5bbd0d5cbc05a96180c4e8e00c807f142ae9fb7bddaf67b2c86ce1a
Jul 24 19:34:23.626216 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.626195    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e294aca_708a_449e_b630_15fafab287d4.slice/crio-13553aec295188981ebfeae2f4fc3c4f1a195f53d643efd7822c97395ef0cb8a WatchSource:0}: Error finding container 13553aec295188981ebfeae2f4fc3c4f1a195f53d643efd7822c97395ef0cb8a: Status 404 returned error can't find the container with id 13553aec295188981ebfeae2f4fc3c4f1a195f53d643efd7822c97395ef0cb8a
Jul 24 19:34:23.627385 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.627362    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddd4a06_4cec_41af_a784_2249b3e39fa5.slice/crio-e440b695c9744ac6c046598a3af8e98b5825edd8007ca34b0d652496178af791 WatchSource:0}: Error finding container e440b695c9744ac6c046598a3af8e98b5825edd8007ca34b0d652496178af791: Status 404 returned error can't find the container with id e440b695c9744ac6c046598a3af8e98b5825edd8007ca34b0d652496178af791
Jul 24 19:34:23.628289 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.628268    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee7909a_f7dd_401a_b862_7803a4934e3b.slice/crio-c3a5870240fd4d6a9597e97148148cbdcbbe72317a3cc61d009bc1baa942fefa WatchSource:0}: Error finding container c3a5870240fd4d6a9597e97148148cbdcbbe72317a3cc61d009bc1baa942fefa: Status 404 returned error can't find the container with id c3a5870240fd4d6a9597e97148148cbdcbbe72317a3cc61d009bc1baa942fefa
Jul 24 19:34:23.629404 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:23.629316    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbccf34b6_e75f_4764_8977_363456c349e6.slice/crio-3444e76de2dc9232be291ade440647ab757bbe4afd77b672535c6f70760959e1 WatchSource:0}: Error finding container 3444e76de2dc9232be291ade440647ab757bbe4afd77b672535c6f70760959e1: Status 404 returned error can't find the container with id 3444e76de2dc9232be291ade440647ab757bbe4afd77b672535c6f70760959e1
Jul 24 19:34:24.073950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.073576    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:24.073950 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.073928    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:24.074193 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.074117    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:24.074193 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.074182    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret podName:459ff394-f5bd-4502-b106-c57e6f6cb884 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:26.074162774 +0000 UTC m=+6.198501931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret") pod "global-pull-secret-syncer-56r2d" (UID: "459ff394-f5bd-4502-b106-c57e6f6cb884") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:24.074673 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.074653    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:24.074673 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.074686    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:24.074832 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.074702    2541 projected.go:196] Error preparing data for projected volume kube-api-access-f8hsq for pod openshift-network-diagnostics/network-check-target-h2z9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:24.074832 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.074753    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq podName:760abb63-cf10-4984-b24e-4090bb0d0015 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:26.074738064 +0000 UTC m=+6.199077221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8hsq" (UniqueName: "kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq") pod "network-check-target-h2z9w" (UID: "760abb63-cf10-4984-b24e-4090bb0d0015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:24.175009 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.174759    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:24.175009 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.174956    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:24.175296 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.175034    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:26.175010721 +0000 UTC m=+6.299349859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:24.483331 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.483206    2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:29:22 +0000 UTC" deadline="2028-01-13 17:20:21.356823149 +0000 UTC"
Jul 24 19:34:24.483331 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.483276    2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12909h45m56.873551813s"
Jul 24 19:34:24.576135 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.576100    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:24.576318 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.576248    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:24.576706 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.576684    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:24.576841 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:24.576802    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:24.609237 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.609193    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"fe85e62ac379bf5c89648f4d7ed5cadccb47b1ef1ae6e4698dca199a32ada8d5"}
Jul 24 19:34:24.614232 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.614189    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6z8dz" event={"ID":"6800a62c-9a09-4bdc-b739-90171804f37d","Type":"ContainerStarted","Data":"914514fae088673f6f6e040ddff5eac51e3653b31df8d7f78c4ed61bc714782a"}
Jul 24 19:34:24.625862 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.625809    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal" event={"ID":"2361c9c159847def10336548e796fbdb","Type":"ContainerStarted","Data":"8762ec2f34c21db74fb0661cfb20d607f4ada1ea8c38b1ff643487d6be751bca"}
Jul 24 19:34:24.641151 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.641102    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vkxlc" event={"ID":"bccf34b6-e75f-4764-8977-363456c349e6","Type":"ContainerStarted","Data":"3444e76de2dc9232be291ade440647ab757bbe4afd77b672535c6f70760959e1"}
Jul 24 19:34:24.652350 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.652256    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4qpn" event={"ID":"bb3d1179-ce80-4527-b6f6-5719469a8ab2","Type":"ContainerStarted","Data":"c00e1832a8df52c69a1630a56e16ed4e8aa32d5086dfdf54167d0ded11256f84"}
Jul 24 19:34:24.661512 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.661413    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerStarted","Data":"e440b695c9744ac6c046598a3af8e98b5825edd8007ca34b0d652496178af791"}
Jul 24 19:34:24.664973 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.664874    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-276zs" event={"ID":"02036468-9e21-4e65-aa8a-cff992d3d777","Type":"ContainerStarted","Data":"290afa5ec5bbd0d5cbc05a96180c4e8e00c807f142ae9fb7bddaf67b2c86ce1a"}
Jul 24 19:34:24.669536 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.669382    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp" event={"ID":"fe46ffe7-d157-4874-8405-e477e9b6b9f7","Type":"ContainerStarted","Data":"c12d88e39f3226c6aadc32c50a0b803e9ad275d0afc291214d7c678207ce4a39"}
Jul 24 19:34:24.682713 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.681728    2541 generic.go:356] "Generic (PLEG): container finished" podID="5440c6100f019cdf70dcd1b74e4583f3" containerID="11b1cb6c499dac5c71eeaa00abee2ce13dae74eeb7bc056ca0d108b58808ec34" exitCode=0
Jul 24 19:34:24.682713 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.681833    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" event={"ID":"5440c6100f019cdf70dcd1b74e4583f3","Type":"ContainerDied","Data":"11b1cb6c499dac5c71eeaa00abee2ce13dae74eeb7bc056ca0d108b58808ec34"}
Jul 24 19:34:24.697343 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.697260    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zznj" event={"ID":"fee7909a-f7dd-401a-b862-7803a4934e3b","Type":"ContainerStarted","Data":"c3a5870240fd4d6a9597e97148148cbdcbbe72317a3cc61d009bc1baa942fefa"}
Jul 24 19:34:24.704230 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.703882    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal" podStartSLOduration=2.703843711 podStartE2EDuration="2.703843711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:24.644067009 +0000 UTC m=+4.768406170" watchObservedRunningTime="2026-07-24 19:34:24.703843711 +0000 UTC m=+4.828182871"
Jul 24 19:34:24.722100 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:24.722009    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4s5zr" event={"ID":"2e294aca-708a-449e-b630-15fafab287d4","Type":"ContainerStarted","Data":"13553aec295188981ebfeae2f4fc3c4f1a195f53d643efd7822c97395ef0cb8a"}
Jul 24 19:34:25.573232 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:25.573196    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:25.573860 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:25.573337    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:25.752853 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:25.752800    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" event={"ID":"5440c6100f019cdf70dcd1b74e4583f3","Type":"ContainerStarted","Data":"221d65d0b23a4c7724394151c62d37e5510aeee72831596fad6f67110e3bd584"}
Jul 24 19:34:26.093252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:26.093202    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:26.093446 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:26.093277    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:26.093505 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.093472    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:26.093578 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.093551    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret podName:459ff394-f5bd-4502-b106-c57e6f6cb884 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:30.093529235 +0000 UTC m=+10.217868393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret") pod "global-pull-secret-syncer-56r2d" (UID: "459ff394-f5bd-4502-b106-c57e6f6cb884") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:26.094086 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.094063    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:26.094269 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.094096    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:26.094269 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.094110    2541 projected.go:196] Error preparing data for projected volume kube-api-access-f8hsq for pod openshift-network-diagnostics/network-check-target-h2z9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:26.094269 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.094161    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq podName:760abb63-cf10-4984-b24e-4090bb0d0015 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:30.094144109 +0000 UTC m=+10.218483248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8hsq" (UniqueName: "kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq") pod "network-check-target-h2z9w" (UID: "760abb63-cf10-4984-b24e-4090bb0d0015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:26.194001 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:26.193953    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:26.194203 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.194124    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:26.194312 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.194227    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:30.194173387 +0000 UTC m=+10.318512541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:26.574098 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:26.573936    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:26.574581 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.574098    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:26.574581 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:26.574464    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:26.574581 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:26.574567    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:27.573683 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:27.573647    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:27.573926 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:27.573810    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:28.575870 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:28.574974    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:28.575870 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:28.575195    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:28.575870 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:28.575751    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:28.576487 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:28.575887    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:29.573821 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:29.573785    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:29.573973 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:29.573927    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:30.130402    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:30.130494    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.130675    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.130741    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret podName:459ff394-f5bd-4502-b106-c57e6f6cb884 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:38.130722673 +0000 UTC m=+18.255061824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret") pod "global-pull-secret-syncer-56r2d" (UID: "459ff394-f5bd-4502-b106-c57e6f6cb884") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.130847    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.130862    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.130873    2541 projected.go:196] Error preparing data for projected volume kube-api-access-f8hsq for pod openshift-network-diagnostics/network-check-target-h2z9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:30.131294 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.130912    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq podName:760abb63-cf10-4984-b24e-4090bb0d0015 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:38.130899475 +0000 UTC m=+18.255238623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8hsq" (UniqueName: "kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq") pod "network-check-target-h2z9w" (UID: "760abb63-cf10-4984-b24e-4090bb0d0015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:30.231216 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:30.231145    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:30.231412 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.231327    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:30.231482 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.231412    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:38.231390632 +0000 UTC m=+18.355729783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:30.576221 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:30.575930    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:30.576373 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.576247    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:30.576373 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:30.576344    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:30.578369 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:30.576546    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:31.573367 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:31.573333    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:31.573986 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:31.573459    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:32.573819 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:32.573724    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:32.574311 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:32.573901    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:32.574311 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:32.574061    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:32.574311 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:32.574179    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:33.573666 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:33.573621    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:33.573854 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:33.573799    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:34.573641 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:34.573608    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:34.573828 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:34.573608    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:34.573828 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:34.573755    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:34.573828 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:34.573801    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:35.573945 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:35.573898    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:35.574373 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:35.574028    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:36.575988 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:36.575954    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:36.576416 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:36.576076    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:36.576416 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:36.576136    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:36.576416 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:36.576253    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:37.573841 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:37.573811    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:37.574041 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:37.573939    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:38.191482 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:38.191437    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:38.191976 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:38.191531    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:38.191976 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.191608    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:38.191976 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.191645    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:38.191976 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.191666    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:38.191976 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.191681    2541 projected.go:196] Error preparing data for projected volume kube-api-access-f8hsq for pod openshift-network-diagnostics/network-check-target-h2z9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:38.191976 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.191682    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret podName:459ff394-f5bd-4502-b106-c57e6f6cb884 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:54.191661013 +0000 UTC m=+34.316000162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret") pod "global-pull-secret-syncer-56r2d" (UID: "459ff394-f5bd-4502-b106-c57e6f6cb884") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:38.191976 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.191743    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq podName:760abb63-cf10-4984-b24e-4090bb0d0015 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:54.191728162 +0000 UTC m=+34.316067296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8hsq" (UniqueName: "kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq") pod "network-check-target-h2z9w" (UID: "760abb63-cf10-4984-b24e-4090bb0d0015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:38.292563 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:38.292531    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:38.292728 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.292654    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:38.292728 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.292710    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:54.292695282 +0000 UTC m=+34.417034416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:38.573993 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:38.573912    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:38.574145 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:38.573915    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:38.574145 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.574053    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:38.574257 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:38.574164    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:39.573598 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:39.573558    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:39.574095 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:39.573688    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:40.577023 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:40.576986    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:40.577023 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:40.577001    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:40.577454 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:40.577110    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:40.577454 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:40.577192    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:41.573115 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:41.573074    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:41.573295 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:41.573190    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:42.575478 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.574986    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:42.575478 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:42.575116    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:42.575478 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.575241    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:42.575478 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:42.575354    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:42.791497 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.791274    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4qpn" event={"ID":"bb3d1179-ce80-4527-b6f6-5719469a8ab2","Type":"ContainerStarted","Data":"83152f1c897cd0d7c908bf16d06df2f38e9efe8f7c686bfb07ee6775cf0bc9a0"}
Jul 24 19:34:42.793326 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.793298    2541 generic.go:356] "Generic (PLEG): container finished" podID="2ddd4a06-4cec-41af-a784-2249b3e39fa5" containerID="ca885acedce3dba0fa9793b4f43a287ba4a2bf2c66edc902cea4f4e99cfc31be" exitCode=0
Jul 24 19:34:42.793459 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.793382    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerDied","Data":"ca885acedce3dba0fa9793b4f43a287ba4a2bf2c66edc902cea4f4e99cfc31be"}
Jul 24 19:34:42.795106 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.794897    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-276zs" event={"ID":"02036468-9e21-4e65-aa8a-cff992d3d777","Type":"ContainerStarted","Data":"899e9dee13eaf072186c73b7b80867d0d33b38fa1013c85a7764a61be78617bd"}
Jul 24 19:34:42.796677 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.796649    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp" event={"ID":"fe46ffe7-d157-4874-8405-e477e9b6b9f7","Type":"ContainerStarted","Data":"c75cb56d7bf02a40b4af0fd4d3e9f3809e436766eef43e766298a7dbe9186231"}
Jul 24 19:34:42.798174 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.798147    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zznj" event={"ID":"fee7909a-f7dd-401a-b862-7803a4934e3b","Type":"ContainerStarted","Data":"6dfbdca44f0542c3fd58cd02cf8163de526d4299212fd8487cda5bb08e2e979a"}
Jul 24 19:34:42.799500 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.799480    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4s5zr" event={"ID":"2e294aca-708a-449e-b630-15fafab287d4","Type":"ContainerStarted","Data":"641c010832d4ac91b63e6ab47c1af532eb9f450c3b65fd67f8a9299001e40e3c"}
Jul 24 19:34:42.801668 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.801643    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"aba043add531af6e7f02a73f770e182fb3e37ee87987b02216387cbe1470beef"}
Jul 24 19:34:42.803206 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.803185    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vkxlc" event={"ID":"bccf34b6-e75f-4764-8977-363456c349e6","Type":"ContainerStarted","Data":"29b7edb187856db8b56e000354604be4315945e5be0af30c358decdfb13eee22"}
Jul 24 19:34:42.805563 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.805526    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k4qpn" podStartSLOduration=2.9300010309999998 podStartE2EDuration="21.805514445s" totalImagesPullingTime="18.875513414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:42.805241376 +0000 UTC m=+22.929580533" watchObservedRunningTime="2026-07-24 19:34:42.805514445 +0000 UTC m=+22.929853601"
Jul 24 19:34:42.805680 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.805611    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" podStartSLOduration=20.805601816 podStartE2EDuration="20.805601816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:25.769790218 +0000 UTC m=+5.894129379" watchObservedRunningTime="2026-07-24 19:34:42.805601816 +0000 UTC m=+22.929940973"
Jul 24 19:34:42.823686 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.823631    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4zznj" podStartSLOduration=2.908360695 podStartE2EDuration="21.823592112s" totalImagesPullingTime="18.915231417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:42.823067073 +0000 UTC m=+22.947406229" watchObservedRunningTime="2026-07-24 19:34:42.823592112 +0000 UTC m=+22.947931283"
Jul 24 19:34:42.839185 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.839140    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vkxlc" podStartSLOduration=10.95524587 podStartE2EDuration="21.839127267s" totalImagesPullingTime="10.883881397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:42.838811502 +0000 UTC m=+22.963150661" watchObservedRunningTime="2026-07-24 19:34:42.839127267 +0000 UTC m=+22.963466423"
Jul 24 19:34:42.857144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.857099    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4s5zr" podStartSLOduration=2.982239232 podStartE2EDuration="21.85708246s" totalImagesPullingTime="18.874843228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:42.856669638 +0000 UTC m=+22.981008795" watchObservedRunningTime="2026-07-24 19:34:42.85708246 +0000 UTC m=+22.981421616"
Jul 24 19:34:42.909321 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:42.909275    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-276zs" podStartSLOduration=3.032723191 podStartE2EDuration="21.909257556s" totalImagesPullingTime="18.876534365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:42.908756811 +0000 UTC m=+23.033095967" watchObservedRunningTime="2026-07-24 19:34:42.909257556 +0000 UTC m=+23.033596711"
Jul 24 19:34:43.434636 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.434600    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:43.435284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.435243    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:43.573861 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.573828    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:43.574010 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:43.573947    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:43.809188 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.809148    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"3fbf9c31e6a0d0eb3261eacff45c63c37f91d2aa72e0197e38c7a1cfccdaabb1"}
Jul 24 19:34:43.809986 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.809237    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"86df0d79947ebbf7ecb10d2d420867693a4da59bd8c3708a0f40f773628c7df3"}
Jul 24 19:34:43.809986 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.809279    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"a06256b0c9283a85645d0b16ec72ad78bc7bc2084d943d86ae3869cb14df485e"}
Jul 24 19:34:43.809986 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.809348    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"86a04b9e566517692e03b3b86065dafef07c7d1d2d541d82a83e1aeea63686a8"}
Jul 24 19:34:43.809986 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.809391    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"ffe77f0d23d37002dff1c4cf6384c0f659d4f3dd5f4c67e3ce43191db69450b2"}
Jul 24 19:34:43.809986 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.809955    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:43.810366 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.810340    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vkxlc"
Jul 24 19:34:43.831861 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:43.831735    2541 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 19:34:44.516274 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.516026    2541 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T19:34:43.831753128Z","UUID":"9132fbd3-0556-4b40-97b9-c93228b4a61c","Handler":null,"Name":"","Endpoint":""}
Jul 24 19:34:44.518330 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.518305    2541 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 19:34:44.518330 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.518347    2541 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 19:34:44.574061 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.573753    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:44.574061 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.573753    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:44.574061 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:44.573907    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:44.574061 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:44.573995    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:44.813980 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.813880    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6z8dz" event={"ID":"6800a62c-9a09-4bdc-b739-90171804f37d","Type":"ContainerStarted","Data":"72b5d66b6fa45bb3f32d734f11f5f971a03f8ecca43752cfc03c8c0783ba884f"}
Jul 24 19:34:44.817088 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.817038    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp" event={"ID":"fe46ffe7-d157-4874-8405-e477e9b6b9f7","Type":"ContainerStarted","Data":"c4d4ad1091649948037e2920db11655396d48cf195ec9b30dfc059370d28c42d"}
Jul 24 19:34:44.829497 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:44.829447    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6z8dz" podStartSLOduration=4.941973976 podStartE2EDuration="23.829430655s" totalImagesPullingTime="18.887456679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:44.82888339 +0000 UTC m=+24.953222547" watchObservedRunningTime="2026-07-24 19:34:44.829430655 +0000 UTC m=+24.953769809"
Jul 24 19:34:45.573484 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:45.573275    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:45.573645 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:45.573569    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:45.822163 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:45.822068    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp" event={"ID":"fe46ffe7-d157-4874-8405-e477e9b6b9f7","Type":"ContainerStarted","Data":"fb24b81054a5f73a5cfaacc34c19e6928e552b10b7b87cc71fb92050cd5e45e9"}
Jul 24 19:34:45.839215 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:45.839164    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2rwkp" podStartSLOduration=3.762365005 podStartE2EDuration="24.83914648s" totalImagesPullingTime="21.076781475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:45.838566188 +0000 UTC m=+25.962905345" watchObservedRunningTime="2026-07-24 19:34:45.83914648 +0000 UTC m=+25.963485635"
Jul 24 19:34:46.573611 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:46.573576    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:46.573846 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:46.573576    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:46.573846 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:46.573720    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:46.573846 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:46.573799    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:47.574016 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:47.573922    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:47.574602 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:47.574029    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:47.829001 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:47.828911    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"6a923808492c19c987082ed06a99c03b90eeb9e3d2ee321941a102615dcfbdd6"}
Jul 24 19:34:47.830614 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:47.830592    2541 generic.go:356] "Generic (PLEG): container finished" podID="2ddd4a06-4cec-41af-a784-2249b3e39fa5" containerID="56aaaae617316d4e683c5e421f85e3c8801caf270e11cb9cc7fbf8bf4399d3aa" exitCode=0
Jul 24 19:34:47.830697 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:47.830624    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerDied","Data":"56aaaae617316d4e683c5e421f85e3c8801caf270e11cb9cc7fbf8bf4399d3aa"}
Jul 24 19:34:48.573550 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:48.573522    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:48.573713 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:48.573633    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:48.573713 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:48.573660    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:48.573713 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:48.573709    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:49.573159 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.572897    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:49.573684 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:49.573155    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:49.842236 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.842142    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" event={"ID":"fb58d1b5-2629-4d25-b7e9-abdf3e274e8c","Type":"ContainerStarted","Data":"b38498f53771ff7cfdbb1c96882cda63db2c4b16988efc4e182d90c2710b79cb"}
Jul 24 19:34:49.842419 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.842385    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:49.842490 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.842444    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:49.844247 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.844217    2541 generic.go:356] "Generic (PLEG): container finished" podID="2ddd4a06-4cec-41af-a784-2249b3e39fa5" containerID="730716604b27fcc486762f5360ed3b2df0d99698a3f0baace06278f40cb11309" exitCode=0
Jul 24 19:34:49.844375 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.844260    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerDied","Data":"730716604b27fcc486762f5360ed3b2df0d99698a3f0baace06278f40cb11309"}
Jul 24 19:34:49.859339 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.859311    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:49.866813 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:49.866743    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c" podStartSLOduration=9.919111523 podStartE2EDuration="28.866727491s" totalImagesPullingTime="18.947615968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:49.866497706 +0000 UTC m=+29.990836876" watchObservedRunningTime="2026-07-24 19:34:49.866727491 +0000 UTC m=+29.991066648"
Jul 24 19:34:50.574566 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:50.574529    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:50.574955 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:50.574645    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:50.574955 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:50.574696    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:50.574955 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:50.574812    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:50.849847 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:50.849059    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:50.865373 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:50.865344    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:34:51.205403 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.205150    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pbgmc"]
Jul 24 19:34:51.205584 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.205528    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:51.205682 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:51.205646    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:51.205991 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.205917    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56r2d"]
Jul 24 19:34:51.206105 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.206005    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:51.206105 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:51.206090    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:51.207437 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.207400    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2z9w"]
Jul 24 19:34:51.207546 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.207515    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:51.207626 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:51.207602    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:51.851826 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.851787    2541 generic.go:356] "Generic (PLEG): container finished" podID="2ddd4a06-4cec-41af-a784-2249b3e39fa5" containerID="a0f17645fba538accea5f1039eabb165e61360b25bfe695119c5bea8ba96fc7f" exitCode=0
Jul 24 19:34:51.852402 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:51.851858    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerDied","Data":"a0f17645fba538accea5f1039eabb165e61360b25bfe695119c5bea8ba96fc7f"}
Jul 24 19:34:52.573680 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:52.573644    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:52.573879 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:52.573796    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:52.573879 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:52.573823    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:52.574006 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:52.573940    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:53.573831 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:53.573791    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:53.574355 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:53.573933    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56r2d" podUID="459ff394-f5bd-4502-b106-c57e6f6cb884"
Jul 24 19:34:54.211041 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:54.211001    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:54.211223 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:54.211059    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:54.211223 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.211208    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:54.211344 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.211276    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret podName:459ff394-f5bd-4502-b106-c57e6f6cb884 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:26.211256059 +0000 UTC m=+66.335595217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret") pod "global-pull-secret-syncer-56r2d" (UID: "459ff394-f5bd-4502-b106-c57e6f6cb884") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:54.211344 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.211210    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:54.211344 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.211329    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:54.211490 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.211346    2541 projected.go:196] Error preparing data for projected volume kube-api-access-f8hsq for pod openshift-network-diagnostics/network-check-target-h2z9w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:54.211490 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.211400    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq podName:760abb63-cf10-4984-b24e-4090bb0d0015 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:26.211381059 +0000 UTC m=+66.335720214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f8hsq" (UniqueName: "kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq") pod "network-check-target-h2z9w" (UID: "760abb63-cf10-4984-b24e-4090bb0d0015") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:54.311966 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:54.311930    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:54.312128 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.312086    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:54.312162 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.312154    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:26.312136528 +0000 UTC m=+66.436475662 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:54.573801 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:54.573708    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:54.573801 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:54.573709    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:54.574236 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.573842    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2z9w" podUID="760abb63-cf10-4984-b24e-4090bb0d0015"
Jul 24 19:34:54.574236 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:54.573982    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbgmc" podUID="77763871-5b8d-4026-b916-770abf823589"
Jul 24 19:34:55.149239 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.149213    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeReady"
Jul 24 19:34:55.149452 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.149354    2541 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 19:34:55.184015 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.183971    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74f8b757b4-2ftkr"]
Jul 24 19:34:55.188519 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.188491    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.191132 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.191106    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 19:34:55.191372 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.191331    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 19:34:55.191456 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.191379    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nx6vx\""
Jul 24 19:34:55.191456 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.191416    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 19:34:55.196690 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.196664    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vfbx8"]
Jul 24 19:34:55.196840 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.196740    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 19:34:55.200725 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.200659    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.201660 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.201639    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74f8b757b4-2ftkr"]
Jul 24 19:34:55.203461 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.203436    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p8txj\""
Jul 24 19:34:55.203744 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.203723    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 19:34:55.203968 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.203946    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qwvmj"]
Jul 24 19:34:55.204048 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.203986    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 19:34:55.207281 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.207262    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.209781 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.209746    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 19:34:55.209880 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.209746    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 19:34:55.210403 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.210381    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 19:34:55.211156 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.211138    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zq8nd\""
Jul 24 19:34:55.211920 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.211896    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vfbx8"]
Jul 24 19:34:55.223043 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.222985    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwvmj"]
Jul 24 19:34:55.320638 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320540    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5724d911-2242-43e9-8f35-9ce7a75b9aad-ca-trust-extracted\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.320638 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320590    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/625809e2-a447-47cc-8855-1258e486fb87-config-volume\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.320638 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320619    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-trusted-ca\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.320939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320662    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlcbp\" (UniqueName: \"kubernetes.io/projected/625809e2-a447-47cc-8855-1258e486fb87-kube-api-access-zlcbp\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.320939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320685    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-image-registry-private-configuration\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.320939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320713    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625809e2-a447-47cc-8855-1258e486fb87-tmp-dir\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.320939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320730    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-installation-pull-secrets\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.320939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320754    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-745nd\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-kube-api-access-745nd\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.320939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320789    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181d01dd-6034-4e63-85d3-9179c8d28f59-cert\") pod \"ingress-canary-qwvmj\" (UID: \"181d01dd-6034-4e63-85d3-9179c8d28f59\") " pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.320939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320840    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.321252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.320957    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.321252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.321003    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-certificates\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.321252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.321029    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-bound-sa-token\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.321252 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.321066    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vr89\" (UniqueName: \"kubernetes.io/projected/181d01dd-6034-4e63-85d3-9179c8d28f59-kube-api-access-9vr89\") pod \"ingress-canary-qwvmj\" (UID: \"181d01dd-6034-4e63-85d3-9179c8d28f59\") " pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.422206 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422161    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.422410 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422221    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422410 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422253    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-certificates\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422410 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422269    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-bound-sa-token\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422410 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422290    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vr89\" (UniqueName: \"kubernetes.io/projected/181d01dd-6034-4e63-85d3-9179c8d28f59-kube-api-access-9vr89\") pod \"ingress-canary-qwvmj\" (UID: \"181d01dd-6034-4e63-85d3-9179c8d28f59\") " pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.422410 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.422342    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 19:34:55.422410 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.422393    2541 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 19:34:55.422410 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.422412    2541 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f8b757b4-2ftkr: secret "image-registry-tls" not found
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.422419    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls podName:625809e2-a447-47cc-8855-1258e486fb87 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:55.922398029 +0000 UTC m=+36.046737179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls") pod "dns-default-vfbx8" (UID: "625809e2-a447-47cc-8855-1258e486fb87") : secret "dns-default-metrics-tls" not found
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.422460    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls podName:5724d911-2242-43e9-8f35-9ce7a75b9aad nodeName:}" failed. No retries permitted until 2026-07-24 19:34:55.922443888 +0000 UTC m=+36.046783036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls") pod "image-registry-74f8b757b4-2ftkr" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad") : secret "image-registry-tls" not found
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422494    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5724d911-2242-43e9-8f35-9ce7a75b9aad-ca-trust-extracted\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422530    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/625809e2-a447-47cc-8855-1258e486fb87-config-volume\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422552    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-trusted-ca\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422588    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlcbp\" (UniqueName: \"kubernetes.io/projected/625809e2-a447-47cc-8855-1258e486fb87-kube-api-access-zlcbp\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422616    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-image-registry-private-configuration\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422644    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625809e2-a447-47cc-8855-1258e486fb87-tmp-dir\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422668    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-installation-pull-secrets\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422709    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-745nd\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-kube-api-access-745nd\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.422738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422732    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181d01dd-6034-4e63-85d3-9179c8d28f59-cert\") pod \"ingress-canary-qwvmj\" (UID: \"181d01dd-6034-4e63-85d3-9179c8d28f59\") " pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.423307 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.422964    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-certificates\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.423307 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.423223    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5724d911-2242-43e9-8f35-9ce7a75b9aad-ca-trust-extracted\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.423957 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.423597    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-trusted-ca\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.423957 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.423912    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/625809e2-a447-47cc-8855-1258e486fb87-tmp-dir\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.423957 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.423931    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/625809e2-a447-47cc-8855-1258e486fb87-config-volume\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.428271 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.428247    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-image-registry-private-configuration\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.428393 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.428272    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/181d01dd-6034-4e63-85d3-9179c8d28f59-cert\") pod \"ingress-canary-qwvmj\" (UID: \"181d01dd-6034-4e63-85d3-9179c8d28f59\") " pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.428393 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.428270    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-installation-pull-secrets\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.432854 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.432828    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-745nd\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-kube-api-access-745nd\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.433006 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.432987    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlcbp\" (UniqueName: \"kubernetes.io/projected/625809e2-a447-47cc-8855-1258e486fb87-kube-api-access-zlcbp\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.433414 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.433392    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-bound-sa-token\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.433554 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.433538    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vr89\" (UniqueName: \"kubernetes.io/projected/181d01dd-6034-4e63-85d3-9179c8d28f59-kube-api-access-9vr89\") pod \"ingress-canary-qwvmj\" (UID: \"181d01dd-6034-4e63-85d3-9179c8d28f59\") " pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.525504 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.525470    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwvmj"
Jul 24 19:34:55.573630 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.573546    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:34:55.576628 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.576599    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:34:55.926378 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.926339    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:55.926579 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:55.926404    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:55.926579 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.926466    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 19:34:55.926579 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.926541    2541 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 19:34:55.926579 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.926547    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls podName:625809e2-a447-47cc-8855-1258e486fb87 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:56.926527841 +0000 UTC m=+37.050866999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls") pod "dns-default-vfbx8" (UID: "625809e2-a447-47cc-8855-1258e486fb87") : secret "dns-default-metrics-tls" not found
Jul 24 19:34:55.926579 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.926556    2541 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f8b757b4-2ftkr: secret "image-registry-tls" not found
Jul 24 19:34:55.926886 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:55.926603    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls podName:5724d911-2242-43e9-8f35-9ce7a75b9aad nodeName:}" failed. No retries permitted until 2026-07-24 19:34:56.926585162 +0000 UTC m=+37.050924314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls") pod "image-registry-74f8b757b4-2ftkr" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad") : secret "image-registry-tls" not found
Jul 24 19:34:56.191127 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.190926    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwvmj"]
Jul 24 19:34:56.195107 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:34:56.195076    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181d01dd_6034_4e63_85d3_9179c8d28f59.slice/crio-9365579e620728d0a8ebd96e77049656b77f1cd5fffccecec47a257484aaf0d0 WatchSource:0}: Error finding container 9365579e620728d0a8ebd96e77049656b77f1cd5fffccecec47a257484aaf0d0: Status 404 returned error can't find the container with id 9365579e620728d0a8ebd96e77049656b77f1cd5fffccecec47a257484aaf0d0
Jul 24 19:34:56.573214 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.573175    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:34:56.573382 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.573226    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:34:56.577179 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.577151    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srqs8\""
Jul 24 19:34:56.577507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.577194    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:34:56.577507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.577151    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n5p7p\""
Jul 24 19:34:56.577507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.577155    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 19:34:56.577507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.577164    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 19:34:56.868298 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.868149    2541 generic.go:356] "Generic (PLEG): container finished" podID="2ddd4a06-4cec-41af-a784-2249b3e39fa5" containerID="66f33b25eb0195d24aaf2a7f2f4c825f909c35ee237e29b202e2f540bfd0cc64" exitCode=0
Jul 24 19:34:56.868298 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.868236    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerDied","Data":"66f33b25eb0195d24aaf2a7f2f4c825f909c35ee237e29b202e2f540bfd0cc64"}
Jul 24 19:34:56.869600 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.869570    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwvmj" event={"ID":"181d01dd-6034-4e63-85d3-9179c8d28f59","Type":"ContainerStarted","Data":"9365579e620728d0a8ebd96e77049656b77f1cd5fffccecec47a257484aaf0d0"}
Jul 24 19:34:56.932957 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.932924    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:56.933115 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:56.932972    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:56.933115 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:56.933086    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 19:34:56.933183 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:56.933145    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls podName:625809e2-a447-47cc-8855-1258e486fb87 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:58.933130412 +0000 UTC m=+39.057469550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls") pod "dns-default-vfbx8" (UID: "625809e2-a447-47cc-8855-1258e486fb87") : secret "dns-default-metrics-tls" not found
Jul 24 19:34:56.933183 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:56.933089    2541 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 19:34:56.933183 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:56.933179    2541 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f8b757b4-2ftkr: secret "image-registry-tls" not found
Jul 24 19:34:56.933279 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:56.933219    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls podName:5724d911-2242-43e9-8f35-9ce7a75b9aad nodeName:}" failed. No retries permitted until 2026-07-24 19:34:58.933208423 +0000 UTC m=+39.057547576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls") pod "image-registry-74f8b757b4-2ftkr" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad") : secret "image-registry-tls" not found
Jul 24 19:34:57.878925 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:57.878883    2541 generic.go:356] "Generic (PLEG): container finished" podID="2ddd4a06-4cec-41af-a784-2249b3e39fa5" containerID="4984b718e2cf2aac31bb20600cb83a79c72417e587621aae516c8e247459352f" exitCode=0
Jul 24 19:34:57.879335 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:57.878943    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerDied","Data":"4984b718e2cf2aac31bb20600cb83a79c72417e587621aae516c8e247459352f"}
Jul 24 19:34:58.884552 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:58.884342    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" event={"ID":"2ddd4a06-4cec-41af-a784-2249b3e39fa5","Type":"ContainerStarted","Data":"583fb64e9ced07100cb466bcaf68d6210b5b5214c05bb3d5c6bfea29fdf66742"}
Jul 24 19:34:58.885833 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:58.885812    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwvmj" event={"ID":"181d01dd-6034-4e63-85d3-9179c8d28f59","Type":"ContainerStarted","Data":"8f7b8104ac6a4ca029af7c8ddce2329333ad3e07d2f84985a93872e2cbfbaf8a"}
Jul 24 19:34:58.906810 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:58.906745    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gwp5p" podStartSLOduration=8.431828109 podStartE2EDuration="37.906729666s" totalImagesPullingTime="29.474901557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:58.90569949 +0000 UTC m=+39.030038648" watchObservedRunningTime="2026-07-24 19:34:58.906729666 +0000 UTC m=+39.031068822"
Jul 24 19:34:58.921547 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:58.921507    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qwvmj" podStartSLOduration=1.554213589 podStartE2EDuration="3.921492917s" totalImagesPullingTime="2.367279328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:34:58.920953539 +0000 UTC m=+39.045292696" watchObservedRunningTime="2026-07-24 19:34:58.921492917 +0000 UTC m=+39.045832073"
Jul 24 19:34:58.949370 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:58.949339    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:34:58.949505 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:34:58.949389    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:34:58.949545 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:58.949509    2541 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 19:34:58.949545 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:58.949521    2541 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f8b757b4-2ftkr: secret "image-registry-tls" not found
Jul 24 19:34:58.949627 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:58.949563    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls podName:5724d911-2242-43e9-8f35-9ce7a75b9aad nodeName:}" failed. No retries permitted until 2026-07-24 19:35:02.949551209 +0000 UTC m=+43.073890355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls") pod "image-registry-74f8b757b4-2ftkr" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad") : secret "image-registry-tls" not found
Jul 24 19:34:58.949627 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:58.949509    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 19:34:58.949710 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:34:58.949640    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls podName:625809e2-a447-47cc-8855-1258e486fb87 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:02.949622101 +0000 UTC m=+43.073961235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls") pod "dns-default-vfbx8" (UID: "625809e2-a447-47cc-8855-1258e486fb87") : secret "dns-default-metrics-tls" not found
Jul 24 19:35:02.977186 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:02.977147    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:35:02.977611 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:02.977200    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:35:02.977611 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:02.977301    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 19:35:02.977611 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:02.977319    2541 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 19:35:02.977611 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:02.977329    2541 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f8b757b4-2ftkr: secret "image-registry-tls" not found
Jul 24 19:35:02.977611 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:02.977365    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls podName:625809e2-a447-47cc-8855-1258e486fb87 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:10.977350357 +0000 UTC m=+51.101689528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls") pod "dns-default-vfbx8" (UID: "625809e2-a447-47cc-8855-1258e486fb87") : secret "dns-default-metrics-tls" not found
Jul 24 19:35:02.977611 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:02.977379    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls podName:5724d911-2242-43e9-8f35-9ce7a75b9aad nodeName:}" failed. No retries permitted until 2026-07-24 19:35:10.977373302 +0000 UTC m=+51.101712436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls") pod "image-registry-74f8b757b4-2ftkr" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad") : secret "image-registry-tls" not found
Jul 24 19:35:06.358594 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.358553    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7895ff9947-rjb69"]
Jul 24 19:35:06.394130 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.394086    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7895ff9947-rjb69"]
Jul 24 19:35:06.394301 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.394212    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.396983 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.396946    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 19:35:06.397236 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.397217    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 19:35:06.397323 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.397291    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 19:35:06.397388 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.397366    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sqtnq\""
Jul 24 19:35:06.397444 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.397428    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 19:35:06.397492 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.397445    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 19:35:06.397492 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.397452    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 19:35:06.501957 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.501913    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.501957 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.501957    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.502231 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.502116    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-stats-auth\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.502231 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.502153    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-default-certificate\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.502231 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.502189    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flkvk\" (UniqueName: \"kubernetes.io/projected/453dc48a-2e5e-4a9d-93b0-ab62e2128529-kube-api-access-flkvk\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.553645 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.553611    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"]
Jul 24 19:35:06.573358 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.573330    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"]
Jul 24 19:35:06.573527 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.573461    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"
Jul 24 19:35:06.575886 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.575856    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cchg8\""
Jul 24 19:35:06.595526 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.595497    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.597962 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.597936    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 24 19:35:06.598228 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.598209    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 24 19:35:06.598353 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.598290    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ntmxw\""
Jul 24 19:35:06.598353 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.598302    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:35:06.598604 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.598587    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 24 19:35:06.599147 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.599132    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"]
Jul 24 19:35:06.602450 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.602428    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flkvk\" (UniqueName: \"kubernetes.io/projected/453dc48a-2e5e-4a9d-93b0-ab62e2128529-kube-api-access-flkvk\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.602528 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.602463    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.602528 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.602483    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.602616 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:06.602584    2541 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 19:35:06.602616 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:06.602610    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:07.102595752 +0000 UTC m=+47.226934889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : configmap references non-existent config key: service-ca.crt
Jul 24 19:35:06.602743 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:06.602638    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:07.102624399 +0000 UTC m=+47.226963533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : secret "router-metrics-certs-default" not found
Jul 24 19:35:06.602811 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.602797    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-stats-auth\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.602844 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.602824    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-default-certificate\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.606614 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.606587    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-stats-auth\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.606701 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.606593    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-default-certificate\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.613966 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.613910    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flkvk\" (UniqueName: \"kubernetes.io/projected/453dc48a-2e5e-4a9d-93b0-ab62e2128529-kube-api-access-flkvk\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:06.621478 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.621454    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"]
Jul 24 19:35:06.621597 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.621571    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:06.624270 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.624249    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 24 19:35:06.624270 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.624264    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mb8c5\""
Jul 24 19:35:06.624434 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.624279    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 24 19:35:06.641703 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.641670    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"]
Jul 24 19:35:06.641703 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.641705    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"]
Jul 24 19:35:06.641904 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.641719    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"]
Jul 24 19:35:06.641904 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.641733    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"]
Jul 24 19:35:06.641904 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.641783    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.644394 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.644368    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:35:06.644514 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.644374    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cnzzk\""
Jul 24 19:35:06.644514 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.644408    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 19:35:06.644694 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.644677    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 19:35:06.644785 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.644709    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 19:35:06.703400 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.703360    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66168002-0b89-4954-8ab3-c6a54de37249-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.703400 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.703400    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjtd\" (UniqueName: \"kubernetes.io/projected/3e38ba69-fc93-41d5-b540-790addf003f9-kube-api-access-9mjtd\") pod \"network-check-source-7d88cb55d8-c5kl9\" (UID: \"3e38ba69-fc93-41d5-b540-790addf003f9\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"
Jul 24 19:35:06.703626 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.703430    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqwgd\" (UniqueName: \"kubernetes.io/projected/66168002-0b89-4954-8ab3-c6a54de37249-kube-api-access-kqwgd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.703626 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.703553    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66168002-0b89-4954-8ab3-c6a54de37249-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.804495 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804453    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66168002-0b89-4954-8ab3-c6a54de37249-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.804495 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804494    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:06.804698 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804527    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0f27bb-5686-435e-b02f-bdf7e398a326-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.804698 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804555    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vqkz\" (UniqueName: \"kubernetes.io/projected/db0f27bb-5686-435e-b02f-bdf7e398a326-kube-api-access-8vqkz\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.804698 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804612    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjtd\" (UniqueName: \"kubernetes.io/projected/3e38ba69-fc93-41d5-b540-790addf003f9-kube-api-access-9mjtd\") pod \"network-check-source-7d88cb55d8-c5kl9\" (UID: \"3e38ba69-fc93-41d5-b540-790addf003f9\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"
Jul 24 19:35:06.804698 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804640    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:06.804861 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804706    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db0f27bb-5686-435e-b02f-bdf7e398a326-config\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.804861 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804735    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66168002-0b89-4954-8ab3-c6a54de37249-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.804861 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.804759    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqwgd\" (UniqueName: \"kubernetes.io/projected/66168002-0b89-4954-8ab3-c6a54de37249-kube-api-access-kqwgd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.805146 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.805129    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66168002-0b89-4954-8ab3-c6a54de37249-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.807001 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.806980    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66168002-0b89-4954-8ab3-c6a54de37249-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.812507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.812480    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqwgd\" (UniqueName: \"kubernetes.io/projected/66168002-0b89-4954-8ab3-c6a54de37249-kube-api-access-kqwgd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd\" (UID: \"66168002-0b89-4954-8ab3-c6a54de37249\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.812618 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.812544    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjtd\" (UniqueName: \"kubernetes.io/projected/3e38ba69-fc93-41d5-b540-790addf003f9-kube-api-access-9mjtd\") pod \"network-check-source-7d88cb55d8-c5kl9\" (UID: \"3e38ba69-fc93-41d5-b540-790addf003f9\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"
Jul 24 19:35:06.882805 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.882708    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"
Jul 24 19:35:06.904075 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.904051    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"
Jul 24 19:35:06.905265 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.905241    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:06.905367 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.905280    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0f27bb-5686-435e-b02f-bdf7e398a326-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.905367 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.905301    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqkz\" (UniqueName: \"kubernetes.io/projected/db0f27bb-5686-435e-b02f-bdf7e398a326-kube-api-access-8vqkz\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.905367 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:06.905346    2541 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 19:35:06.905497 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:06.905412    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert podName:0e0d134e-308b-4c18-8bd3-fdfc04c38d0f nodeName:}" failed. No retries permitted until 2026-07-24 19:35:07.405389138 +0000 UTC m=+47.529728295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqpsq" (UID: "0e0d134e-308b-4c18-8bd3-fdfc04c38d0f") : secret "networking-console-plugin-cert" not found
Jul 24 19:35:06.905497 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.905485    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:06.905607 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.905555    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db0f27bb-5686-435e-b02f-bdf7e398a326-config\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.906041 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.906021    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db0f27bb-5686-435e-b02f-bdf7e398a326-config\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.906298 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.906274    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:06.907528 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.907506    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0f27bb-5686-435e-b02f-bdf7e398a326-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.914985 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.914954    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vqkz\" (UniqueName: \"kubernetes.io/projected/db0f27bb-5686-435e-b02f-bdf7e398a326-kube-api-access-8vqkz\") pod \"service-ca-operator-5d6c75f84f-5t9n7\" (UID: \"db0f27bb-5686-435e-b02f-bdf7e398a326\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:06.950653 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:06.950594    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"
Jul 24 19:35:07.055437 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.054621    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9"]
Jul 24 19:35:07.062322 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:07.061861    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e38ba69_fc93_41d5_b540_790addf003f9.slice/crio-2aa01d8604eabee8b83a0eae8d8b83fe7dadbbb93016351cba91fba9c991a16f WatchSource:0}: Error finding container 2aa01d8604eabee8b83a0eae8d8b83fe7dadbbb93016351cba91fba9c991a16f: Status 404 returned error can't find the container with id 2aa01d8604eabee8b83a0eae8d8b83fe7dadbbb93016351cba91fba9c991a16f
Jul 24 19:35:07.106555 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.106522    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:07.106555 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.106560    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:07.106744 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:07.106698    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:08.106683471 +0000 UTC m=+48.231022618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : configmap references non-existent config key: service-ca.crt
Jul 24 19:35:07.106744 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:07.106696    2541 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 19:35:07.106744 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:07.106727    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:08.106720942 +0000 UTC m=+48.231060076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : secret "router-metrics-certs-default" not found
Jul 24 19:35:07.110801 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.110760    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd"]
Jul 24 19:35:07.113022 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:07.112997    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66168002_0b89_4954_8ab3_c6a54de37249.slice/crio-ab3bf54d5bb04699e5f084f44ece27a2912a284dc6362d4f8530e9e275c3d1a2 WatchSource:0}: Error finding container ab3bf54d5bb04699e5f084f44ece27a2912a284dc6362d4f8530e9e275c3d1a2: Status 404 returned error can't find the container with id ab3bf54d5bb04699e5f084f44ece27a2912a284dc6362d4f8530e9e275c3d1a2
Jul 24 19:35:07.136190 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.136162    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7"]
Jul 24 19:35:07.138972 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:07.138949    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0f27bb_5686_435e_b02f_bdf7e398a326.slice/crio-092bebf6272af10c993eeab8e35046f26acf4c58c15c1e0a80d2cd262a24512f WatchSource:0}: Error finding container 092bebf6272af10c993eeab8e35046f26acf4c58c15c1e0a80d2cd262a24512f: Status 404 returned error can't find the container with id 092bebf6272af10c993eeab8e35046f26acf4c58c15c1e0a80d2cd262a24512f
Jul 24 19:35:07.410027 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.409945    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:07.410403 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:07.410105    2541 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 19:35:07.410403 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:07.410179    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert podName:0e0d134e-308b-4c18-8bd3-fdfc04c38d0f nodeName:}" failed. No retries permitted until 2026-07-24 19:35:08.410160618 +0000 UTC m=+48.534499764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqpsq" (UID: "0e0d134e-308b-4c18-8bd3-fdfc04c38d0f") : secret "networking-console-plugin-cert" not found
Jul 24 19:35:07.910028 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.909996    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd" event={"ID":"66168002-0b89-4954-8ab3-c6a54de37249","Type":"ContainerStarted","Data":"ab3bf54d5bb04699e5f084f44ece27a2912a284dc6362d4f8530e9e275c3d1a2"}
Jul 24 19:35:07.911296 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.911258    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7" event={"ID":"db0f27bb-5686-435e-b02f-bdf7e398a326","Type":"ContainerStarted","Data":"092bebf6272af10c993eeab8e35046f26acf4c58c15c1e0a80d2cd262a24512f"}
Jul 24 19:35:07.912595 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:07.912548    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9" event={"ID":"3e38ba69-fc93-41d5-b540-790addf003f9","Type":"ContainerStarted","Data":"2aa01d8604eabee8b83a0eae8d8b83fe7dadbbb93016351cba91fba9c991a16f"}
Jul 24 19:35:08.117738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:08.117696    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:08.117738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:08.117747    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:08.118005 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:08.117878    2541 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 19:35:08.118005 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:08.117948    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:10.117930318 +0000 UTC m=+50.242269466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : secret "router-metrics-certs-default" not found
Jul 24 19:35:08.118005 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:08.117969    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:10.11795911 +0000 UTC m=+50.242298256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : configmap references non-existent config key: service-ca.crt
Jul 24 19:35:08.420323 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:08.420273    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:08.420761 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:08.420469    2541 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 19:35:08.420761 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:08.420545    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert podName:0e0d134e-308b-4c18-8bd3-fdfc04c38d0f nodeName:}" failed. No retries permitted until 2026-07-24 19:35:10.420529672 +0000 UTC m=+50.544868951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqpsq" (UID: "0e0d134e-308b-4c18-8bd3-fdfc04c38d0f") : secret "networking-console-plugin-cert" not found
Jul 24 19:35:10.134983 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:10.134948    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:10.134983 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:10.134986    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:10.135452 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:10.135141    2541 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 19:35:10.135452 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:10.135199    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:14.135175414 +0000 UTC m=+54.259514563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : configmap references non-existent config key: service-ca.crt
Jul 24 19:35:10.135452 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:10.135228    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:14.135216867 +0000 UTC m=+54.259556036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : secret "router-metrics-certs-default" not found
Jul 24 19:35:10.437603 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:10.437511    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:10.437788 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:10.437641    2541 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 19:35:10.437788 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:10.437730    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert podName:0e0d134e-308b-4c18-8bd3-fdfc04c38d0f nodeName:}" failed. No retries permitted until 2026-07-24 19:35:14.437705687 +0000 UTC m=+54.562044825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqpsq" (UID: "0e0d134e-308b-4c18-8bd3-fdfc04c38d0f") : secret "networking-console-plugin-cert" not found
Jul 24 19:35:11.042598 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.042553    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:35:11.042845 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.042691    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:35:11.042845 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:11.042709    2541 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 19:35:11.042845 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:11.042732    2541 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f8b757b4-2ftkr: secret "image-registry-tls" not found
Jul 24 19:35:11.042845 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:11.042823    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls podName:5724d911-2242-43e9-8f35-9ce7a75b9aad nodeName:}" failed. No retries permitted until 2026-07-24 19:35:27.042802552 +0000 UTC m=+67.167141708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls") pod "image-registry-74f8b757b4-2ftkr" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad") : secret "image-registry-tls" not found
Jul 24 19:35:11.042845 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:11.042842    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 19:35:11.043094 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:11.042931    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls podName:625809e2-a447-47cc-8855-1258e486fb87 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:27.042918647 +0000 UTC m=+67.167257781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls") pod "dns-default-vfbx8" (UID: "625809e2-a447-47cc-8855-1258e486fb87") : secret "dns-default-metrics-tls" not found
Jul 24 19:35:11.925379 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.925339    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9" event={"ID":"3e38ba69-fc93-41d5-b540-790addf003f9","Type":"ContainerStarted","Data":"6a827c7b5f66085384b8e7f9e94ff4d3dbba4723a0ae09aec88d24679597d21b"}
Jul 24 19:35:11.927070 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.927042    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd" event={"ID":"66168002-0b89-4954-8ab3-c6a54de37249","Type":"ContainerStarted","Data":"ef7f6fc0cd7aafa1a26eb9490c05e9c6f26fab5597fdca6e97df19de5c61e473"}
Jul 24 19:35:11.928582 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.928555    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7" event={"ID":"db0f27bb-5686-435e-b02f-bdf7e398a326","Type":"ContainerStarted","Data":"4c55cd34ad810a66054cd64bb00c329d0869c1ea333d6b1fbc88328e5ca296d5"}
Jul 24 19:35:11.940524 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.940483    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-c5kl9" podStartSLOduration=1.696238089 podStartE2EDuration="5.940465887s" totalImagesPullingTime="4.244227798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:11.939143956 +0000 UTC m=+52.063483113" watchObservedRunningTime="2026-07-24 19:35:11.940465887 +0000 UTC m=+52.064805043"
Jul 24 19:35:11.953945 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.953896    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7" podStartSLOduration=1.796722983 podStartE2EDuration="5.953879184s" totalImagesPullingTime="4.157156201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:11.953022037 +0000 UTC m=+52.077361194" watchObservedRunningTime="2026-07-24 19:35:11.953879184 +0000 UTC m=+52.078218341"
Jul 24 19:35:11.972384 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:11.972324    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd" podStartSLOduration=1.7893440859999998 podStartE2EDuration="5.972309461s" totalImagesPullingTime="4.182965375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:11.971530339 +0000 UTC m=+52.095869502" watchObservedRunningTime="2026-07-24 19:35:11.972309461 +0000 UTC m=+52.096648616"
Jul 24 19:35:12.128124 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.128088    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xxhm6"]
Jul 24 19:35:12.145480 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.145449    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxhm6"]
Jul 24 19:35:12.145667 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.145600    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.148426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.148202    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 19:35:12.148426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.148215    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 19:35:12.148426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.148204    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 19:35:12.148821 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.148800    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 19:35:12.148821 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.148811    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mq7m6\""
Jul 24 19:35:12.253883 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.253782    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-crio-socket\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.253883 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.253835    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.253883 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.253863    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9vmk\" (UniqueName: \"kubernetes.io/projected/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-api-access-f9vmk\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.254173 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.253931    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-data-volume\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.254173 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.253966    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.354381 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.354335    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-crio-socket\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.354381 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.354379    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.354632 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.354402    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9vmk\" (UniqueName: \"kubernetes.io/projected/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-api-access-f9vmk\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.354632 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.354490    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 19:35:12.354632 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.354568    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:12.854546737 +0000 UTC m=+52.978885875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : configmap "kube-rbac-proxy" not found
Jul 24 19:35:12.354632 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.354580    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-crio-socket\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.354632 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.354611    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-data-volume\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.354916 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.354654    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.354916 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.354835    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:12.354916 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.354895    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:12.854879151 +0000 UTC m=+52.979218300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:12.355205 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.354979    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-data-volume\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.362468 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.362444    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9vmk\" (UniqueName: \"kubernetes.io/projected/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-api-access-f9vmk\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.843376 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.843343    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"]
Jul 24 19:35:12.859700 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.859651    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.860019 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.859799    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:12.860019 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.859842    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:12.860019 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.859887    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:13.859847298 +0000 UTC m=+53.984186439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:12.860019 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.859896    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 19:35:12.860234 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:12.860036    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:13.860023955 +0000 UTC m=+53.984363102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : configmap "kube-rbac-proxy" not found
Jul 24 19:35:12.863479 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.863442    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"]
Jul 24 19:35:12.863617 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.863586    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"
Jul 24 19:35:12.866272 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.866226    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 24 19:35:12.866561 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.866230    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 24 19:35:12.868186 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.867157    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pn6qd\""
Jul 24 19:35:12.961516 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:12.961477    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhw85\" (UniqueName: \"kubernetes.io/projected/dfcf4df2-7216-47cd-a79e-d2e0d8d38997-kube-api-access-hhw85\") pod \"migrator-6865c9967-68f64\" (UID: \"dfcf4df2-7216-47cd-a79e-d2e0d8d38997\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"
Jul 24 19:35:13.062691 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.062640    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhw85\" (UniqueName: \"kubernetes.io/projected/dfcf4df2-7216-47cd-a79e-d2e0d8d38997-kube-api-access-hhw85\") pod \"migrator-6865c9967-68f64\" (UID: \"dfcf4df2-7216-47cd-a79e-d2e0d8d38997\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"
Jul 24 19:35:13.073062 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.072421    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhw85\" (UniqueName: \"kubernetes.io/projected/dfcf4df2-7216-47cd-a79e-d2e0d8d38997-kube-api-access-hhw85\") pod \"migrator-6865c9967-68f64\" (UID: \"dfcf4df2-7216-47cd-a79e-d2e0d8d38997\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"
Jul 24 19:35:13.176275 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.176239    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"
Jul 24 19:35:13.310204 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.310173    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-68f64"]
Jul 24 19:35:13.313998 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:13.313963    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcf4df2_7216_47cd_a79e_d2e0d8d38997.slice/crio-c1a520c7b04bb930c5d2117360c94eed050fa07e95963ca979069808e7e56f77 WatchSource:0}: Error finding container c1a520c7b04bb930c5d2117360c94eed050fa07e95963ca979069808e7e56f77: Status 404 returned error can't find the container with id c1a520c7b04bb930c5d2117360c94eed050fa07e95963ca979069808e7e56f77
Jul 24 19:35:13.522274 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.522185    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-276zs_02036468-9e21-4e65-aa8a-cff992d3d777/dns-node-resolver/0.log"
Jul 24 19:35:13.868895 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.868815    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:13.868895 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.868884    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:13.869174 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:13.868941    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 19:35:13.869174 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:13.869008    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:15.868991208 +0000 UTC m=+55.993330345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : configmap "kube-rbac-proxy" not found
Jul 24 19:35:13.869174 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:13.869029    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:13.869174 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:13.869081    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:15.869065288 +0000 UTC m=+55.993404442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:13.934877 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:13.934817    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64" event={"ID":"dfcf4df2-7216-47cd-a79e-d2e0d8d38997","Type":"ContainerStarted","Data":"c1a520c7b04bb930c5d2117360c94eed050fa07e95963ca979069808e7e56f77"}
Jul 24 19:35:14.171089 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:14.171051    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:14.171089 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:14.171098    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:14.171630 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:14.171229    2541 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 19:35:14.171630 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:14.171233    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:22.171209797 +0000 UTC m=+62.295548933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : configmap references non-existent config key: service-ca.crt
Jul 24 19:35:14.171630 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:14.171404    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:22.171377916 +0000 UTC m=+62.295717065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : secret "router-metrics-certs-default" not found
Jul 24 19:35:14.474718 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:14.474620    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:14.474918 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:14.474756    2541 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 19:35:14.474918 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:14.474844    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert podName:0e0d134e-308b-4c18-8bd3-fdfc04c38d0f nodeName:}" failed. No retries permitted until 2026-07-24 19:35:22.474827476 +0000 UTC m=+62.599166614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqpsq" (UID: "0e0d134e-308b-4c18-8bd3-fdfc04c38d0f") : secret "networking-console-plugin-cert" not found
Jul 24 19:35:14.920760 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:14.920733    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4qpn_bb3d1179-ce80-4527-b6f6-5719469a8ab2/node-ca/0.log"
Jul 24 19:35:14.940565 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:14.940524    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64" event={"ID":"dfcf4df2-7216-47cd-a79e-d2e0d8d38997","Type":"ContainerStarted","Data":"6d054276849a8105b9f129ec1d14b9037091df13ac1ab5ca9832801f5e346a2c"}
Jul 24 19:35:14.940717 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:14.940581    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64" event={"ID":"dfcf4df2-7216-47cd-a79e-d2e0d8d38997","Type":"ContainerStarted","Data":"6bb137d6543b4a6af54edd6b01be94c8abd2b8b2f0469df0e33015de8697ad81"}
Jul 24 19:35:14.955995 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:14.955943    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-68f64" podStartSLOduration=1.742241399 podStartE2EDuration="2.955927203s" totalImagesPullingTime="1.213685804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:14.954320707 +0000 UTC m=+55.078659862" watchObservedRunningTime="2026-07-24 19:35:14.955927203 +0000 UTC m=+55.080266414"
Jul 24 19:35:15.521033 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:15.521005    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwvmj_181d01dd-6034-4e63-85d3-9179c8d28f59/serve-healthcheck-canary/0.log"
Jul 24 19:35:15.885309 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:15.885275    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:15.885468 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:15.885350    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:15.885468 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:15.885402    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 19:35:15.885468 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:15.885452    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:15.885563 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:15.885474    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:19.885458629 +0000 UTC m=+60.009797763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : configmap "kube-rbac-proxy" not found
Jul 24 19:35:15.885563 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:15.885495    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:19.885483943 +0000 UTC m=+60.009823077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:19.919699 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:19.919656    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:19.920196 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:19.919791    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:19.920196 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:19.919878    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:19.920196 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:19.919969    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:27.919947311 +0000 UTC m=+68.044286444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:19.920196 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:19.919884    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 19:35:19.920196 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:19.920043    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:27.920000339 +0000 UTC m=+68.044339477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : configmap "kube-rbac-proxy" not found
Jul 24 19:35:22.237739 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:22.237696    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:22.237739 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:22.237746    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:22.238246 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:22.237957    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:38.237931825 +0000 UTC m=+78.362270958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : configmap references non-existent config key: service-ca.crt
Jul 24 19:35:22.238246 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:22.238000    2541 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 19:35:22.238246 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:22.238069    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs podName:453dc48a-2e5e-4a9d-93b0-ab62e2128529 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:38.2380513 +0000 UTC m=+78.362390451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs") pod "router-default-7895ff9947-rjb69" (UID: "453dc48a-2e5e-4a9d-93b0-ab62e2128529") : secret "router-metrics-certs-default" not found
Jul 24 19:35:22.540949 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:22.540854    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:22.541098 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:22.540971    2541 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 19:35:22.541098 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:22.541027    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert podName:0e0d134e-308b-4c18-8bd3-fdfc04c38d0f nodeName:}" failed. No retries permitted until 2026-07-24 19:35:38.541010965 +0000 UTC m=+78.665350098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-xqpsq" (UID: "0e0d134e-308b-4c18-8bd3-fdfc04c38d0f") : secret "networking-console-plugin-cert" not found
Jul 24 19:35:22.865727 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:22.865654    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7l4c"
Jul 24 19:35:26.272664 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.272622    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:35:26.273133 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.272693    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:35:26.275277 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.275252    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hsq\" (UniqueName: \"kubernetes.io/projected/760abb63-cf10-4984-b24e-4090bb0d0015-kube-api-access-f8hsq\") pod \"network-check-target-h2z9w\" (UID: \"760abb63-cf10-4984-b24e-4090bb0d0015\") " pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:35:26.275481 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.275464    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:35:26.285939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.285917    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/459ff394-f5bd-4502-b106-c57e6f6cb884-original-pull-secret\") pod \"global-pull-secret-syncer-56r2d\" (UID: \"459ff394-f5bd-4502-b106-c57e6f6cb884\") " pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:35:26.295682 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.294078    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n5p7p\""
Jul 24 19:35:26.300953 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.300924    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:35:26.373198 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.373169    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:35:26.375826 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.375802    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:35:26.384010 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:26.383987    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 19:35:26.384138 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:26.384086    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs podName:77763871-5b8d-4026-b916-770abf823589 nodeName:}" failed. No retries permitted until 2026-07-24 19:36:30.384065606 +0000 UTC m=+130.508404753 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs") pod "network-metrics-daemon-pbgmc" (UID: "77763871-5b8d-4026-b916-770abf823589") : secret "metrics-daemon-secret" not found
Jul 24 19:35:26.423125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.423007    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2z9w"]
Jul 24 19:35:26.425751 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:26.425727    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760abb63_cf10_4984_b24e_4090bb0d0015.slice/crio-621b1f6cacaceab52ca23dcadd72e768348711d7f61197c574cdd2619fb4b1fa WatchSource:0}: Error finding container 621b1f6cacaceab52ca23dcadd72e768348711d7f61197c574cdd2619fb4b1fa: Status 404 returned error can't find the container with id 621b1f6cacaceab52ca23dcadd72e768348711d7f61197c574cdd2619fb4b1fa
Jul 24 19:35:26.483563 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.483539    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56r2d"
Jul 24 19:35:26.609270 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.609239    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56r2d"]
Jul 24 19:35:26.612254 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:26.612230    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod459ff394_f5bd_4502_b106_c57e6f6cb884.slice/crio-824ea8f34a9027821d0003f6cc608ed5e6b899187ae01744a68db9f5ee3fb61c WatchSource:0}: Error finding container 824ea8f34a9027821d0003f6cc608ed5e6b899187ae01744a68db9f5ee3fb61c: Status 404 returned error can't find the container with id 824ea8f34a9027821d0003f6cc608ed5e6b899187ae01744a68db9f5ee3fb61c
Jul 24 19:35:26.980709 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.980671    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2z9w" event={"ID":"760abb63-cf10-4984-b24e-4090bb0d0015","Type":"ContainerStarted","Data":"eecdf5873c1a9d444db049e8cb1086345699527476800286c99b0445f7903cae"}
Jul 24 19:35:26.980939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.980801    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:35:26.980939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.980843    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2z9w" event={"ID":"760abb63-cf10-4984-b24e-4090bb0d0015","Type":"ContainerStarted","Data":"621b1f6cacaceab52ca23dcadd72e768348711d7f61197c574cdd2619fb4b1fa"}
Jul 24 19:35:26.981827 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.981797    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56r2d" event={"ID":"459ff394-f5bd-4502-b106-c57e6f6cb884","Type":"ContainerStarted","Data":"824ea8f34a9027821d0003f6cc608ed5e6b899187ae01744a68db9f5ee3fb61c"}
Jul 24 19:35:26.995650 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:26.995598    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2z9w" podStartSLOduration=65.995581849 podStartE2EDuration="1m5.995581849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:26.995050557 +0000 UTC m=+67.119389719" watchObservedRunningTime="2026-07-24 19:35:26.995581849 +0000 UTC m=+67.119921005"
Jul 24 19:35:27.077984 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.077952    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:35:27.078266 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.078029    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:35:27.080440 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.080406    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/625809e2-a447-47cc-8855-1258e486fb87-metrics-tls\") pod \"dns-default-vfbx8\" (UID: \"625809e2-a447-47cc-8855-1258e486fb87\") " pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:35:27.080559 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.080475    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"image-registry-74f8b757b4-2ftkr\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") " pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:35:27.303619 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.303529    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nx6vx\""
Jul 24 19:35:27.311816 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.311785    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:35:27.315346 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.315317    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p8txj\""
Jul 24 19:35:27.323600 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.323396    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:35:27.462085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.462050    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74f8b757b4-2ftkr"]
Jul 24 19:35:27.466466 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:27.466438    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5724d911_2242_43e9_8f35_9ce7a75b9aad.slice/crio-573d02430f4e484bc9154bff4fbf89ea431135ed12ccd498829609770c6c672d WatchSource:0}: Error finding container 573d02430f4e484bc9154bff4fbf89ea431135ed12ccd498829609770c6c672d: Status 404 returned error can't find the container with id 573d02430f4e484bc9154bff4fbf89ea431135ed12ccd498829609770c6c672d
Jul 24 19:35:27.513500 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.513383    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vfbx8"]
Jul 24 19:35:27.516214 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:27.516175    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625809e2_a447_47cc_8855_1258e486fb87.slice/crio-19f5cd95fa7433b2fd5a1d99cdcec86232f97b7e50cfb10e18033506479d2ef7 WatchSource:0}: Error finding container 19f5cd95fa7433b2fd5a1d99cdcec86232f97b7e50cfb10e18033506479d2ef7: Status 404 returned error can't find the container with id 19f5cd95fa7433b2fd5a1d99cdcec86232f97b7e50cfb10e18033506479d2ef7
Jul 24 19:35:27.986562 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.986185    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:27.986562 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.986270    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:27.986562 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:27.986387    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:27.986562 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:35:27.986447    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls podName:9ff9555a-9a1f-48da-b6d2-d62bde051d0c nodeName:}" failed. No retries permitted until 2026-07-24 19:35:43.986425948 +0000 UTC m=+84.110765096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxhm6" (UID: "9ff9555a-9a1f-48da-b6d2-d62bde051d0c") : secret "insights-runtime-extractor-tls" not found
Jul 24 19:35:27.986949 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.986866    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:27.988233 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.988191    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vfbx8" event={"ID":"625809e2-a447-47cc-8855-1258e486fb87","Type":"ContainerStarted","Data":"19f5cd95fa7433b2fd5a1d99cdcec86232f97b7e50cfb10e18033506479d2ef7"}
Jul 24 19:35:27.990199 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.990112    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr" event={"ID":"5724d911-2242-43e9-8f35-9ce7a75b9aad","Type":"ContainerStarted","Data":"c52b1f7e5b1d9af2e120ae9a458c62bdea449aff9e448d3adb0cbbdf7fcf5552"}
Jul 24 19:35:27.990199 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:27.990163    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr" event={"ID":"5724d911-2242-43e9-8f35-9ce7a75b9aad","Type":"ContainerStarted","Data":"573d02430f4e484bc9154bff4fbf89ea431135ed12ccd498829609770c6c672d"}
Jul 24 19:35:28.009554 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:28.009493    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr" podStartSLOduration=67.009470712 podStartE2EDuration="1m7.009470712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:28.008490523 +0000 UTC m=+68.132829680" watchObservedRunningTime="2026-07-24 19:35:28.009470712 +0000 UTC m=+68.133809868"
Jul 24 19:35:28.996011 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:28.995946    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:35:32.008689 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:32.008649    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vfbx8" event={"ID":"625809e2-a447-47cc-8855-1258e486fb87","Type":"ContainerStarted","Data":"b65bce14aa6070e724bf56b3d7cebd7e3e42240324f61c1131914beb7d57061a"}
Jul 24 19:35:32.009180 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:32.008715    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vfbx8" event={"ID":"625809e2-a447-47cc-8855-1258e486fb87","Type":"ContainerStarted","Data":"32f9c51ba5d94ebc4b3d59de041b13ca31dfe00b31f7f6a17c141826f5bc1fec"}
Jul 24 19:35:32.009180 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:32.008744    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:35:32.010166 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:32.010138    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56r2d" event={"ID":"459ff394-f5bd-4502-b106-c57e6f6cb884","Type":"ContainerStarted","Data":"07fa65c49be71c4f2b3b5a938c7126f885dfb7b86b908d34810a40a95b05f891"}
Jul 24 19:35:32.026999 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:32.026949    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vfbx8" podStartSLOduration=33.38303663 podStartE2EDuration="37.026932897s" totalImagesPullingTime="3.643896267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:32.024999843 +0000 UTC m=+72.149339026" watchObservedRunningTime="2026-07-24 19:35:32.026932897 +0000 UTC m=+72.151272086"
Jul 24 19:35:32.039498 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:32.039449    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-56r2d" podStartSLOduration=66.461563014 podStartE2EDuration="1m11.039436515s" totalImagesPullingTime="4.577873501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:32.03910648 +0000 UTC m=+72.163445635" watchObservedRunningTime="2026-07-24 19:35:32.039436515 +0000 UTC m=+72.163775724"
Jul 24 19:35:36.396466 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.396428    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"]
Jul 24 19:35:36.400974 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.400951    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.403576 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.403549    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 24 19:35:36.404680 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.404662    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 19:35:36.404790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.404717    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 19:35:36.404790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.404717    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 19:35:36.413674 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.413649    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"]
Jul 24 19:35:36.458507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.458462    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgt79\" (UniqueName: \"kubernetes.io/projected/d89d1827-ac32-4330-8714-728365994090-kube-api-access-tgt79\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.458695 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.458517    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d89d1827-ac32-4330-8714-728365994090-tmp\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.458695 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.458543    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d89d1827-ac32-4330-8714-728365994090-klusterlet-config\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.559790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.559734    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d89d1827-ac32-4330-8714-728365994090-tmp\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.559790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.559797    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d89d1827-ac32-4330-8714-728365994090-klusterlet-config\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.560006 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.559912    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgt79\" (UniqueName: \"kubernetes.io/projected/d89d1827-ac32-4330-8714-728365994090-kube-api-access-tgt79\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.560145 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.560126    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d89d1827-ac32-4330-8714-728365994090-tmp\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.562328 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.562305    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d89d1827-ac32-4330-8714-728365994090-klusterlet-config\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.577144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.577111    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgt79\" (UniqueName: \"kubernetes.io/projected/d89d1827-ac32-4330-8714-728365994090-kube-api-access-tgt79\") pod \"klusterlet-addon-workmgr-64fc6ccd9-5vvxb\" (UID: \"d89d1827-ac32-4330-8714-728365994090\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.711219 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.711127    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:36.840135 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:36.840100    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"]
Jul 24 19:35:36.843506 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:36.843478    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89d1827_ac32_4330_8714_728365994090.slice/crio-c3a0f1fa9b489ce7f593133e40d94b729e6152fd045bfec74ce75587d4f3238a WatchSource:0}: Error finding container c3a0f1fa9b489ce7f593133e40d94b729e6152fd045bfec74ce75587d4f3238a: Status 404 returned error can't find the container with id c3a0f1fa9b489ce7f593133e40d94b729e6152fd045bfec74ce75587d4f3238a
Jul 24 19:35:37.028173 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:37.028090    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb" event={"ID":"d89d1827-ac32-4330-8714-728365994090","Type":"ContainerStarted","Data":"c3a0f1fa9b489ce7f593133e40d94b729e6152fd045bfec74ce75587d4f3238a"}
Jul 24 19:35:38.274000 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.273575    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:38.274000 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.273622    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:38.274813 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.274785    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453dc48a-2e5e-4a9d-93b0-ab62e2128529-service-ca-bundle\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:38.277289 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.277246    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/453dc48a-2e5e-4a9d-93b0-ab62e2128529-metrics-certs\") pod \"router-default-7895ff9947-rjb69\" (UID: \"453dc48a-2e5e-4a9d-93b0-ab62e2128529\") " pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:38.506657 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.506575    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sqtnq\""
Jul 24 19:35:38.514862 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.514795    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:38.578043 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.577846    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:38.583301 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.583237    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e0d134e-308b-4c18-8bd3-fdfc04c38d0f-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-xqpsq\" (UID: \"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:38.671436 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.671401    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7895ff9947-rjb69"]
Jul 24 19:35:38.733102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.733068    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mb8c5\""
Jul 24 19:35:38.740869 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:38.740828    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"
Jul 24 19:35:39.391238 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:39.391203    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453dc48a_2e5e_4a9d_93b0_ab62e2128529.slice/crio-74c294f9755ae82cc1e8b9816eb1665f9f5dbd609cb2cf47eb1068ce8174677f WatchSource:0}: Error finding container 74c294f9755ae82cc1e8b9816eb1665f9f5dbd609cb2cf47eb1068ce8174677f: Status 404 returned error can't find the container with id 74c294f9755ae82cc1e8b9816eb1665f9f5dbd609cb2cf47eb1068ce8174677f
Jul 24 19:35:39.561326 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:39.561278    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq"]
Jul 24 19:35:39.565923 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:39.565884    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0d134e_308b_4c18_8bd3_fdfc04c38d0f.slice/crio-5259280f1f47c43baa8709ca49052b8dbbc54e23de45b12443f086456a1c45e4 WatchSource:0}: Error finding container 5259280f1f47c43baa8709ca49052b8dbbc54e23de45b12443f086456a1c45e4: Status 404 returned error can't find the container with id 5259280f1f47c43baa8709ca49052b8dbbc54e23de45b12443f086456a1c45e4
Jul 24 19:35:40.046254 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:40.046212    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7895ff9947-rjb69" event={"ID":"453dc48a-2e5e-4a9d-93b0-ab62e2128529","Type":"ContainerStarted","Data":"8be69ed542a4efbe6f11f59bf4315554921f19f8ef2df1f9d4a427c5285761e3"}
Jul 24 19:35:40.046466 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:40.046306    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7895ff9947-rjb69" event={"ID":"453dc48a-2e5e-4a9d-93b0-ab62e2128529","Type":"ContainerStarted","Data":"74c294f9755ae82cc1e8b9816eb1665f9f5dbd609cb2cf47eb1068ce8174677f"}
Jul 24 19:35:40.048166 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:40.048136    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq" event={"ID":"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f","Type":"ContainerStarted","Data":"5259280f1f47c43baa8709ca49052b8dbbc54e23de45b12443f086456a1c45e4"}
Jul 24 19:35:40.067296 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:40.067236    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7895ff9947-rjb69" podStartSLOduration=34.067219799 podStartE2EDuration="34.067219799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:40.065031542 +0000 UTC m=+80.189370768" watchObservedRunningTime="2026-07-24 19:35:40.067219799 +0000 UTC m=+80.191558932"
Jul 24 19:35:40.515258 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:40.515212    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:40.518214 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:40.518188    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:41.053626 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:41.053585    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb" event={"ID":"d89d1827-ac32-4330-8714-728365994090","Type":"ContainerStarted","Data":"43731442f95dd9c700565c14457ced0a5b42ad6b89bb1b682c8642c99f5f5824"}
Jul 24 19:35:41.053944 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:41.053907    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:41.053944 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:41.053954    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:41.055244 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:41.055222    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7895ff9947-rjb69"
Jul 24 19:35:41.055654 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:41.055625    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb"
Jul 24 19:35:41.069666 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:41.069614    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64fc6ccd9-5vvxb" podStartSLOduration=1.08830532 podStartE2EDuration="5.069597465s" totalImagesPullingTime="3.981292145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:41.06839459 +0000 UTC m=+81.192733748" watchObservedRunningTime="2026-07-24 19:35:41.069597465 +0000 UTC m=+81.193936621"
Jul 24 19:35:42.016025 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:42.015996    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vfbx8"
Jul 24 19:35:43.061985 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:43.061949    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq" event={"ID":"0e0d134e-308b-4c18-8bd3-fdfc04c38d0f","Type":"ContainerStarted","Data":"07c505744642b1955c2e197e68b0276a151f8725145c14754df7291bdba1c3b5"}
Jul 24 19:35:43.078736 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:43.078657    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-xqpsq" podStartSLOduration=34.534543844 podStartE2EDuration="37.078638669s" totalImagesPullingTime="2.544094825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:43.077947465 +0000 UTC m=+83.202286622" watchObservedRunningTime="2026-07-24 19:35:43.078638669 +0000 UTC m=+83.202977824"
Jul 24 19:35:44.029020 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:44.028964    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:44.031293 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:44.031254    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ff9555a-9a1f-48da-b6d2-d62bde051d0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxhm6\" (UID: \"9ff9555a-9a1f-48da-b6d2-d62bde051d0c\") " pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:44.258344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:44.258307    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mq7m6\""
Jul 24 19:35:44.266594 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:44.266561    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxhm6"
Jul 24 19:35:44.397930 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:44.397814    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxhm6"]
Jul 24 19:35:44.400564 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:35:44.400532    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff9555a_9a1f_48da_b6d2_d62bde051d0c.slice/crio-e63b22a6e830fa17d6221ba8bea883aacdf5b40da944998d85fd10ce79b2b033 WatchSource:0}: Error finding container e63b22a6e830fa17d6221ba8bea883aacdf5b40da944998d85fd10ce79b2b033: Status 404 returned error can't find the container with id e63b22a6e830fa17d6221ba8bea883aacdf5b40da944998d85fd10ce79b2b033
Jul 24 19:35:45.071683 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:45.071641    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxhm6" event={"ID":"9ff9555a-9a1f-48da-b6d2-d62bde051d0c","Type":"ContainerStarted","Data":"e63b22a6e830fa17d6221ba8bea883aacdf5b40da944998d85fd10ce79b2b033"}
Jul 24 19:35:47.317624 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:47.317586    2541 patch_prober.go:28] interesting pod/image-registry-74f8b757b4-2ftkr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 19:35:47.318054 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:47.317649    2541 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr" podUID="5724d911-2242-43e9-8f35-9ce7a75b9aad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:35:50.006975 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:50.006946    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:35:50.096493 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:50.096452    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxhm6" event={"ID":"9ff9555a-9a1f-48da-b6d2-d62bde051d0c","Type":"ContainerStarted","Data":"f91dda996cbb58d67ad1676eedd3ece903f8a4b8a4ee14def7de54e71f205833"}
Jul 24 19:35:53.109609 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:53.109521    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxhm6" event={"ID":"9ff9555a-9a1f-48da-b6d2-d62bde051d0c","Type":"ContainerStarted","Data":"39bafe5dd2288bc09cc9c5b093fd5a8098bff26cd0fb05435e24a27dc3f0d9e5"}
Jul 24 19:35:57.125610 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:57.125570    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxhm6" event={"ID":"9ff9555a-9a1f-48da-b6d2-d62bde051d0c","Type":"ContainerStarted","Data":"fbfbc7d82fad89a1d2cab877d142b59612d2013655ce6767c225d49e8d3c14e3"}
Jul 24 19:35:57.142501 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:57.142437    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xxhm6" podStartSLOduration=33.485158781 podStartE2EDuration="45.142416055s" totalImagesPullingTime="11.657257274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:35:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:57.142025428 +0000 UTC m=+97.266364594" watchObservedRunningTime="2026-07-24 19:35:57.142416055 +0000 UTC m=+97.266755212"
Jul 24 19:35:57.992909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:57.992877    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2z9w"
Jul 24 19:35:58.963426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:35:58.963391    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74f8b757b4-2ftkr"]
Jul 24 19:36:00.759022 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.758986    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x4g2d"]
Jul 24 19:36:00.764708 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.764684    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.767227 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.767198    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 19:36:00.767227 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.767212    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z4drf\""
Jul 24 19:36:00.767227 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.767219    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 19:36:00.767448 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.767359    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 19:36:00.768390 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.768373    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 19:36:00.768446 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.768392    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 19:36:00.768446 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.768430    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 19:36:00.773459 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773441    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a47109-1268-4f5f-83ba-ed38022a2741-metrics-client-ca\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773555 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773468    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-root\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773555 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773507    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-textfile\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773659 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773569    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-tls\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773659 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773594    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773659 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773649    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-sys\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773842 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773691    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773842 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773735    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-wtmp\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.773842 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.773760    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjg5\" (UniqueName: \"kubernetes.io/projected/f8a47109-1268-4f5f-83ba-ed38022a2741-kube-api-access-pzjg5\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874384 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874340    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a47109-1268-4f5f-83ba-ed38022a2741-metrics-client-ca\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874390    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-root\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874453    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-textfile\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874485    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-tls\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874508    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874540    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-sys\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874540    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-root\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874565    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874961 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:36:00.874600    2541 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 19:36:00.874961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874619    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-wtmp\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874645    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjg5\" (UniqueName: \"kubernetes.io/projected/f8a47109-1268-4f5f-83ba-ed38022a2741-kube-api-access-pzjg5\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874664    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-sys\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874961 ip-10-0-140-118 kubenswrapper[2541]: E0724 19:36:00.874669    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-tls podName:f8a47109-1268-4f5f-83ba-ed38022a2741 nodeName:}" failed. No retries permitted until 2026-07-24 19:36:01.374647109 +0000 UTC m=+101.498986256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-tls") pod "node-exporter-x4g2d" (UID: "f8a47109-1268-4f5f-83ba-ed38022a2741") : secret "node-exporter-tls" not found
Jul 24 19:36:00.874961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874839    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-textfile\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.874961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.874850    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-wtmp\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.875223 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.875070    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a47109-1268-4f5f-83ba-ed38022a2741-metrics-client-ca\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.875223 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.875138    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.876779 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.876755    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:00.883486 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:00.883462    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjg5\" (UniqueName: \"kubernetes.io/projected/f8a47109-1268-4f5f-83ba-ed38022a2741-kube-api-access-pzjg5\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:01.378527 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:01.378486    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-tls\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:01.380920 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:01.380891    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8a47109-1268-4f5f-83ba-ed38022a2741-node-exporter-tls\") pod \"node-exporter-x4g2d\" (UID: \"f8a47109-1268-4f5f-83ba-ed38022a2741\") " pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:01.674292 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:01.674259    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4g2d"
Jul 24 19:36:01.686979 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:36:01.686951    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a47109_1268_4f5f_83ba_ed38022a2741.slice/crio-3c94a0f309dd517806fac82b240d8b26d0b02a5e0ef8f52dc8d0c6712f800d6e WatchSource:0}: Error finding container 3c94a0f309dd517806fac82b240d8b26d0b02a5e0ef8f52dc8d0c6712f800d6e: Status 404 returned error can't find the container with id 3c94a0f309dd517806fac82b240d8b26d0b02a5e0ef8f52dc8d0c6712f800d6e
Jul 24 19:36:02.144800 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:02.144739    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4g2d" event={"ID":"f8a47109-1268-4f5f-83ba-ed38022a2741","Type":"ContainerStarted","Data":"3c94a0f309dd517806fac82b240d8b26d0b02a5e0ef8f52dc8d0c6712f800d6e"}
Jul 24 19:36:03.149658 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:03.149622    2541 generic.go:356] "Generic (PLEG): container finished" podID="f8a47109-1268-4f5f-83ba-ed38022a2741" containerID="03859e74b8ebbaab6ac115970b13c0e3fcbed6b30874d0261f69c6576fa9e268" exitCode=0
Jul 24 19:36:03.150087 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:03.149714    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4g2d" event={"ID":"f8a47109-1268-4f5f-83ba-ed38022a2741","Type":"ContainerDied","Data":"03859e74b8ebbaab6ac115970b13c0e3fcbed6b30874d0261f69c6576fa9e268"}
Jul 24 19:36:04.154987 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:04.154947    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4g2d" event={"ID":"f8a47109-1268-4f5f-83ba-ed38022a2741","Type":"ContainerStarted","Data":"e1380cf8e65a06989ac43eac851e3536146b4fb1f0e315cea48eba8ee0ed81b5"}
Jul 24 19:36:04.155381 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:04.155050    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4g2d" event={"ID":"f8a47109-1268-4f5f-83ba-ed38022a2741","Type":"ContainerStarted","Data":"c74e6f9e645ed4c23a292655e9a715e3daded043dcb444161843a493e90410a6"}
Jul 24 19:36:04.179236 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:04.179183    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x4g2d" podStartSLOduration=3.166616071 podStartE2EDuration="4.179161847s" totalImagesPullingTime="946.098251ms" totalInitContainerRuntime="66.447525ms" isStatefulPod=true podCreationTimestamp="2026-07-24 19:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:04.177135918 +0000 UTC m=+104.301475066" watchObservedRunningTime="2026-07-24 19:36:04.179161847 +0000 UTC m=+104.303501002"
Jul 24 19:36:17.201076 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:17.201040    2541 generic.go:356] "Generic (PLEG): container finished" podID="66168002-0b89-4954-8ab3-c6a54de37249" containerID="ef7f6fc0cd7aafa1a26eb9490c05e9c6f26fab5597fdca6e97df19de5c61e473" exitCode=0
Jul 24 19:36:17.201517 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:17.201118    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd" event={"ID":"66168002-0b89-4954-8ab3-c6a54de37249","Type":"ContainerDied","Data":"ef7f6fc0cd7aafa1a26eb9490c05e9c6f26fab5597fdca6e97df19de5c61e473"}
Jul 24 19:36:17.201517 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:17.201464    2541 scope.go:117] "RemoveContainer" containerID="ef7f6fc0cd7aafa1a26eb9490c05e9c6f26fab5597fdca6e97df19de5c61e473"
Jul 24 19:36:18.206392 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:18.206342    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd" event={"ID":"66168002-0b89-4954-8ab3-c6a54de37249","Type":"ContainerStarted","Data":"c97fdf126db528e3883e0521f89ae63a2a7f498a18bd3293b2b988ee21f2a1db"}
Jul 24 19:36:23.987585 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:23.987509    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr" podUID="5724d911-2242-43e9-8f35-9ce7a75b9aad" containerName="registry" containerID="cri-o://c52b1f7e5b1d9af2e120ae9a458c62bdea449aff9e448d3adb0cbbdf7fcf5552" gracePeriod=30
Jul 24 19:36:24.228758 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.228720    2541 generic.go:356] "Generic (PLEG): container finished" podID="5724d911-2242-43e9-8f35-9ce7a75b9aad" containerID="c52b1f7e5b1d9af2e120ae9a458c62bdea449aff9e448d3adb0cbbdf7fcf5552" exitCode=0
Jul 24 19:36:24.228948 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.228798    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr" event={"ID":"5724d911-2242-43e9-8f35-9ce7a75b9aad","Type":"ContainerDied","Data":"c52b1f7e5b1d9af2e120ae9a458c62bdea449aff9e448d3adb0cbbdf7fcf5552"}
Jul 24 19:36:24.732423 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.732397    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:36:24.771920 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.771886    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772101 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.771951    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5724d911-2242-43e9-8f35-9ce7a75b9aad-ca-trust-extracted\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772101 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772006    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-trusted-ca\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772101 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772027    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-745nd\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-kube-api-access-745nd\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772101 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772045    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-certificates\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772101 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772069    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-installation-pull-secrets\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772315 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772105    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-image-registry-private-configuration\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772315 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772131    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-bound-sa-token\") pod \"5724d911-2242-43e9-8f35-9ce7a75b9aad\" (UID: \"5724d911-2242-43e9-8f35-9ce7a75b9aad\") "
Jul 24 19:36:24.772620 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772539    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:24.772620 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.772599    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:24.774715 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.774683    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-kube-api-access-745nd" (OuterVolumeSpecName: "kube-api-access-745nd") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "kube-api-access-745nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:36:24.774844 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.774799    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:36:24.774915 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.774839    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:36:24.774970 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.774946    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:36:24.775130 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.775108    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:36:24.781997 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.781968    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5724d911-2242-43e9-8f35-9ce7a75b9aad-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5724d911-2242-43e9-8f35-9ce7a75b9aad" (UID: "5724d911-2242-43e9-8f35-9ce7a75b9aad"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873057    2541 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-installation-pull-secrets\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873092    2541 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5724d911-2242-43e9-8f35-9ce7a75b9aad-image-registry-private-configuration\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873104    2541 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-bound-sa-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873113    2541 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873122    2541 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5724d911-2242-43e9-8f35-9ce7a75b9aad-ca-trust-extracted\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873132    2541 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-trusted-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873140    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-745nd\" (UniqueName: \"kubernetes.io/projected/5724d911-2242-43e9-8f35-9ce7a75b9aad-kube-api-access-745nd\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:24.873144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:24.873148    2541 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5724d911-2242-43e9-8f35-9ce7a75b9aad-registry-certificates\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:36:25.234301 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:25.234263    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr" event={"ID":"5724d911-2242-43e9-8f35-9ce7a75b9aad","Type":"ContainerDied","Data":"573d02430f4e484bc9154bff4fbf89ea431135ed12ccd498829609770c6c672d"}
Jul 24 19:36:25.234756 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:25.234331    2541 scope.go:117] "RemoveContainer" containerID="c52b1f7e5b1d9af2e120ae9a458c62bdea449aff9e448d3adb0cbbdf7fcf5552"
Jul 24 19:36:25.234756 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:25.234272    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f8b757b4-2ftkr"
Jul 24 19:36:25.254977 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:25.254945    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74f8b757b4-2ftkr"]
Jul 24 19:36:25.258786 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:25.258747    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74f8b757b4-2ftkr"]
Jul 24 19:36:26.577450 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:26.577413    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5724d911-2242-43e9-8f35-9ce7a75b9aad" path="/var/lib/kubelet/pods/5724d911-2242-43e9-8f35-9ce7a75b9aad/volumes"
Jul 24 19:36:27.718320 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:27.718288    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4g2d_f8a47109-1268-4f5f-83ba-ed38022a2741/init-textfile/0.log"
Jul 24 19:36:27.920033 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:27.920005    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4g2d_f8a47109-1268-4f5f-83ba-ed38022a2741/node-exporter/0.log"
Jul 24 19:36:28.118602 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:28.118519    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4g2d_f8a47109-1268-4f5f-83ba-ed38022a2741/kube-rbac-proxy/0.log"
Jul 24 19:36:28.247631 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:28.247598    2541 generic.go:356] "Generic (PLEG): container finished" podID="db0f27bb-5686-435e-b02f-bdf7e398a326" containerID="4c55cd34ad810a66054cd64bb00c329d0869c1ea333d6b1fbc88328e5ca296d5" exitCode=0
Jul 24 19:36:28.247843 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:28.247679    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7" event={"ID":"db0f27bb-5686-435e-b02f-bdf7e398a326","Type":"ContainerDied","Data":"4c55cd34ad810a66054cd64bb00c329d0869c1ea333d6b1fbc88328e5ca296d5"}
Jul 24 19:36:28.248121 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:28.248104    2541 scope.go:117] "RemoveContainer" containerID="4c55cd34ad810a66054cd64bb00c329d0869c1ea333d6b1fbc88328e5ca296d5"
Jul 24 19:36:29.253504 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:29.253467    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5t9n7" event={"ID":"db0f27bb-5686-435e-b02f-bdf7e398a326","Type":"ContainerStarted","Data":"f421e00f53c954e2555093e4ee5e9c69a45f52781235086e632dc1a42eb4647c"}
Jul 24 19:36:30.419554 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:30.419516    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:36:30.421805 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:30.421777    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77763871-5b8d-4026-b916-770abf823589-metrics-certs\") pod \"network-metrics-daemon-pbgmc\" (UID: \"77763871-5b8d-4026-b916-770abf823589\") " pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:36:30.487522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:30.487493    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srqs8\""
Jul 24 19:36:30.495591 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:30.495568    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbgmc"
Jul 24 19:36:30.636274 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:30.636239    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pbgmc"]
Jul 24 19:36:30.639286 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:36:30.639257    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77763871_5b8d_4026_b916_770abf823589.slice/crio-ac045d5ce4d8a6893ac749305d9ec10aab8498cb339afcae5b643a4b95a1237c WatchSource:0}: Error finding container ac045d5ce4d8a6893ac749305d9ec10aab8498cb339afcae5b643a4b95a1237c: Status 404 returned error can't find the container with id ac045d5ce4d8a6893ac749305d9ec10aab8498cb339afcae5b643a4b95a1237c
Jul 24 19:36:31.261638 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:31.261585    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbgmc" event={"ID":"77763871-5b8d-4026-b916-770abf823589","Type":"ContainerStarted","Data":"ac045d5ce4d8a6893ac749305d9ec10aab8498cb339afcae5b643a4b95a1237c"}
Jul 24 19:36:32.118969 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:32.118939    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-xqpsq_0e0d134e-308b-4c18-8bd3-fdfc04c38d0f/networking-console-plugin/0.log"
Jul 24 19:36:32.266722 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:32.266688    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbgmc" event={"ID":"77763871-5b8d-4026-b916-770abf823589","Type":"ContainerStarted","Data":"6d69737ed6af053ffad2a4b5311f801440e994bd2def3b6791711c6e97a8165b"}
Jul 24 19:36:32.266927 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:32.266749    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbgmc" event={"ID":"77763871-5b8d-4026-b916-770abf823589","Type":"ContainerStarted","Data":"d1789350b35c7be25578717774dced9875c13841620274acacb7879e79020b4e"}
Jul 24 19:36:32.281926 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:32.281874    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pbgmc" podStartSLOduration=130.455967282 podStartE2EDuration="2m11.281857462s" totalImagesPullingTime="825.89018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:32.281038131 +0000 UTC m=+132.405377286" watchObservedRunningTime="2026-07-24 19:36:32.281857462 +0000 UTC m=+132.406196612"
Jul 24 19:36:33.319733 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:33.319709    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7895ff9947-rjb69_453dc48a-2e5e-4a9d-93b0-ab62e2128529/router/0.log"
Jul 24 19:36:33.918981 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:36:33.918953    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwvmj_181d01dd-6034-4e63-85d3-9179c8d28f59/serve-healthcheck-canary/0.log"
Jul 24 19:37:25.069797 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.069729    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"]
Jul 24 19:37:25.070236 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.070056    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5724d911-2242-43e9-8f35-9ce7a75b9aad" containerName="registry"
Jul 24 19:37:25.070236 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.070067    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="5724d911-2242-43e9-8f35-9ce7a75b9aad" containerName="registry"
Jul 24 19:37:25.070236 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.070108    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="5724d911-2242-43e9-8f35-9ce7a75b9aad" containerName="registry"
Jul 24 19:37:25.074170 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.074145    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.077190 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.077164    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 19:37:25.077316 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.077242    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 19:37:25.077316 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.077246    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 19:37:25.077427 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.077169    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 19:37:25.077517 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.077432    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 19:37:25.077842 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.077826    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bzlpt\""
Jul 24 19:37:25.082423 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.082404    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 19:37:25.090462 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.090435    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"]
Jul 24 19:37:25.119377 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119335    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.119377 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119380    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.119589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119409    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-serving-certs-ca-bundle\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.119589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119428    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-telemeter-client-tls\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.119589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119448    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-metrics-client-ca\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.119589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119466    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-federate-client-tls\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.119589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119543    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldl6f\" (UniqueName: \"kubernetes.io/projected/1af033a3-8b36-4bc8-b544-0ffce21172ec-kube-api-access-ldl6f\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.119589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.119583    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-secret-telemeter-client\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220333 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220291    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220345    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220381    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-serving-certs-ca-bundle\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220404    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-telemeter-client-tls\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220434    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-metrics-client-ca\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220463    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-federate-client-tls\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220499    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldl6f\" (UniqueName: \"kubernetes.io/projected/1af033a3-8b36-4bc8-b544-0ffce21172ec-kube-api-access-ldl6f\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.220542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.220533    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-secret-telemeter-client\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.221378 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.221306    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-metrics-client-ca\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.221378 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.221371    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-serving-certs-ca-bundle\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.221558 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.221497    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af033a3-8b36-4bc8-b544-0ffce21172ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.223047 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.223019    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.223165 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.223099    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-telemeter-client-tls\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.223365 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.223344    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-secret-telemeter-client\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.223518 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.223500    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1af033a3-8b36-4bc8-b544-0ffce21172ec-federate-client-tls\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.230154 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.230132    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldl6f\" (UniqueName: \"kubernetes.io/projected/1af033a3-8b36-4bc8-b544-0ffce21172ec-kube-api-access-ldl6f\") pod \"telemeter-client-66fc67dbb6-q4p78\" (UID: \"1af033a3-8b36-4bc8-b544-0ffce21172ec\") " pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.383473 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.383365    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"
Jul 24 19:37:25.533420 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:25.533385    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66fc67dbb6-q4p78"]
Jul 24 19:37:25.536597 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:37:25.536568    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af033a3_8b36_4bc8_b544_0ffce21172ec.slice/crio-fb582f4b7c4f8a95429548d8d164d9e82623b4cc9cc84a7bfdc5dd3f9bf86c3d WatchSource:0}: Error finding container fb582f4b7c4f8a95429548d8d164d9e82623b4cc9cc84a7bfdc5dd3f9bf86c3d: Status 404 returned error can't find the container with id fb582f4b7c4f8a95429548d8d164d9e82623b4cc9cc84a7bfdc5dd3f9bf86c3d
Jul 24 19:37:26.463922 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:26.463880    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78" event={"ID":"1af033a3-8b36-4bc8-b544-0ffce21172ec","Type":"ContainerStarted","Data":"fb582f4b7c4f8a95429548d8d164d9e82623b4cc9cc84a7bfdc5dd3f9bf86c3d"}
Jul 24 19:37:28.473276 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:28.473230    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78" event={"ID":"1af033a3-8b36-4bc8-b544-0ffce21172ec","Type":"ContainerStarted","Data":"810ec72473db2f17527b2768ce89edd582764489ec1a73a2764d87d7d13753db"}
Jul 24 19:37:29.478613 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:29.478568    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78" event={"ID":"1af033a3-8b36-4bc8-b544-0ffce21172ec","Type":"ContainerStarted","Data":"b7e102c6caf4b4051d522b290587606da032beefc05c3fad675c1d3daa8c4fde"}
Jul 24 19:37:29.479026 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:29.478633    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78" event={"ID":"1af033a3-8b36-4bc8-b544-0ffce21172ec","Type":"ContainerStarted","Data":"b7b5f0657ab8311a17617ca1960f9a851b06c6b61a15a6f4146d9e62d0634e35"}
Jul 24 19:37:29.500040 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:37:29.499974    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66fc67dbb6-q4p78" podStartSLOduration=1.412178356 podStartE2EDuration="4.499952941s" totalImagesPullingTime="3.087774585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:37:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:37:29.497596857 +0000 UTC m=+189.621936004" watchObservedRunningTime="2026-07-24 19:37:29.499952941 +0000 UTC m=+189.624292101"
Jul 24 19:38:56.383561 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.383524    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"]
Jul 24 19:38:56.386750 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.386734    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.389261 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.389244    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-68r7x\""
Jul 24 19:38:56.389347 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.389249    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 19:38:56.390260 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.390244    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 19:38:56.396847 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.396824    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"]
Jul 24 19:38:56.499080 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.499027    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.499080 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.499082    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmvg\" (UniqueName: \"kubernetes.io/projected/726e44c5-30ae-4465-87f1-5cf104b59ff8-kube-api-access-xfmvg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.499344 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.499157    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.599862 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.599815    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.599862 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.599863    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmvg\" (UniqueName: \"kubernetes.io/projected/726e44c5-30ae-4465-87f1-5cf104b59ff8-kube-api-access-xfmvg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.600076 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.599916    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.600299 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.600279    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.600336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.600288    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.608066 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.608044    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmvg\" (UniqueName: \"kubernetes.io/projected/726e44c5-30ae-4465-87f1-5cf104b59ff8-kube-api-access-xfmvg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.695486 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.695444    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:38:56.828439 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:56.828410    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"]
Jul 24 19:38:56.831039 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:38:56.831011    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726e44c5_30ae_4465_87f1_5cf104b59ff8.slice/crio-8573a0cba31735d4b43844f3679f209efa287ceea9f5e3c43998a71b572470f3 WatchSource:0}: Error finding container 8573a0cba31735d4b43844f3679f209efa287ceea9f5e3c43998a71b572470f3: Status 404 returned error can't find the container with id 8573a0cba31735d4b43844f3679f209efa287ceea9f5e3c43998a71b572470f3
Jul 24 19:38:57.783068 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:38:57.783034    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp" event={"ID":"726e44c5-30ae-4465-87f1-5cf104b59ff8","Type":"ContainerStarted","Data":"8573a0cba31735d4b43844f3679f209efa287ceea9f5e3c43998a71b572470f3"}
Jul 24 19:39:04.811579 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:04.811531    2541 generic.go:356] "Generic (PLEG): container finished" podID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerID="657eb3879b7340a1ef4a60916eca1b821e866117f34ca09ee7c77292701d47f7" exitCode=0
Jul 24 19:39:04.811989 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:04.811624    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp" event={"ID":"726e44c5-30ae-4465-87f1-5cf104b59ff8","Type":"ContainerDied","Data":"657eb3879b7340a1ef4a60916eca1b821e866117f34ca09ee7c77292701d47f7"}
Jul 24 19:39:07.824821 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:07.824792    2541 generic.go:356] "Generic (PLEG): container finished" podID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerID="13e5f8fa4f7a8684c88b494671c0d137ee5ae591d637702a8fdf2a55b006b227" exitCode=0
Jul 24 19:39:07.825127 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:07.824881    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp" event={"ID":"726e44c5-30ae-4465-87f1-5cf104b59ff8","Type":"ContainerDied","Data":"13e5f8fa4f7a8684c88b494671c0d137ee5ae591d637702a8fdf2a55b006b227"}
Jul 24 19:39:15.855812 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:15.855725    2541 generic.go:356] "Generic (PLEG): container finished" podID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerID="c44b7969ad513f6aae5adfdc7b840904b5df9c2487ea84d197f3c46b97b03f1a" exitCode=0
Jul 24 19:39:15.856126 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:15.855811    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp" event={"ID":"726e44c5-30ae-4465-87f1-5cf104b59ff8","Type":"ContainerDied","Data":"c44b7969ad513f6aae5adfdc7b840904b5df9c2487ea84d197f3c46b97b03f1a"}
Jul 24 19:39:16.985302 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:16.985280    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:39:17.062021 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.061992    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-bundle\") pod \"726e44c5-30ae-4465-87f1-5cf104b59ff8\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") "
Jul 24 19:39:17.062151 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.062026    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfmvg\" (UniqueName: \"kubernetes.io/projected/726e44c5-30ae-4465-87f1-5cf104b59ff8-kube-api-access-xfmvg\") pod \"726e44c5-30ae-4465-87f1-5cf104b59ff8\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") "
Jul 24 19:39:17.062151 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.062078    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-util\") pod \"726e44c5-30ae-4465-87f1-5cf104b59ff8\" (UID: \"726e44c5-30ae-4465-87f1-5cf104b59ff8\") "
Jul 24 19:39:17.062656 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.062629    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-bundle" (OuterVolumeSpecName: "bundle") pod "726e44c5-30ae-4465-87f1-5cf104b59ff8" (UID: "726e44c5-30ae-4465-87f1-5cf104b59ff8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:39:17.064157 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.064132    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726e44c5-30ae-4465-87f1-5cf104b59ff8-kube-api-access-xfmvg" (OuterVolumeSpecName: "kube-api-access-xfmvg") pod "726e44c5-30ae-4465-87f1-5cf104b59ff8" (UID: "726e44c5-30ae-4465-87f1-5cf104b59ff8"). InnerVolumeSpecName "kube-api-access-xfmvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:39:17.066851 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.066827    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-util" (OuterVolumeSpecName: "util") pod "726e44c5-30ae-4465-87f1-5cf104b59ff8" (UID: "726e44c5-30ae-4465-87f1-5cf104b59ff8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:39:17.162490 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.162467    2541 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-util\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:17.162490 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.162490    2541 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/726e44c5-30ae-4465-87f1-5cf104b59ff8-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:17.162643 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.162500    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfmvg\" (UniqueName: \"kubernetes.io/projected/726e44c5-30ae-4465-87f1-5cf104b59ff8-kube-api-access-xfmvg\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:17.863634 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.863609    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp"
Jul 24 19:39:17.863634 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.863616    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qd6pp" event={"ID":"726e44c5-30ae-4465-87f1-5cf104b59ff8","Type":"ContainerDied","Data":"8573a0cba31735d4b43844f3679f209efa287ceea9f5e3c43998a71b572470f3"}
Jul 24 19:39:17.863895 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:17.863661    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8573a0cba31735d4b43844f3679f209efa287ceea9f5e3c43998a71b572470f3"
Jul 24 19:39:20.445934 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:20.445908    2541 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 19:39:24.372652 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372618    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"]
Jul 24 19:39:24.374050 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372908    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerName="extract"
Jul 24 19:39:24.374050 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372920    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerName="extract"
Jul 24 19:39:24.374050 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372934    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerName="util"
Jul 24 19:39:24.374050 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372939    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerName="util"
Jul 24 19:39:24.374050 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372953    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerName="pull"
Jul 24 19:39:24.374050 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372959    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerName="pull"
Jul 24 19:39:24.374050 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.372998    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="726e44c5-30ae-4465-87f1-5cf104b59ff8" containerName="extract"
Jul 24 19:39:24.374589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.374574    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.377141 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.377118    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-t4479\""
Jul 24 19:39:24.377421 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.377404    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:39:24.377523 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.377506    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 19:39:24.389082 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.389056    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"]
Jul 24 19:39:24.511220 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.511192    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33e69b7d-1681-436f-8f7f-8285c563b5fc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-979vn\" (UID: \"33e69b7d-1681-436f-8f7f-8285c563b5fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.511361 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.511233    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6ml6\" (UniqueName: \"kubernetes.io/projected/33e69b7d-1681-436f-8f7f-8285c563b5fc-kube-api-access-t6ml6\") pod \"cert-manager-operator-controller-manager-55c444bf86-979vn\" (UID: \"33e69b7d-1681-436f-8f7f-8285c563b5fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.611739 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.611713    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33e69b7d-1681-436f-8f7f-8285c563b5fc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-979vn\" (UID: \"33e69b7d-1681-436f-8f7f-8285c563b5fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.611874 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.611756    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6ml6\" (UniqueName: \"kubernetes.io/projected/33e69b7d-1681-436f-8f7f-8285c563b5fc-kube-api-access-t6ml6\") pod \"cert-manager-operator-controller-manager-55c444bf86-979vn\" (UID: \"33e69b7d-1681-436f-8f7f-8285c563b5fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.612111 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.612088    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33e69b7d-1681-436f-8f7f-8285c563b5fc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-979vn\" (UID: \"33e69b7d-1681-436f-8f7f-8285c563b5fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.623626 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.623574    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6ml6\" (UniqueName: \"kubernetes.io/projected/33e69b7d-1681-436f-8f7f-8285c563b5fc-kube-api-access-t6ml6\") pod \"cert-manager-operator-controller-manager-55c444bf86-979vn\" (UID: \"33e69b7d-1681-436f-8f7f-8285c563b5fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.683698 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.683679    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"
Jul 24 19:39:24.814490 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.814467    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn"]
Jul 24 19:39:24.816806 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:39:24.816777    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e69b7d_1681_436f_8f7f_8285c563b5fc.slice/crio-13969175408c349adbdd708cd2eb198bbfecdcf88c4459040065000d5c31c84b WatchSource:0}: Error finding container 13969175408c349adbdd708cd2eb198bbfecdcf88c4459040065000d5c31c84b: Status 404 returned error can't find the container with id 13969175408c349adbdd708cd2eb198bbfecdcf88c4459040065000d5c31c84b
Jul 24 19:39:24.819505 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.819489    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:39:24.890958 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:24.890931    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn" event={"ID":"33e69b7d-1681-436f-8f7f-8285c563b5fc","Type":"ContainerStarted","Data":"13969175408c349adbdd708cd2eb198bbfecdcf88c4459040065000d5c31c84b"}
Jul 24 19:39:26.900166 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:26.900130    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn" event={"ID":"33e69b7d-1681-436f-8f7f-8285c563b5fc","Type":"ContainerStarted","Data":"c90c731436b763fcee974e642e163b5d8aa3758ca52472fa217b520f5aee6887"}
Jul 24 19:39:26.920158 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:26.920106    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-979vn" podStartSLOduration=1.476941987 podStartE2EDuration="2.920091622s" totalImagesPullingTime="1.443149635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:39:26.918865319 +0000 UTC m=+307.043204475" watchObservedRunningTime="2026-07-24 19:39:26.920091622 +0000 UTC m=+307.044430777"
Jul 24 19:39:28.079553 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.079517    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"]
Jul 24 19:39:28.082939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.082921    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.085733 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.085709    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 19:39:28.086941 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.086920    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 19:39:28.087054 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.086927    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-68r7x\""
Jul 24 19:39:28.092121 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.092100    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"]
Jul 24 19:39:28.139881 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.139845    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.140034 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.139933    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfqv\" (UniqueName: \"kubernetes.io/projected/1d01a354-065f-44cb-8304-39d800251b11-kube-api-access-2pfqv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.140034 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.139961    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.241129 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.241096    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfqv\" (UniqueName: \"kubernetes.io/projected/1d01a354-065f-44cb-8304-39d800251b11-kube-api-access-2pfqv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.241293 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.241133    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.241293 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.241160    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.241583 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.241563    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.241650 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.241585    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.249065 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.249042    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfqv\" (UniqueName: \"kubernetes.io/projected/1d01a354-065f-44cb-8304-39d800251b11-kube-api-access-2pfqv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.391479 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.391456    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:28.514522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.514354    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"]
Jul 24 19:39:28.517142 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:39:28.517115    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d01a354_065f_44cb_8304_39d800251b11.slice/crio-7417d12d67dc448a09d11798f89468fc843d0e63950d7cce69cea5ba56dd5e82 WatchSource:0}: Error finding container 7417d12d67dc448a09d11798f89468fc843d0e63950d7cce69cea5ba56dd5e82: Status 404 returned error can't find the container with id 7417d12d67dc448a09d11798f89468fc843d0e63950d7cce69cea5ba56dd5e82
Jul 24 19:39:28.908337 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.908306    2541 generic.go:356] "Generic (PLEG): container finished" podID="1d01a354-065f-44cb-8304-39d800251b11" containerID="8b6464b5aa2052efdc5654368c4b924d624f0be619a1e37819a8d14c869387de" exitCode=0
Jul 24 19:39:28.908486 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.908370    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth" event={"ID":"1d01a354-065f-44cb-8304-39d800251b11","Type":"ContainerDied","Data":"8b6464b5aa2052efdc5654368c4b924d624f0be619a1e37819a8d14c869387de"}
Jul 24 19:39:28.908486 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:28.908410    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth" event={"ID":"1d01a354-065f-44cb-8304-39d800251b11","Type":"ContainerStarted","Data":"7417d12d67dc448a09d11798f89468fc843d0e63950d7cce69cea5ba56dd5e82"}
Jul 24 19:39:30.320511 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.320480    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"]
Jul 24 19:39:30.323855 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.323835    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:30.326217 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.326199    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 19:39:30.327161 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.327133    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 19:39:30.327270 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.327140    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-n6mq9\""
Jul 24 19:39:30.333837 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.333815    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"]
Jul 24 19:39:30.457536 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.457496    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6qb\" (UniqueName: \"kubernetes.io/projected/a5476ac7-da42-4330-8e85-242ea802a21c-kube-api-access-9f6qb\") pod \"cert-manager-cainjector-559cdd8c87-dwzkw\" (UID: \"a5476ac7-da42-4330-8e85-242ea802a21c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:30.457697 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.457563    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5476ac7-da42-4330-8e85-242ea802a21c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dwzkw\" (UID: \"a5476ac7-da42-4330-8e85-242ea802a21c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:30.558951 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.558911    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6qb\" (UniqueName: \"kubernetes.io/projected/a5476ac7-da42-4330-8e85-242ea802a21c-kube-api-access-9f6qb\") pod \"cert-manager-cainjector-559cdd8c87-dwzkw\" (UID: \"a5476ac7-da42-4330-8e85-242ea802a21c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:30.559132 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.558979    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5476ac7-da42-4330-8e85-242ea802a21c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dwzkw\" (UID: \"a5476ac7-da42-4330-8e85-242ea802a21c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:30.571426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.571361    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6qb\" (UniqueName: \"kubernetes.io/projected/a5476ac7-da42-4330-8e85-242ea802a21c-kube-api-access-9f6qb\") pod \"cert-manager-cainjector-559cdd8c87-dwzkw\" (UID: \"a5476ac7-da42-4330-8e85-242ea802a21c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:30.572099 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.572051    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5476ac7-da42-4330-8e85-242ea802a21c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dwzkw\" (UID: \"a5476ac7-da42-4330-8e85-242ea802a21c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:30.645182 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:30.645154    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"
Jul 24 19:39:31.206494 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:31.206471    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw"]
Jul 24 19:39:31.208958 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:39:31.208933    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5476ac7_da42_4330_8e85_242ea802a21c.slice/crio-7154da54f9dd95fa75075d439e4f7beb2ab2d3913d741cec3aa28042b0250981 WatchSource:0}: Error finding container 7154da54f9dd95fa75075d439e4f7beb2ab2d3913d741cec3aa28042b0250981: Status 404 returned error can't find the container with id 7154da54f9dd95fa75075d439e4f7beb2ab2d3913d741cec3aa28042b0250981
Jul 24 19:39:31.923873 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:31.923841    2541 generic.go:356] "Generic (PLEG): container finished" podID="1d01a354-065f-44cb-8304-39d800251b11" containerID="0f490d65f81122a93afcbe062915b8137facead24b5cafab4d958a1792698c12" exitCode=0
Jul 24 19:39:31.924353 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:31.923929    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth" event={"ID":"1d01a354-065f-44cb-8304-39d800251b11","Type":"ContainerDied","Data":"0f490d65f81122a93afcbe062915b8137facead24b5cafab4d958a1792698c12"}
Jul 24 19:39:31.925462 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:31.925415    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw" event={"ID":"a5476ac7-da42-4330-8e85-242ea802a21c","Type":"ContainerStarted","Data":"7154da54f9dd95fa75075d439e4f7beb2ab2d3913d741cec3aa28042b0250981"}
Jul 24 19:39:32.931989 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:32.931956    2541 generic.go:356] "Generic (PLEG): container finished" podID="1d01a354-065f-44cb-8304-39d800251b11" containerID="c7cc1f44a9e1dd9f632423f30fff4737806881bf0865948136bf343c150f8460" exitCode=0
Jul 24 19:39:32.932401 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:32.932007    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth" event={"ID":"1d01a354-065f-44cb-8304-39d800251b11","Type":"ContainerDied","Data":"c7cc1f44a9e1dd9f632423f30fff4737806881bf0865948136bf343c150f8460"}
Jul 24 19:39:33.938135 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:33.938095    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw" event={"ID":"a5476ac7-da42-4330-8e85-242ea802a21c","Type":"ContainerStarted","Data":"6c83167b2361cdd143b4e3a7ab76d9e9f0a34143cce45837964c6ce858ae9021"}
Jul 24 19:39:33.955539 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:33.955351    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwzkw" podStartSLOduration=1.452777978 podStartE2EDuration="3.955333386s" totalImagesPullingTime="2.502555408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:39:33.955049763 +0000 UTC m=+314.079388921" watchObservedRunningTime="2026-07-24 19:39:33.955333386 +0000 UTC m=+314.079672543"
Jul 24 19:39:34.080646 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.080622    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:34.187048 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.187014    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-util\") pod \"1d01a354-065f-44cb-8304-39d800251b11\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") "
Jul 24 19:39:34.187228 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.187081    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-bundle\") pod \"1d01a354-065f-44cb-8304-39d800251b11\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") "
Jul 24 19:39:34.187228 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.187114    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pfqv\" (UniqueName: \"kubernetes.io/projected/1d01a354-065f-44cb-8304-39d800251b11-kube-api-access-2pfqv\") pod \"1d01a354-065f-44cb-8304-39d800251b11\" (UID: \"1d01a354-065f-44cb-8304-39d800251b11\") "
Jul 24 19:39:34.187424 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.187399    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-bundle" (OuterVolumeSpecName: "bundle") pod "1d01a354-065f-44cb-8304-39d800251b11" (UID: "1d01a354-065f-44cb-8304-39d800251b11"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:39:34.189267 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.189231    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d01a354-065f-44cb-8304-39d800251b11-kube-api-access-2pfqv" (OuterVolumeSpecName: "kube-api-access-2pfqv") pod "1d01a354-065f-44cb-8304-39d800251b11" (UID: "1d01a354-065f-44cb-8304-39d800251b11"). InnerVolumeSpecName "kube-api-access-2pfqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:39:34.191266 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.191224    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-util" (OuterVolumeSpecName: "util") pod "1d01a354-065f-44cb-8304-39d800251b11" (UID: "1d01a354-065f-44cb-8304-39d800251b11"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:39:34.287901 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.287826    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pfqv\" (UniqueName: \"kubernetes.io/projected/1d01a354-065f-44cb-8304-39d800251b11-kube-api-access-2pfqv\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:34.287901 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.287860    2541 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-util\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:34.287901 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.287876    2541 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d01a354-065f-44cb-8304-39d800251b11-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:34.943822 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.943798    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth"
Jul 24 19:39:34.943822 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.943804    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f65xth" event={"ID":"1d01a354-065f-44cb-8304-39d800251b11","Type":"ContainerDied","Data":"7417d12d67dc448a09d11798f89468fc843d0e63950d7cce69cea5ba56dd5e82"}
Jul 24 19:39:34.944229 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:34.943845    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7417d12d67dc448a09d11798f89468fc843d0e63950d7cce69cea5ba56dd5e82"
Jul 24 19:39:38.612673 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.612644    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pflts"]
Jul 24 19:39:38.613060 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.612923    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d01a354-065f-44cb-8304-39d800251b11" containerName="pull"
Jul 24 19:39:38.613060 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.612935    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d01a354-065f-44cb-8304-39d800251b11" containerName="pull"
Jul 24 19:39:38.613060 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.612949    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d01a354-065f-44cb-8304-39d800251b11" containerName="extract"
Jul 24 19:39:38.613060 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.612954    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d01a354-065f-44cb-8304-39d800251b11" containerName="extract"
Jul 24 19:39:38.613060 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.612970    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d01a354-065f-44cb-8304-39d800251b11" containerName="util"
Jul 24 19:39:38.613060 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.612975    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d01a354-065f-44cb-8304-39d800251b11" containerName="util"
Jul 24 19:39:38.613060 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.613018    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d01a354-065f-44cb-8304-39d800251b11" containerName="extract"
Jul 24 19:39:38.621438 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.621417    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:38.623632 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.623608    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pflts"]
Jul 24 19:39:38.722400 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.722370    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vh4m\" (UniqueName: \"kubernetes.io/projected/6e8c33df-69bc-4889-a609-844afc54265a-kube-api-access-9vh4m\") pod \"cert-manager-55b4d954d5-pflts\" (UID: \"6e8c33df-69bc-4889-a609-844afc54265a\") " pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:38.722544 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.722423    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e8c33df-69bc-4889-a609-844afc54265a-bound-sa-token\") pod \"cert-manager-55b4d954d5-pflts\" (UID: \"6e8c33df-69bc-4889-a609-844afc54265a\") " pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:38.823196 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.823155    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e8c33df-69bc-4889-a609-844afc54265a-bound-sa-token\") pod \"cert-manager-55b4d954d5-pflts\" (UID: \"6e8c33df-69bc-4889-a609-844afc54265a\") " pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:38.823345 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.823224    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vh4m\" (UniqueName: \"kubernetes.io/projected/6e8c33df-69bc-4889-a609-844afc54265a-kube-api-access-9vh4m\") pod \"cert-manager-55b4d954d5-pflts\" (UID: \"6e8c33df-69bc-4889-a609-844afc54265a\") " pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:38.831084 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.831061    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e8c33df-69bc-4889-a609-844afc54265a-bound-sa-token\") pod \"cert-manager-55b4d954d5-pflts\" (UID: \"6e8c33df-69bc-4889-a609-844afc54265a\") " pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:38.831255 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.831234    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vh4m\" (UniqueName: \"kubernetes.io/projected/6e8c33df-69bc-4889-a609-844afc54265a-kube-api-access-9vh4m\") pod \"cert-manager-55b4d954d5-pflts\" (UID: \"6e8c33df-69bc-4889-a609-844afc54265a\") " pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:38.931374 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:38.931354    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pflts"
Jul 24 19:39:39.058906 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:39.058875    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pflts"]
Jul 24 19:39:39.061907 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:39:39.061882    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e8c33df_69bc_4889_a609_844afc54265a.slice/crio-f8f09906006e1a234a22c59ac6af5ac05d2392e7f90ed4491162d835282e6283 WatchSource:0}: Error finding container f8f09906006e1a234a22c59ac6af5ac05d2392e7f90ed4491162d835282e6283: Status 404 returned error can't find the container with id f8f09906006e1a234a22c59ac6af5ac05d2392e7f90ed4491162d835282e6283
Jul 24 19:39:39.963631 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:39.963595    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pflts" event={"ID":"6e8c33df-69bc-4889-a609-844afc54265a","Type":"ContainerStarted","Data":"bc20eaa6ecdfb98f8efd7dad135a16567a6f4105750507b5e6076e301547c01d"}
Jul 24 19:39:39.963631 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:39.963632    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pflts" event={"ID":"6e8c33df-69bc-4889-a609-844afc54265a","Type":"ContainerStarted","Data":"f8f09906006e1a234a22c59ac6af5ac05d2392e7f90ed4491162d835282e6283"}
Jul 24 19:39:39.980095 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:39.980048    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pflts" podStartSLOduration=1.9800346420000001 podStartE2EDuration="1.980034642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:39:39.978828358 +0000 UTC m=+320.103167506" watchObservedRunningTime="2026-07-24 19:39:39.980034642 +0000 UTC m=+320.104373798"
Jul 24 19:39:45.088799 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.088748    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"]
Jul 24 19:39:45.123728 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.123699    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"]
Jul 24 19:39:45.123879 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.123808    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.126658 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.126640    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 19:39:45.126832 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.126640    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-68r7x\""
Jul 24 19:39:45.127542 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.127526    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 19:39:45.270080 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.270041    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm2f4\" (UniqueName: \"kubernetes.io/projected/367d79ba-a0ae-4383-af7a-9ec1470221b3-kube-api-access-dm2f4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.270230 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.270126    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.270230 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.270147    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.370507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.370432    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm2f4\" (UniqueName: \"kubernetes.io/projected/367d79ba-a0ae-4383-af7a-9ec1470221b3-kube-api-access-dm2f4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.370641 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.370512    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.370641 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.370537    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.370911 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.370891    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.370951 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.370919    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.378420 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.378395    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm2f4\" (UniqueName: \"kubernetes.io/projected/367d79ba-a0ae-4383-af7a-9ec1470221b3-kube-api-access-dm2f4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.433118 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.433096    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:45.581232 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.581202    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"]
Jul 24 19:39:45.583379 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:39:45.583352    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367d79ba_a0ae_4383_af7a_9ec1470221b3.slice/crio-64c9275e98fcce532b6b6561733cee3cc29e241f2f3a2e337992c5b1bb87bdbb WatchSource:0}: Error finding container 64c9275e98fcce532b6b6561733cee3cc29e241f2f3a2e337992c5b1bb87bdbb: Status 404 returned error can't find the container with id 64c9275e98fcce532b6b6561733cee3cc29e241f2f3a2e337992c5b1bb87bdbb
Jul 24 19:39:45.988861 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.988827    2541 generic.go:356] "Generic (PLEG): container finished" podID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerID="d2a8a94be88ee9bbe4a5c22df90ef152d66aa7c88f7e400609390f37703f174d" exitCode=0
Jul 24 19:39:45.989028 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.988879    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42" event={"ID":"367d79ba-a0ae-4383-af7a-9ec1470221b3","Type":"ContainerDied","Data":"d2a8a94be88ee9bbe4a5c22df90ef152d66aa7c88f7e400609390f37703f174d"}
Jul 24 19:39:45.989028 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:45.988922    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42" event={"ID":"367d79ba-a0ae-4383-af7a-9ec1470221b3","Type":"ContainerStarted","Data":"64c9275e98fcce532b6b6561733cee3cc29e241f2f3a2e337992c5b1bb87bdbb"}
Jul 24 19:39:48.000374 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:48.000342    2541 generic.go:356] "Generic (PLEG): container finished" podID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerID="ff85bad6258a37da8814d09cf0931fb8094d928e8a4775528a94256fc5022e0e" exitCode=0
Jul 24 19:39:48.000752 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:48.000418    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42" event={"ID":"367d79ba-a0ae-4383-af7a-9ec1470221b3","Type":"ContainerDied","Data":"ff85bad6258a37da8814d09cf0931fb8094d928e8a4775528a94256fc5022e0e"}
Jul 24 19:39:49.008854 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:49.008823    2541 generic.go:356] "Generic (PLEG): container finished" podID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerID="edd6c59f0a68d16075677790de30ac45f6673d80120cf0f00c44a8031e9c48f0" exitCode=0
Jul 24 19:39:49.009224 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:49.008861    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42" event={"ID":"367d79ba-a0ae-4383-af7a-9ec1470221b3","Type":"ContainerDied","Data":"edd6c59f0a68d16075677790de30ac45f6673d80120cf0f00c44a8031e9c48f0"}
Jul 24 19:39:50.133328 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.133307    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:50.305611 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.305533    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-bundle\") pod \"367d79ba-a0ae-4383-af7a-9ec1470221b3\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") "
Jul 24 19:39:50.305611 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.305566    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-util\") pod \"367d79ba-a0ae-4383-af7a-9ec1470221b3\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") "
Jul 24 19:39:50.305611 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.305612    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm2f4\" (UniqueName: \"kubernetes.io/projected/367d79ba-a0ae-4383-af7a-9ec1470221b3-kube-api-access-dm2f4\") pod \"367d79ba-a0ae-4383-af7a-9ec1470221b3\" (UID: \"367d79ba-a0ae-4383-af7a-9ec1470221b3\") "
Jul 24 19:39:50.306230 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.306197    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-bundle" (OuterVolumeSpecName: "bundle") pod "367d79ba-a0ae-4383-af7a-9ec1470221b3" (UID: "367d79ba-a0ae-4383-af7a-9ec1470221b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:39:50.307654 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.307632    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367d79ba-a0ae-4383-af7a-9ec1470221b3-kube-api-access-dm2f4" (OuterVolumeSpecName: "kube-api-access-dm2f4") pod "367d79ba-a0ae-4383-af7a-9ec1470221b3" (UID: "367d79ba-a0ae-4383-af7a-9ec1470221b3"). InnerVolumeSpecName "kube-api-access-dm2f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:39:50.311328 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.311304    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-util" (OuterVolumeSpecName: "util") pod "367d79ba-a0ae-4383-af7a-9ec1470221b3" (UID: "367d79ba-a0ae-4383-af7a-9ec1470221b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:39:50.406160 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.406133    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm2f4\" (UniqueName: \"kubernetes.io/projected/367d79ba-a0ae-4383-af7a-9ec1470221b3-kube-api-access-dm2f4\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:50.406160 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.406156    2541 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:50.406160 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:50.406164    2541 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367d79ba-a0ae-4383-af7a-9ec1470221b3-util\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:39:51.018447 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:51.018411    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42" event={"ID":"367d79ba-a0ae-4383-af7a-9ec1470221b3","Type":"ContainerDied","Data":"64c9275e98fcce532b6b6561733cee3cc29e241f2f3a2e337992c5b1bb87bdbb"}
Jul 24 19:39:51.018447 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:51.018433    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhrs42"
Jul 24 19:39:51.018643 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:39:51.018465    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64c9275e98fcce532b6b6561733cee3cc29e241f2f3a2e337992c5b1bb87bdbb"
Jul 24 19:40:01.462410 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462376    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"]
Jul 24 19:40:01.462846 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462753    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerName="extract"
Jul 24 19:40:01.462846 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462789    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerName="extract"
Jul 24 19:40:01.462846 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462810    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerName="util"
Jul 24 19:40:01.462846 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462818    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerName="util"
Jul 24 19:40:01.462846 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462830    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerName="pull"
Jul 24 19:40:01.462846 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462839    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerName="pull"
Jul 24 19:40:01.463045 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.462919    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="367d79ba-a0ae-4383-af7a-9ec1470221b3" containerName="extract"
Jul 24 19:40:01.464908 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.464891    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.469152 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.469129    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 19:40:01.469291 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.469171    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 19:40:01.469291 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.469187    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:40:01.469291 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.469129    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 19:40:01.469291 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.469262    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fsmlx\""
Jul 24 19:40:01.469291 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.469129    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 19:40:01.484085 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.484066    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"]
Jul 24 19:40:01.583607 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.583574    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/22edf87e-e433-40a2-9283-f18fbe8d2d1d-manager-config\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.583607 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.583613    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22edf87e-e433-40a2-9283-f18fbe8d2d1d-cert\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.583822 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.583672    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5ww\" (UniqueName: \"kubernetes.io/projected/22edf87e-e433-40a2-9283-f18fbe8d2d1d-kube-api-access-hm5ww\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.583822 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.583724    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/22edf87e-e433-40a2-9283-f18fbe8d2d1d-metrics-cert\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.684845 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.684813    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/22edf87e-e433-40a2-9283-f18fbe8d2d1d-metrics-cert\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.685010 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.684858    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/22edf87e-e433-40a2-9283-f18fbe8d2d1d-manager-config\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.685010 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.684889    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22edf87e-e433-40a2-9283-f18fbe8d2d1d-cert\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.685010 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.684934    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5ww\" (UniqueName: \"kubernetes.io/projected/22edf87e-e433-40a2-9283-f18fbe8d2d1d-kube-api-access-hm5ww\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.685558 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.685534    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/22edf87e-e433-40a2-9283-f18fbe8d2d1d-manager-config\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.687233 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.687212    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22edf87e-e433-40a2-9283-f18fbe8d2d1d-cert\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.687314 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.687251    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/22edf87e-e433-40a2-9283-f18fbe8d2d1d-metrics-cert\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.694205 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.694184    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5ww\" (UniqueName: \"kubernetes.io/projected/22edf87e-e433-40a2-9283-f18fbe8d2d1d-kube-api-access-hm5ww\") pod \"lws-controller-manager-6c7b4484d8-ttk9f\" (UID: \"22edf87e-e433-40a2-9283-f18fbe8d2d1d\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.774851 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.774756    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:01.906234 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:01.906204    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"]
Jul 24 19:40:01.908739 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:40:01.908712    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22edf87e_e433_40a2_9283_f18fbe8d2d1d.slice/crio-7944197dc5505bbc264c6403820513975b2e20600aa51d0d9eddf572e241a686 WatchSource:0}: Error finding container 7944197dc5505bbc264c6403820513975b2e20600aa51d0d9eddf572e241a686: Status 404 returned error can't find the container with id 7944197dc5505bbc264c6403820513975b2e20600aa51d0d9eddf572e241a686
Jul 24 19:40:02.062876 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:02.062797    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f" event={"ID":"22edf87e-e433-40a2-9283-f18fbe8d2d1d","Type":"ContainerStarted","Data":"7944197dc5505bbc264c6403820513975b2e20600aa51d0d9eddf572e241a686"}
Jul 24 19:40:03.059654 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.059594    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"]
Jul 24 19:40:03.062396 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.062377    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.065391 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.065367    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 19:40:03.065507 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.065443    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 19:40:03.067593 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.067576    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2ws7w\""
Jul 24 19:40:03.067964 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.067950    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 19:40:03.068387 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.068371    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 19:40:03.093467 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.092273    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"]
Jul 24 19:40:03.198604 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.198577    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0234b6e-f8f0-4908-86e1-7d050b038bfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.198748 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.198612    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0234b6e-f8f0-4908-86e1-7d050b038bfc-tmp\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.198748 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.198628    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0234b6e-f8f0-4908-86e1-7d050b038bfc-manifests\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.198748 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.198655    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8cbq\" (UniqueName: \"kubernetes.io/projected/c0234b6e-f8f0-4908-86e1-7d050b038bfc-kube-api-access-b8cbq\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.198748 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.198732    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0234b6e-f8f0-4908-86e1-7d050b038bfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.299915 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.299888    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0234b6e-f8f0-4908-86e1-7d050b038bfc-tmp\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.300029 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.299919    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0234b6e-f8f0-4908-86e1-7d050b038bfc-manifests\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.300029 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.299951    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8cbq\" (UniqueName: \"kubernetes.io/projected/c0234b6e-f8f0-4908-86e1-7d050b038bfc-kube-api-access-b8cbq\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.300029 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.299990    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0234b6e-f8f0-4908-86e1-7d050b038bfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.300148 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.300038    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0234b6e-f8f0-4908-86e1-7d050b038bfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.300398 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.300376    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0234b6e-f8f0-4908-86e1-7d050b038bfc-manifests\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.302089 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.302068    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0234b6e-f8f0-4908-86e1-7d050b038bfc-tmp\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.302386 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.302355    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0234b6e-f8f0-4908-86e1-7d050b038bfc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.302458 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.302412    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0234b6e-f8f0-4908-86e1-7d050b038bfc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.307637 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.307614    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8cbq\" (UniqueName: \"kubernetes.io/projected/c0234b6e-f8f0-4908-86e1-7d050b038bfc-kube-api-access-b8cbq\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-ps64d\" (UID: \"c0234b6e-f8f0-4908-86e1-7d050b038bfc\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.373695 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.373641    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:03.507737 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:03.507674    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"]
Jul 24 19:40:03.510352 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:40:03.510328    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0234b6e_f8f0_4908_86e1_7d050b038bfc.slice/crio-e25ee8bb04b127de8d5509e42616461adf1726df3478e7f13c0ddd75faee32c1 WatchSource:0}: Error finding container e25ee8bb04b127de8d5509e42616461adf1726df3478e7f13c0ddd75faee32c1: Status 404 returned error can't find the container with id e25ee8bb04b127de8d5509e42616461adf1726df3478e7f13c0ddd75faee32c1
Jul 24 19:40:04.073755 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:04.073714    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d" event={"ID":"c0234b6e-f8f0-4908-86e1-7d050b038bfc","Type":"ContainerStarted","Data":"e25ee8bb04b127de8d5509e42616461adf1726df3478e7f13c0ddd75faee32c1"}
Jul 24 19:40:05.081314 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:05.081273    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f" event={"ID":"22edf87e-e433-40a2-9283-f18fbe8d2d1d","Type":"ContainerStarted","Data":"5b0b2a5e85960cb12fad4aafb072877d0848bd36c1122bd84892ba3163b0e472"}
Jul 24 19:40:05.081716 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:05.081424    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:05.098879 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:05.098789    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f" podStartSLOduration=1.118324236 podStartE2EDuration="4.098748967s" totalImagesPullingTime="2.980424731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:40:05.097445868 +0000 UTC m=+345.221785026" watchObservedRunningTime="2026-07-24 19:40:05.098748967 +0000 UTC m=+345.223088124"
Jul 24 19:40:07.092621 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:07.092537    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d" event={"ID":"c0234b6e-f8f0-4908-86e1-7d050b038bfc","Type":"ContainerStarted","Data":"29ec4ac1400593caffefc19627974df7ae4b863e12b05cc19b3a4bcfd7ea5731"}
Jul 24 19:40:08.098472 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:08.098387    2541 generic.go:356] "Generic (PLEG): container finished" podID="c0234b6e-f8f0-4908-86e1-7d050b038bfc" containerID="29ec4ac1400593caffefc19627974df7ae4b863e12b05cc19b3a4bcfd7ea5731" exitCode=0
Jul 24 19:40:08.098472 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:08.098425    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d" event={"ID":"c0234b6e-f8f0-4908-86e1-7d050b038bfc","Type":"ContainerDied","Data":"29ec4ac1400593caffefc19627974df7ae4b863e12b05cc19b3a4bcfd7ea5731"}
Jul 24 19:40:09.104307 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:09.104263    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d" event={"ID":"c0234b6e-f8f0-4908-86e1-7d050b038bfc","Type":"ContainerStarted","Data":"b15580d48eb1a0c42287aa692d40a9927d5117339e7fe49a6ee2eccc0c189b71"}
Jul 24 19:40:09.104715 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:09.104377    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:09.127028 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:09.126968    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d" podStartSLOduration=1.552916459 podStartE2EDuration="6.126951762s" totalImagesPullingTime="3.575630871s" totalInitContainerRuntime="998.404432ms" isStatefulPod=false podCreationTimestamp="2026-07-24 19:40:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:40:09.124203966 +0000 UTC m=+349.248543122" watchObservedRunningTime="2026-07-24 19:40:09.126951762 +0000 UTC m=+349.251290912"
Jul 24 19:40:16.088809 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:16.088714    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-ttk9f"
Jul 24 19:40:20.111229 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:20.111196    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-ps64d"
Jul 24 19:40:37.228575 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.228544    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"]
Jul 24 19:40:37.236205 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.236182    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.239063 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.239038    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 19:40:37.239270 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.239253    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rtvn8\""
Jul 24 19:40:37.248534 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.248505    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"]
Jul 24 19:40:37.357489 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357451    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.357489 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357489    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.357735 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357516    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.357735 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357579    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.357735 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357632    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.357735 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357659    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.357735 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357675    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.357735 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357693    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klvzv\" (UniqueName: \"kubernetes.io/projected/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-kube-api-access-klvzv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.358010 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.357843    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.458937 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.458895    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459157 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.458950    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459157 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.458976    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459157 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.458996    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klvzv\" (UniqueName: \"kubernetes.io/projected/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-kube-api-access-klvzv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459157 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459058    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459157 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459106    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459157 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459146    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459486 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459348    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459486 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459470    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459579 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459527    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459579 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459557    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459669 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459591    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459897 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459868    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.459991 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.459966    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.461444 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.461424    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.461856 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.461834    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.472223 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.472189    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klvzv\" (UniqueName: \"kubernetes.io/projected/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-kube-api-access-klvzv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.474439 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.474413    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b412459d-b352-48dd-9d2f-56e2b1ee6ea7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh\" (UID: \"b412459d-b352-48dd-9d2f-56e2b1ee6ea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.547334 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.547232    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:37.563676 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.563639    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"]
Jul 24 19:40:37.567011 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.566987    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.569812 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.569785    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 19:40:37.569936 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.569822    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 19:40:37.569936 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.569797    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 19:40:37.569936 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.569910    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c9qrb\""
Jul 24 19:40:37.586305 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.586257    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"]
Jul 24 19:40:37.661230 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.661192    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.661230 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.661233    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.661476 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.661273    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.661476 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.661352    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v675c\" (UniqueName: \"kubernetes.io/projected/567e225a-8961-453e-bc5b-3272a9e8d31b-kube-api-access-v675c\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.661476 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.661391    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.661476 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.661455    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.661660 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.661483    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/567e225a-8961-453e-bc5b-3272a9e8d31b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.702700 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.702665    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"]
Jul 24 19:40:37.706334 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:40:37.706307    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb412459d_b352_48dd_9d2f_56e2b1ee6ea7.slice/crio-0ee4f15aaac51079c88acdaa1d3046aacfabb8a8776213cda3cf1ffc20a9b966 WatchSource:0}: Error finding container 0ee4f15aaac51079c88acdaa1d3046aacfabb8a8776213cda3cf1ffc20a9b966: Status 404 returned error can't find the container with id 0ee4f15aaac51079c88acdaa1d3046aacfabb8a8776213cda3cf1ffc20a9b966
Jul 24 19:40:37.762312 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.762263    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.762522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.762317    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/567e225a-8961-453e-bc5b-3272a9e8d31b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.762522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.762352    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.762522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.762375    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.762522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.762429    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.762522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.762469    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v675c\" (UniqueName: \"kubernetes.io/projected/567e225a-8961-453e-bc5b-3272a9e8d31b-kube-api-access-v675c\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.762522 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.762494    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.763291 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.763267    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.764875 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.764845    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/567e225a-8961-453e-bc5b-3272a9e8d31b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.764968 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.764876    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.765143 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.765126    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.765179 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.765158    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.771583 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.771558    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567e225a-8961-453e-bc5b-3272a9e8d31b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.772298 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.772278    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v675c\" (UniqueName: \"kubernetes.io/projected/567e225a-8961-453e-bc5b-3272a9e8d31b-kube-api-access-v675c\") pod \"istiod-openshift-gateway-5677ccb49b-zpzpz\" (UID: \"567e225a-8961-453e-bc5b-3272a9e8d31b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:37.877710 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:37.877600    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:38.027685 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:38.027658    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"]
Jul 24 19:40:38.228856 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:38.228816    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz" event={"ID":"567e225a-8961-453e-bc5b-3272a9e8d31b","Type":"ContainerStarted","Data":"a1f9cbad07a2e4a33e51f31e2638f705ca2973ac8df92c4aea405430922c52ba"}
Jul 24 19:40:38.230025 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:38.230000    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh" event={"ID":"b412459d-b352-48dd-9d2f-56e2b1ee6ea7","Type":"ContainerStarted","Data":"0ee4f15aaac51079c88acdaa1d3046aacfabb8a8776213cda3cf1ffc20a9b966"}
Jul 24 19:40:41.569449 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:41.569399    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:40:41.569855 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:41.569504    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:40:41.569855 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:41.569552    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:40:41.571711 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:41.571680    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:40:41.571862 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:41.571756    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:40:42.254986 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.254949    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz" event={"ID":"567e225a-8961-453e-bc5b-3272a9e8d31b","Type":"ContainerStarted","Data":"a1b9d1966cc8f0e7ac867693e1061d66dd5f590a3eb47321843d4cf3bc9e83d1"}
Jul 24 19:40:42.255195 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.255135    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:42.257054 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.256990    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh" event={"ID":"b412459d-b352-48dd-9d2f-56e2b1ee6ea7","Type":"ContainerStarted","Data":"115087e585b1e3ff6819aa283c20287ca5576e86fee3ed33bc4fc7fa0352ce96"}
Jul 24 19:40:42.257202 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.257064    2541 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-zpzpz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:40:42.257202 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.257109    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz" podUID="567e225a-8961-453e-bc5b-3272a9e8d31b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:40:42.280694 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.280640    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz" podStartSLOduration=1.741176924 podStartE2EDuration="5.280624229s" totalImagesPullingTime="3.539447305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:40:42.279111011 +0000 UTC m=+382.403450188" watchObservedRunningTime="2026-07-24 19:40:42.280624229 +0000 UTC m=+382.404963384"
Jul 24 19:40:42.300004 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.299946    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh" podStartSLOduration=1.439208922 podStartE2EDuration="5.299926477s" totalImagesPullingTime="3.860717555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:40:42.298083693 +0000 UTC m=+382.422422849" watchObservedRunningTime="2026-07-24 19:40:42.299926477 +0000 UTC m=+382.424265634"
Jul 24 19:40:42.548401 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.548306    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:42.553016 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:42.552988    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:43.262463 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:43.262430    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:40:43.262976 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:43.262903    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zpzpz"
Jul 24 19:40:43.263331 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:40:43.263313    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh"
Jul 24 19:41:39.856313 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.856272    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"]
Jul 24 19:41:39.864695 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.864619    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:39.866858 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.866829    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"]
Jul 24 19:41:39.867391 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.867371    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 19:41:39.868358 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.868333    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tf6ws\""
Jul 24 19:41:39.868501 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.868330    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 19:41:39.996182 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.996132    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:39.996372 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.996205    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:39.996372 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:39.996255    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj89z\" (UniqueName: \"kubernetes.io/projected/7e94b4dc-3766-4322-952e-8924024f78b0-kube-api-access-dj89z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.097476 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.097424    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj89z\" (UniqueName: \"kubernetes.io/projected/7e94b4dc-3766-4322-952e-8924024f78b0-kube-api-access-dj89z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.097636 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.097496    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.097636 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.097538    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.098022 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.098001    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.098078 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.098063    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.106030 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.106007    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj89z\" (UniqueName: \"kubernetes.io/projected/7e94b4dc-3766-4322-952e-8924024f78b0-kube-api-access-dj89z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.174589 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.174549    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:40.310212 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.310184    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"]
Jul 24 19:41:40.312599 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:41:40.312572    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e94b4dc_3766_4322_952e_8924024f78b0.slice/crio-2b27d59f120617a9d0ad3391ac5e16cb3d00a496db84aad5dfaae91d14ba91fa WatchSource:0}: Error finding container 2b27d59f120617a9d0ad3391ac5e16cb3d00a496db84aad5dfaae91d14ba91fa: Status 404 returned error can't find the container with id 2b27d59f120617a9d0ad3391ac5e16cb3d00a496db84aad5dfaae91d14ba91fa
Jul 24 19:41:40.521556 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.521521    2541 generic.go:356] "Generic (PLEG): container finished" podID="7e94b4dc-3766-4322-952e-8924024f78b0" containerID="e8c584f16d8eb54d344fe01e15494f171f5e4ae134b701a1d1798dd7d14f95b6" exitCode=0
Jul 24 19:41:40.521731 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.521610    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx" event={"ID":"7e94b4dc-3766-4322-952e-8924024f78b0","Type":"ContainerDied","Data":"e8c584f16d8eb54d344fe01e15494f171f5e4ae134b701a1d1798dd7d14f95b6"}
Jul 24 19:41:40.521731 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.521667    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx" event={"ID":"7e94b4dc-3766-4322-952e-8924024f78b0","Type":"ContainerStarted","Data":"2b27d59f120617a9d0ad3391ac5e16cb3d00a496db84aad5dfaae91d14ba91fa"}
Jul 24 19:41:40.649208 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.649170    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"]
Jul 24 19:41:40.652514 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.652495    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.660753 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.660722    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"]
Jul 24 19:41:40.702253 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.702147    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.702433 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.702254    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndq64\" (UniqueName: \"kubernetes.io/projected/9ecc686e-0fbd-4c21-b859-b586cb8156d3-kube-api-access-ndq64\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.702433 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.702392    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.803796 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.803715    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.803993 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.803835    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.803993 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.803900    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndq64\" (UniqueName: \"kubernetes.io/projected/9ecc686e-0fbd-4c21-b859-b586cb8156d3-kube-api-access-ndq64\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.804154 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.804133    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.804238 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.804217    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.812144 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.812120    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndq64\" (UniqueName: \"kubernetes.io/projected/9ecc686e-0fbd-4c21-b859-b586cb8156d3-kube-api-access-ndq64\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:40.961936 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:40.961837    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:41.051633 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.051594    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"]
Jul 24 19:41:41.055682 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.055658    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.066114 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.066088    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"]
Jul 24 19:41:41.101019 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.100991    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"]
Jul 24 19:41:41.103477 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:41:41.103449    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ecc686e_0fbd_4c21_b859_b586cb8156d3.slice/crio-55a4c79088b5094a1aed3a507b8f70ef5fb50efb92cbedbd0feeeea6a7822702 WatchSource:0}: Error finding container 55a4c79088b5094a1aed3a507b8f70ef5fb50efb92cbedbd0feeeea6a7822702: Status 404 returned error can't find the container with id 55a4c79088b5094a1aed3a507b8f70ef5fb50efb92cbedbd0feeeea6a7822702
Jul 24 19:41:41.107457 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.107436    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.107545 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.107477    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sn5w\" (UniqueName: \"kubernetes.io/projected/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-kube-api-access-9sn5w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.107545 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.107500    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.208061 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.208031    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.208167 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.208080    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sn5w\" (UniqueName: \"kubernetes.io/projected/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-kube-api-access-9sn5w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.208167 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.208104    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.208476 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.208452    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.208530 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.208514    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.216223 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.216151    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sn5w\" (UniqueName: \"kubernetes.io/projected/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-kube-api-access-9sn5w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.366987 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.366940    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:41.455560 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.455536    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"]
Jul 24 19:41:41.459251 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.459229    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.477057 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.477037    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"]
Jul 24 19:41:41.510891 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.510860    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjjtw\" (UniqueName: \"kubernetes.io/projected/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-kube-api-access-tjjtw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.510891 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.510898    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.511141 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.510936    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.529081 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.529045    2541 generic.go:356] "Generic (PLEG): container finished" podID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerID="2b2ef245dbd7d8a5ec79b64ba1c5c6d5d77bb9b2df88baa15b88e747df318025" exitCode=0
Jul 24 19:41:41.529273 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.529102    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4" event={"ID":"9ecc686e-0fbd-4c21-b859-b586cb8156d3","Type":"ContainerDied","Data":"2b2ef245dbd7d8a5ec79b64ba1c5c6d5d77bb9b2df88baa15b88e747df318025"}
Jul 24 19:41:41.529273 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.529154    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4" event={"ID":"9ecc686e-0fbd-4c21-b859-b586cb8156d3","Type":"ContainerStarted","Data":"55a4c79088b5094a1aed3a507b8f70ef5fb50efb92cbedbd0feeeea6a7822702"}
Jul 24 19:41:41.531284 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.531261    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx" event={"ID":"7e94b4dc-3766-4322-952e-8924024f78b0","Type":"ContainerStarted","Data":"6a67840beacc95d80db8e8037347c865c026a154eea5717bafbe4dfccb336bcd"}
Jul 24 19:41:41.538956 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.538714    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"]
Jul 24 19:41:41.541407 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:41:41.541381    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a02b5d_ce02_44c2_97a5_3b7a7408ec42.slice/crio-91538e01e823adff208cd9821eee46a27aea1b9a292608ac18540186d79491c4 WatchSource:0}: Error finding container 91538e01e823adff208cd9821eee46a27aea1b9a292608ac18540186d79491c4: Status 404 returned error can't find the container with id 91538e01e823adff208cd9821eee46a27aea1b9a292608ac18540186d79491c4
Jul 24 19:41:41.612312 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.612281    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjjtw\" (UniqueName: \"kubernetes.io/projected/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-kube-api-access-tjjtw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.612464 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.612325    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.612464 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.612374    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.612705 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.612683    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.612763 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.612718    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.621116 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.621087    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjjtw\" (UniqueName: \"kubernetes.io/projected/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-kube-api-access-tjjtw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.772695 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.772595    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:41.911119 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:41.911093    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"]
Jul 24 19:41:41.914695 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:41:41.913545    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca6c34b_4059_40c9_b09f_7ed0f5270a3c.slice/crio-85974393a8c0d107c00ef150a3fcd21daf4465f2b998aecd6c935ad38a3a5ab7 WatchSource:0}: Error finding container 85974393a8c0d107c00ef150a3fcd21daf4465f2b998aecd6c935ad38a3a5ab7: Status 404 returned error can't find the container with id 85974393a8c0d107c00ef150a3fcd21daf4465f2b998aecd6c935ad38a3a5ab7
Jul 24 19:41:42.537373 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.537334    2541 generic.go:356] "Generic (PLEG): container finished" podID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerID="b5295a39ecac6861649a9406a55bc40b28365e8903b016c9a609c7407bdc67c3" exitCode=0
Jul 24 19:41:42.537851 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.537378    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg" event={"ID":"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c","Type":"ContainerDied","Data":"b5295a39ecac6861649a9406a55bc40b28365e8903b016c9a609c7407bdc67c3"}
Jul 24 19:41:42.537851 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.537467    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg" event={"ID":"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c","Type":"ContainerStarted","Data":"85974393a8c0d107c00ef150a3fcd21daf4465f2b998aecd6c935ad38a3a5ab7"}
Jul 24 19:41:42.539386 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.539363    2541 generic.go:356] "Generic (PLEG): container finished" podID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerID="084953ef61f0c9ef4384d1571ac778563af6311a9416bb9a27e07113f52f060b" exitCode=0
Jul 24 19:41:42.539492 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.539460    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4" event={"ID":"9ecc686e-0fbd-4c21-b859-b586cb8156d3","Type":"ContainerDied","Data":"084953ef61f0c9ef4384d1571ac778563af6311a9416bb9a27e07113f52f060b"}
Jul 24 19:41:42.541090 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.541066    2541 generic.go:356] "Generic (PLEG): container finished" podID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerID="3707da17ad7dde4d6089157a4d0e3f6a217e98c81fe43a5cf1804f30ca1d60e7" exitCode=0
Jul 24 19:41:42.541181 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.541095    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq" event={"ID":"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42","Type":"ContainerDied","Data":"3707da17ad7dde4d6089157a4d0e3f6a217e98c81fe43a5cf1804f30ca1d60e7"}
Jul 24 19:41:42.541181 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.541164    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq" event={"ID":"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42","Type":"ContainerStarted","Data":"91538e01e823adff208cd9821eee46a27aea1b9a292608ac18540186d79491c4"}
Jul 24 19:41:42.543664 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.543633    2541 generic.go:356] "Generic (PLEG): container finished" podID="7e94b4dc-3766-4322-952e-8924024f78b0" containerID="6a67840beacc95d80db8e8037347c865c026a154eea5717bafbe4dfccb336bcd" exitCode=0
Jul 24 19:41:42.543755 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:42.543665    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx" event={"ID":"7e94b4dc-3766-4322-952e-8924024f78b0","Type":"ContainerDied","Data":"6a67840beacc95d80db8e8037347c865c026a154eea5717bafbe4dfccb336bcd"}
Jul 24 19:41:43.550094 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.550059    2541 generic.go:356] "Generic (PLEG): container finished" podID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerID="9f12391cb591789d77276a322a7917c65f4239fd16f387a8e79fe6e59872aa00" exitCode=0
Jul 24 19:41:43.550546 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.550136    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4" event={"ID":"9ecc686e-0fbd-4c21-b859-b586cb8156d3","Type":"ContainerDied","Data":"9f12391cb591789d77276a322a7917c65f4239fd16f387a8e79fe6e59872aa00"}
Jul 24 19:41:43.551927 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.551904    2541 generic.go:356] "Generic (PLEG): container finished" podID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerID="8698e3a46e91093a5b35fcbbbbe09ee340dcaa23b0991584a793677d57bc69ee" exitCode=0
Jul 24 19:41:43.552043 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.551978    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq" event={"ID":"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42","Type":"ContainerDied","Data":"8698e3a46e91093a5b35fcbbbbe09ee340dcaa23b0991584a793677d57bc69ee"}
Jul 24 19:41:43.554114 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.554091    2541 generic.go:356] "Generic (PLEG): container finished" podID="7e94b4dc-3766-4322-952e-8924024f78b0" containerID="a51de72086daef8bb99c6c2fcda215490ce428d27da2b6e8355dd90d2b58c631" exitCode=0
Jul 24 19:41:43.554198 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.554170    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx" event={"ID":"7e94b4dc-3766-4322-952e-8924024f78b0","Type":"ContainerDied","Data":"a51de72086daef8bb99c6c2fcda215490ce428d27da2b6e8355dd90d2b58c631"}
Jul 24 19:41:43.555862 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.555840    2541 generic.go:356] "Generic (PLEG): container finished" podID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerID="186c0f0891e2d39d3cdde3212fda9976ba55436eeca74a9f27e633ad1a75e355" exitCode=0
Jul 24 19:41:43.555933 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:43.555904    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg" event={"ID":"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c","Type":"ContainerDied","Data":"186c0f0891e2d39d3cdde3212fda9976ba55436eeca74a9f27e633ad1a75e355"}
Jul 24 19:41:44.563332 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.563300    2541 generic.go:356] "Generic (PLEG): container finished" podID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerID="26ff163c1956021c569f6ce2d485e0fa2dd6e9c4886e21ee9631a12311805992" exitCode=0
Jul 24 19:41:44.563801 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.563392    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq" event={"ID":"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42","Type":"ContainerDied","Data":"26ff163c1956021c569f6ce2d485e0fa2dd6e9c4886e21ee9631a12311805992"}
Jul 24 19:41:44.565640 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.565613    2541 generic.go:356] "Generic (PLEG): container finished" podID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerID="3e7dc58b489ff987a98f5fb86be1fe1bca3fef53a89aeae33f72c5b688054801" exitCode=0
Jul 24 19:41:44.565803 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.565686    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg" event={"ID":"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c","Type":"ContainerDied","Data":"3e7dc58b489ff987a98f5fb86be1fe1bca3fef53a89aeae33f72c5b688054801"}
Jul 24 19:41:44.705070 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.705039    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:44.729242 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.729209    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:44.840942 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.840845    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj89z\" (UniqueName: \"kubernetes.io/projected/7e94b4dc-3766-4322-952e-8924024f78b0-kube-api-access-dj89z\") pod \"7e94b4dc-3766-4322-952e-8924024f78b0\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") "
Jul 24 19:41:44.841125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.840944    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-bundle\") pod \"7e94b4dc-3766-4322-952e-8924024f78b0\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") "
Jul 24 19:41:44.841125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.840972    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-bundle\") pod \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") "
Jul 24 19:41:44.841125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.840996    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-util\") pod \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") "
Jul 24 19:41:44.841125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.841020    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-util\") pod \"7e94b4dc-3766-4322-952e-8924024f78b0\" (UID: \"7e94b4dc-3766-4322-952e-8924024f78b0\") "
Jul 24 19:41:44.841125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.841043    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndq64\" (UniqueName: \"kubernetes.io/projected/9ecc686e-0fbd-4c21-b859-b586cb8156d3-kube-api-access-ndq64\") pod \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\" (UID: \"9ecc686e-0fbd-4c21-b859-b586cb8156d3\") "
Jul 24 19:41:44.841601 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.841571    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-bundle" (OuterVolumeSpecName: "bundle") pod "9ecc686e-0fbd-4c21-b859-b586cb8156d3" (UID: "9ecc686e-0fbd-4c21-b859-b586cb8156d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:44.841711 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.841684    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-bundle" (OuterVolumeSpecName: "bundle") pod "7e94b4dc-3766-4322-952e-8924024f78b0" (UID: "7e94b4dc-3766-4322-952e-8924024f78b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:44.843343 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.843318    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e94b4dc-3766-4322-952e-8924024f78b0-kube-api-access-dj89z" (OuterVolumeSpecName: "kube-api-access-dj89z") pod "7e94b4dc-3766-4322-952e-8924024f78b0" (UID: "7e94b4dc-3766-4322-952e-8924024f78b0"). InnerVolumeSpecName "kube-api-access-dj89z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:41:44.843427 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.843352    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ecc686e-0fbd-4c21-b859-b586cb8156d3-kube-api-access-ndq64" (OuterVolumeSpecName: "kube-api-access-ndq64") pod "9ecc686e-0fbd-4c21-b859-b586cb8156d3" (UID: "9ecc686e-0fbd-4c21-b859-b586cb8156d3"). InnerVolumeSpecName "kube-api-access-ndq64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:41:44.846670 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.846644    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-util" (OuterVolumeSpecName: "util") pod "7e94b4dc-3766-4322-952e-8924024f78b0" (UID: "7e94b4dc-3766-4322-952e-8924024f78b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:44.846898 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.846874    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-util" (OuterVolumeSpecName: "util") pod "9ecc686e-0fbd-4c21-b859-b586cb8156d3" (UID: "9ecc686e-0fbd-4c21-b859-b586cb8156d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:44.942173 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.942137    2541 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:44.942173 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.942170    2541 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:44.942173 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.942181    2541 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecc686e-0fbd-4c21-b859-b586cb8156d3-util\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:44.942426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.942192    2541 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e94b4dc-3766-4322-952e-8924024f78b0-util\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:44.942426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.942203    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndq64\" (UniqueName: \"kubernetes.io/projected/9ecc686e-0fbd-4c21-b859-b586cb8156d3-kube-api-access-ndq64\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:44.942426 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:44.942216    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj89z\" (UniqueName: \"kubernetes.io/projected/7e94b4dc-3766-4322-952e-8924024f78b0-kube-api-access-dj89z\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:45.571971 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.571940    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4"
Jul 24 19:41:45.571971 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.571952    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4" event={"ID":"9ecc686e-0fbd-4c21-b859-b586cb8156d3","Type":"ContainerDied","Data":"55a4c79088b5094a1aed3a507b8f70ef5fb50efb92cbedbd0feeeea6a7822702"}
Jul 24 19:41:45.572525 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.572040    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55a4c79088b5094a1aed3a507b8f70ef5fb50efb92cbedbd0feeeea6a7822702"
Jul 24 19:41:45.573833 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.573799    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx" event={"ID":"7e94b4dc-3766-4322-952e-8924024f78b0","Type":"ContainerDied","Data":"2b27d59f120617a9d0ad3391ac5e16cb3d00a496db84aad5dfaae91d14ba91fa"}
Jul 24 19:41:45.573833 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.573822    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx"
Jul 24 19:41:45.573974 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.573849    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b27d59f120617a9d0ad3391ac5e16cb3d00a496db84aad5dfaae91d14ba91fa"
Jul 24 19:41:45.707125 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.707100    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:45.736942 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.736918    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:45.849832 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.849736    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sn5w\" (UniqueName: \"kubernetes.io/projected/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-kube-api-access-9sn5w\") pod \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") "
Jul 24 19:41:45.849832 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.849800    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjjtw\" (UniqueName: \"kubernetes.io/projected/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-kube-api-access-tjjtw\") pod \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") "
Jul 24 19:41:45.849832 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.849821    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-bundle\") pod \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") "
Jul 24 19:41:45.850069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.849926    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-util\") pod \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\" (UID: \"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c\") "
Jul 24 19:41:45.850069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.849974    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-bundle\") pod \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") "
Jul 24 19:41:45.850069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.850002    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-util\") pod \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\" (UID: \"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42\") "
Jul 24 19:41:45.850688 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.850660    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-bundle" (OuterVolumeSpecName: "bundle") pod "7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" (UID: "7ca6c34b-4059-40c9-b09f-7ed0f5270a3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:45.850860 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.850835    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-bundle" (OuterVolumeSpecName: "bundle") pod "e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" (UID: "e6a02b5d-ce02-44c2-97a5-3b7a7408ec42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:45.852120 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.852100    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-kube-api-access-tjjtw" (OuterVolumeSpecName: "kube-api-access-tjjtw") pod "7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" (UID: "7ca6c34b-4059-40c9-b09f-7ed0f5270a3c"). InnerVolumeSpecName "kube-api-access-tjjtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:41:45.852327 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.852295    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-kube-api-access-9sn5w" (OuterVolumeSpecName: "kube-api-access-9sn5w") pod "e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" (UID: "e6a02b5d-ce02-44c2-97a5-3b7a7408ec42"). InnerVolumeSpecName "kube-api-access-9sn5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:41:45.855964 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.855938    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-util" (OuterVolumeSpecName: "util") pod "e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" (UID: "e6a02b5d-ce02-44c2-97a5-3b7a7408ec42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:45.856792 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.856744    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-util" (OuterVolumeSpecName: "util") pod "7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" (UID: "7ca6c34b-4059-40c9-b09f-7ed0f5270a3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:41:45.951694 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.951652    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sn5w\" (UniqueName: \"kubernetes.io/projected/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-kube-api-access-9sn5w\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:45.951694 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.951689    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjjtw\" (UniqueName: \"kubernetes.io/projected/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-kube-api-access-tjjtw\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:45.951694 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.951700    2541 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:45.951951 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.951708    2541 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca6c34b-4059-40c9-b09f-7ed0f5270a3c-util\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:45.951951 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.951717    2541 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:45.951951 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:45.951724    2541 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6a02b5d-ce02-44c2-97a5-3b7a7408ec42-util\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 19:41:46.583091 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:46.583060    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq"
Jul 24 19:41:46.583572 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:46.583061    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq" event={"ID":"e6a02b5d-ce02-44c2-97a5-3b7a7408ec42","Type":"ContainerDied","Data":"91538e01e823adff208cd9821eee46a27aea1b9a292608ac18540186d79491c4"}
Jul 24 19:41:46.583572 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:46.583192    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91538e01e823adff208cd9821eee46a27aea1b9a292608ac18540186d79491c4"
Jul 24 19:41:46.585069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:46.585044    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg" event={"ID":"7ca6c34b-4059-40c9-b09f-7ed0f5270a3c","Type":"ContainerDied","Data":"85974393a8c0d107c00ef150a3fcd21daf4465f2b998aecd6c935ad38a3a5ab7"}
Jul 24 19:41:46.585069 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:46.585061    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg"
Jul 24 19:41:46.585242 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:41:46.585082    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85974393a8c0d107c00ef150a3fcd21daf4465f2b998aecd6c935ad38a3a5ab7"
Jul 24 19:42:49.992602 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.992556    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"]
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993019    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerName="extract"
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993034    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerName="extract"
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993050    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e94b4dc-3766-4322-952e-8924024f78b0" containerName="util"
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993059    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e94b4dc-3766-4322-952e-8924024f78b0" containerName="util"
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993069    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e94b4dc-3766-4322-952e-8924024f78b0" containerName="extract"
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993077    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e94b4dc-3766-4322-952e-8924024f78b0" containerName="extract"
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993087    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerName="pull"
Jul 24 19:42:49.993102 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993095    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerName="pull"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993110    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerName="util"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993119    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerName="util"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993129    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerName="util"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993137    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerName="util"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993147    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerName="pull"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993154    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerName="pull"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993163    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerName="extract"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993171    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerName="extract"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993180    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e94b4dc-3766-4322-952e-8924024f78b0" containerName="pull"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993187    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e94b4dc-3766-4322-952e-8924024f78b0" containerName="pull"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993198    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerName="pull"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993206    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerName="pull"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993213    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerName="extract"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993221    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerName="extract"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993230    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerName="util"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993239    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerName="util"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993315    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a02b5d-ce02-44c2-97a5-3b7a7408ec42" containerName="extract"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993327    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e94b4dc-3766-4322-952e-8924024f78b0" containerName="extract"
Jul 24 19:42:49.993336 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993336    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ecc686e-0fbd-4c21-b859-b586cb8156d3" containerName="extract"
Jul 24 19:42:49.993978 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.993351    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca6c34b-4059-40c9-b09f-7ed0f5270a3c" containerName="extract"
Jul 24 19:42:49.996687 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.996655    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:49.999661 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:49.999639    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2gs4c\""
Jul 24 19:42:50.006733 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.006696    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"]
Jul 24 19:42:50.074644 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074585    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074644 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074640    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074644 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074663    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074799    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d049fad-be2e-474b-98a4-4ad2e2071398-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074835    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074858    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074883    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074905    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrkq\" (UniqueName: \"kubernetes.io/projected/4d049fad-be2e-474b-98a4-4ad2e2071398-kube-api-access-vxrkq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.074961 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.074922    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.175909 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.175858    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176130 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176038    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d049fad-be2e-474b-98a4-4ad2e2071398-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176130 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176075    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176130 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176098    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176130 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176129    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176343 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176154    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrkq\" (UniqueName: \"kubernetes.io/projected/4d049fad-be2e-474b-98a4-4ad2e2071398-kube-api-access-vxrkq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176343 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176171    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176343 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176209    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176343 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176243    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176352    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176409    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176612    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176790 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176643    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.176972 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.176836    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d049fad-be2e-474b-98a4-4ad2e2071398-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.178659 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.178628    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.178911 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.178891    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.184147 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.184124    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d049fad-be2e-474b-98a4-4ad2e2071398-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.184272 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.184256    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrkq\" (UniqueName: \"kubernetes.io/projected/4d049fad-be2e-474b-98a4-4ad2e2071398-kube-api-access-vxrkq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hkv8r\" (UID: \"4d049fad-be2e-474b-98a4-4ad2e2071398\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.308905 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.308808    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:50.448828 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.448799    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"]
Jul 24 19:42:50.451138 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:42:50.451109    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d049fad_be2e_474b_98a4_4ad2e2071398.slice/crio-eaa66a75c964e49aa5f76c6b02ed2927709d0f4df6674b76a55e60575d811f59 WatchSource:0}: Error finding container eaa66a75c964e49aa5f76c6b02ed2927709d0f4df6674b76a55e60575d811f59: Status 404 returned error can't find the container with id eaa66a75c964e49aa5f76c6b02ed2927709d0f4df6674b76a55e60575d811f59
Jul 24 19:42:50.453178 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.453145    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:42:50.453283 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.453211    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:42:50.453283 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.453238    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:42:50.889943 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.889907    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" event={"ID":"4d049fad-be2e-474b-98a4-4ad2e2071398","Type":"ContainerStarted","Data":"540a1bca56c4f1602918c4b33a9ff9ce3fec80c3a90573d625266cefb58b39cc"}
Jul 24 19:42:50.890137 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.889963    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" event={"ID":"4d049fad-be2e-474b-98a4-4ad2e2071398","Type":"ContainerStarted","Data":"eaa66a75c964e49aa5f76c6b02ed2927709d0f4df6674b76a55e60575d811f59"}
Jul 24 19:42:50.909206 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:50.909153    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" podStartSLOduration=1.909136169 podStartE2EDuration="1.909136169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:42:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:42:50.908349264 +0000 UTC m=+511.032688420" watchObservedRunningTime="2026-07-24 19:42:50.909136169 +0000 UTC m=+511.033475400"
Jul 24 19:42:51.309478 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:51.309391    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:51.314319 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:51.314285    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:51.894635 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:51.894605    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:42:51.895501 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:42:51.895476    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:44:15.309321 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:15.309283    2541 generic.go:356] "Generic (PLEG): container finished" podID="4d049fad-be2e-474b-98a4-4ad2e2071398" containerID="540a1bca56c4f1602918c4b33a9ff9ce3fec80c3a90573d625266cefb58b39cc" exitCode=0
Jul 24 19:44:15.309745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:15.309342    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" event={"ID":"4d049fad-be2e-474b-98a4-4ad2e2071398","Type":"ContainerDied","Data":"540a1bca56c4f1602918c4b33a9ff9ce3fec80c3a90573d625266cefb58b39cc"}
Jul 24 19:44:15.309745 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:15.309687    2541 scope.go:117] "RemoveContainer" containerID="540a1bca56c4f1602918c4b33a9ff9ce3fec80c3a90573d625266cefb58b39cc"
Jul 24 19:44:15.310782 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:15.310742    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:44:15.310878 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:15.310851    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:44:15.310917 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:15.310900    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:44:16.316490 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:16.316459    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" event={"ID":"4d049fad-be2e-474b-98a4-4ad2e2071398","Type":"ContainerStarted","Data":"a172f61a588103d4276d6b27131118571a505a7112162abc45403428cbd2a5a9"}
Jul 24 19:44:17.309921 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:17.309883    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:44:17.310121 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:17.310099    2541 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hkv8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 24 19:44:17.310166 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:17.310150    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" podUID="4d049fad-be2e-474b-98a4-4ad2e2071398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 24 19:44:18.309521 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:18.309481    2541 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hkv8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 24 19:44:18.309967 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:18.309543    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" podUID="4d049fad-be2e-474b-98a4-4ad2e2071398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 24 19:44:19.309623 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:19.309580    2541 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hkv8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 24 19:44:19.310066 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:19.309640    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r" podUID="4d049fad-be2e-474b-98a4-4ad2e2071398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 24 19:44:20.313024 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:20.312993    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:44:20.313423 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:20.313274    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:44:20.313994 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:20.313973    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hkv8r"
Jul 24 19:44:33.821277 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.821238    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"]
Jul 24 19:44:33.824868 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.824846    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.827496 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.827469    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x9sks\""
Jul 24 19:44:33.827616 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.827474    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 19:44:33.828282 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.828260    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 19:44:33.828381 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.828263    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 19:44:33.834295 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.834268    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"]
Jul 24 19:44:33.840732 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.840705    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.840881 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.840747    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.840881 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.840866    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.840954 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.840895    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r285t\" (UniqueName: \"kubernetes.io/projected/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-kube-api-access-r285t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.840954 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.840922    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.841021 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.840976    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.941721 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.941674    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.941721 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.941720    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r285t\" (UniqueName: \"kubernetes.io/projected/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-kube-api-access-r285t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.942004 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.941826    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.942004 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.941871    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.942004 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.941893    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.942165 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.942045    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.942222 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.942166    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.942222 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.942185    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.942341 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.942300    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.944187 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.944164    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.944366 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.944351    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:33.949194 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:33.949170    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r285t\" (UniqueName: \"kubernetes.io/projected/4bd6c6d4-8ac3-437d-8be4-bef26943dc4c-kube-api-access-r285t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6\" (UID: \"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:34.136168 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:34.136133    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:34.281873 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:34.277581    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"]
Jul 24 19:44:34.284815 ip-10-0-140-118 kubenswrapper[2541]: W0724 19:44:34.284760    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd6c6d4_8ac3_437d_8be4_bef26943dc4c.slice/crio-bb400d0b11956e9491fcb23e3d710359fe9d9b5137de6daedc3967a9ecd41faa WatchSource:0}: Error finding container bb400d0b11956e9491fcb23e3d710359fe9d9b5137de6daedc3967a9ecd41faa: Status 404 returned error can't find the container with id bb400d0b11956e9491fcb23e3d710359fe9d9b5137de6daedc3967a9ecd41faa
Jul 24 19:44:34.286240 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:34.286215    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:44:34.406515 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:34.406420    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6" event={"ID":"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c","Type":"ContainerStarted","Data":"bb400d0b11956e9491fcb23e3d710359fe9d9b5137de6daedc3967a9ecd41faa"}
Jul 24 19:44:36.419033 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:36.418995    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6" event={"ID":"4bd6c6d4-8ac3-437d-8be4-bef26943dc4c","Type":"ContainerStarted","Data":"777ca75b90c694511e6423a9e2e20aa95d631c52d67e026ffd3d3e5b62d0ce47"}
Jul 24 19:44:36.438282 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:36.438219    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6" podStartSLOduration=2.361753606 podStartE2EDuration="3.438201842s" totalImagesPullingTime="1.076448236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:44:36.43557497 +0000 UTC m=+616.559914140" watchObservedRunningTime="2026-07-24 19:44:36.438201842 +0000 UTC m=+616.562540998"
Jul 24 19:44:44.136417 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:44.136318    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:44.136417 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:44.136382    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:44.148939 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:44.148907    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:44.469440 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:44.469350    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6"
Jul 24 19:44:57.914836 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:57.914801    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"]
Jul 24 19:44:57.918047 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:57.918025    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:57.921033 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:57.921012    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 19:44:57.933055 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:57.933031    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"]
Jul 24 19:44:58.062248 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.062202    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.062447 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.062291    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df49r\" (UniqueName: \"kubernetes.io/projected/96255f72-ae19-440c-9010-d671225ab508-kube-api-access-df49r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.062447 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.062328    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96255f72-ae19-440c-9010-d671225ab508-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.062447 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.062370    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.062447 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.062401    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.062447 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.062422    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.162949 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.162908    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df49r\" (UniqueName: \"kubernetes.io/projected/96255f72-ae19-440c-9010-d671225ab508-kube-api-access-df49r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.162949 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.162955    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96255f72-ae19-440c-9010-d671225ab508-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.163208 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.162991    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.163208 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.163023    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.163208 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.163038    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.163208 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.163068    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.163470 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.163445    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.163470 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.163465    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.163550 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.163499    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.165441 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.165385    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96255f72-ae19-440c-9010-d671225ab508-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.165658 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.165641    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96255f72-ae19-440c-9010-d671225ab508-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.171197 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.171173    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df49r\" (UniqueName: \"kubernetes.io/projected/96255f72-ae19-440c-9010-d671225ab508-kube-api-access-df49r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw\" (UID: \"96255f72-ae19-440c-9010-d671225ab508\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.228689 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.228650    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:44:58.364738 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.362780    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"]
Jul 24 19:44:58.526172 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:58.526088    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw" event={"ID":"96255f72-ae19-440c-9010-d671225ab508","Type":"ContainerStarted","Data":"a3e25aa5a4e4151a3333f913db1abe3324a42cf0e74c42d7c38c99f89c883fd3"}
Jul 24 19:44:59.534478 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:59.534440    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw" event={"ID":"96255f72-ae19-440c-9010-d671225ab508","Type":"ContainerStarted","Data":"72e4d291a6b4e98816d88b13ff6c64160712517963c0c187e3c9bee09d7b2d5c"}
Jul 24 19:44:59.564323 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:44:59.564274    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw" podStartSLOduration=2.40274395 podStartE2EDuration="2.564258893s" totalImagesPullingTime="161.514943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:44:59.56224013 +0000 UTC m=+639.686579310" watchObservedRunningTime="2026-07-24 19:44:59.564258893 +0000 UTC m=+639.688598049"
Jul 24 19:45:08.229720 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:45:08.229680    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:45:08.230292 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:45:08.229850    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:45:08.242544 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:45:08.242519    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 19:45:08.590001 ip-10-0-140-118 kubenswrapper[2541]: I0724 19:45:08.589910    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw"
Jul 24 20:00:00.132412 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.132381    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495"]
Jul 24 20:00:00.135593 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.135578    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495"
Jul 24 20:00:00.138246 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.138228    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:00:00.145129 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.145109    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495"
Jul 24 20:00:00.150728 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.150708    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495"]
Jul 24 20:00:00.273812 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.273785    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495"]
Jul 24 20:00:00.275937 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:00:00.275912    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08e593b_bc3c_4036_935f_62fef9d8173b.slice/crio-e5b6a08c585ae26d6cf6a8544c800bed171a0b53aeab2048c244357d3c90b105 WatchSource:0}: Error finding container e5b6a08c585ae26d6cf6a8544c800bed171a0b53aeab2048c244357d3c90b105: Status 404 returned error can't find the container with id e5b6a08c585ae26d6cf6a8544c800bed171a0b53aeab2048c244357d3c90b105
Jul 24 20:00:00.277726 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.277709    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 20:00:00.921537 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:00.921510    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495" event={"ID":"c08e593b-bc3c-4036-935f-62fef9d8173b","Type":"ContainerStarted","Data":"e5b6a08c585ae26d6cf6a8544c800bed171a0b53aeab2048c244357d3c90b105"}
Jul 24 20:00:03.938388 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:03.938353    2541 generic.go:356] "Generic (PLEG): container finished" podID="c08e593b-bc3c-4036-935f-62fef9d8173b" containerID="52326a6387ad4454fbbbc6a2f6b34b0482329ffbc1b523043005a720664d9515" exitCode=0
Jul 24 20:00:03.938747 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:03.938405    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495" event={"ID":"c08e593b-bc3c-4036-935f-62fef9d8173b","Type":"ContainerDied","Data":"52326a6387ad4454fbbbc6a2f6b34b0482329ffbc1b523043005a720664d9515"}
Jul 24 20:00:05.071289 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:05.071261    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495"
Jul 24 20:00:05.950734 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:05.950704    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495" event={"ID":"c08e593b-bc3c-4036-935f-62fef9d8173b","Type":"ContainerDied","Data":"e5b6a08c585ae26d6cf6a8544c800bed171a0b53aeab2048c244357d3c90b105"}
Jul 24 20:00:05.950734 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:05.950727    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-4w495"
Jul 24 20:00:05.950954 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:00:05.950750    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5b6a08c585ae26d6cf6a8544c800bed171a0b53aeab2048c244357d3c90b105"
Jul 24 20:01:25.127741 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.127666    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"]
Jul 24 20:01:25.128202 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.128041    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08e593b-bc3c-4036-935f-62fef9d8173b" containerName="cleanup"
Jul 24 20:01:25.128202 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.128055    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08e593b-bc3c-4036-935f-62fef9d8173b" containerName="cleanup"
Jul 24 20:01:25.128202 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.128135    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08e593b-bc3c-4036-935f-62fef9d8173b" containerName="cleanup"
Jul 24 20:01:25.130973 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.130954    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.134053 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.134033    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-844e866c-openshift-default-dockercfg-nd7sw\""
Jul 24 20:01:25.142689 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.142663    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"]
Jul 24 20:01:25.178656 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178630    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74557d3e-b7da-45ce-b5d9-37b20976a473-istiod-ca-cert\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178819 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178681    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-socket\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178819 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178756    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-envoy\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178830    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwj5z\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-kube-api-access-qwj5z\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178863    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-credential-socket\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178884    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-podinfo\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178898    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-token\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178914    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-certs\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.178971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.178935    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-data\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.279776 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.279743    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-credential-socket\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.279979 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.279811    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-podinfo\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.279979 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.279909    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-token\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.279979 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.279936    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-certs\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.279979 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.279959    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-data\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280201 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280034    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74557d3e-b7da-45ce-b5d9-37b20976a473-istiod-ca-cert\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280201 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280082    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-socket\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280201 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280138    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-envoy\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280201 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280185    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwj5z\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-kube-api-access-qwj5z\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280370 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280221    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-credential-socket\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280370 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280254    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-certs\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280370 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280328    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-data\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.280496 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.280472    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-socket\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.281190 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.281167    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74557d3e-b7da-45ce-b5d9-37b20976a473-istiod-ca-cert\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.282309 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.282288    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-envoy\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.282501 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.282487    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-podinfo\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.287908 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.287883    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-token\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.287908 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.287905    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwj5z\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-kube-api-access-qwj5z\") pod \"e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") " pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.440749 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.440711    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:25.579362 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.579337    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"]
Jul 24 20:01:25.581145 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:01:25.581117    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74557d3e_b7da_45ce_b5d9_37b20976a473.slice/crio-0323db7d4f30f913b5f1f979533f7783f9ea11453c42756dd46dba507cf8019e WatchSource:0}: Error finding container 0323db7d4f30f913b5f1f979533f7783f9ea11453c42756dd46dba507cf8019e: Status 404 returned error can't find the container with id 0323db7d4f30f913b5f1f979533f7783f9ea11453c42756dd46dba507cf8019e
Jul 24 20:01:25.583255 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.583222    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:01:25.583321 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.583303    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:01:25.583358 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:25.583342    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:01:26.337430 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:26.337394    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" event={"ID":"74557d3e-b7da-45ce-b5d9-37b20976a473","Type":"ContainerStarted","Data":"c844b5a19ceba50b92cebd4e712afaec3e8f63003784bf0d4d735834370dabcf"}
Jul 24 20:01:26.337892 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:26.337446    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" event={"ID":"74557d3e-b7da-45ce-b5d9-37b20976a473","Type":"ContainerStarted","Data":"0323db7d4f30f913b5f1f979533f7783f9ea11453c42756dd46dba507cf8019e"}
Jul 24 20:01:26.358291 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:26.358224    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" podStartSLOduration=1.358183269 podStartE2EDuration="1.358183269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:26.357096224 +0000 UTC m=+1626.481435381" watchObservedRunningTime="2026-07-24 20:01:26.358183269 +0000 UTC m=+1626.482522426"
Jul 24 20:01:26.441607 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:26.441566    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:26.446672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:26.446643    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:27.341872 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:27.341840    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:27.342813 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:27.342792    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:42.343194 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.343116    2541 patch_prober.go:28] interesting pod/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 24 20:01:42.343194 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.343168    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 24 20:01:42.415543 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.415510    2541 generic.go:356] "Generic (PLEG): container finished" podID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerID="c844b5a19ceba50b92cebd4e712afaec3e8f63003784bf0d4d735834370dabcf" exitCode=0
Jul 24 20:01:42.415697 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.415582    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" event={"ID":"74557d3e-b7da-45ce-b5d9-37b20976a473","Type":"ContainerDied","Data":"c844b5a19ceba50b92cebd4e712afaec3e8f63003784bf0d4d735834370dabcf"}
Jul 24 20:01:42.416035 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.416018    2541 scope.go:117] "RemoveContainer" containerID="c844b5a19ceba50b92cebd4e712afaec3e8f63003784bf0d4d735834370dabcf"
Jul 24 20:01:42.416970 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.416945    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:01:42.417079 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.417009    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:01:42.417079 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:42.417042    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:01:43.422233 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:43.422199    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" event={"ID":"74557d3e-b7da-45ce-b5d9-37b20976a473","Type":"ContainerStarted","Data":"ce09b65394e75f010c7b6f804ad32977478df987aa4be3933168c860fabf6f8e"}
Jul 24 20:01:43.441287 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:43.441254    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:43.441629 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:43.441522    2541 patch_prober.go:28] interesting pod/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 24 20:01:43.441880 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:43.441856    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 24 20:01:44.441849 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:44.441812    2541 patch_prober.go:28] interesting pod/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 24 20:01:44.442352 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:44.441876    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 24 20:01:45.442153 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:45.442111    2541 patch_prober.go:28] interesting pod/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 24 20:01:45.442662 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:45.442192    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 24 20:01:46.441803 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:46.441745    2541 patch_prober.go:28] interesting pod/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 24 20:01:46.442007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:46.441830    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 24 20:01:47.445009 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:47.444980    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:47.445470 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:47.445420    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:47.446271 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:47.446250    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:01:53.213213 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.213175    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"]
Jul 24 20:01:53.216395 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.216378    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"
Jul 24 20:01:53.218996 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.218974    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:01:53.219102 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.219009    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:01:53.224519 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.224494    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"]
Jul 24 20:01:53.234403 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.234379    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb52faa1-7911-46a0-a5d9-c20516f6b865-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-844e866c-vcsg4\" (UID: \"bb52faa1-7911-46a0-a5d9-c20516f6b865\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"
Jul 24 20:01:53.335623 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.335582    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb52faa1-7911-46a0-a5d9-c20516f6b865-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-844e866c-vcsg4\" (UID: \"bb52faa1-7911-46a0-a5d9-c20516f6b865\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"
Jul 24 20:01:53.336682 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.336657    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb52faa1-7911-46a0-a5d9-c20516f6b865-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-844e866c-vcsg4\" (UID: \"bb52faa1-7911-46a0-a5d9-c20516f6b865\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"
Jul 24 20:01:53.527108 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.527008    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"
Jul 24 20:01:53.859915 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:53.859886    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"]
Jul 24 20:01:53.861456 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:01:53.861429    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb52faa1_7911_46a0_a5d9_c20516f6b865.slice/crio-d054ae305f54efbae148e41f4a1ce3506d86a8a333f8b9a1b26ebad9af69bf4b WatchSource:0}: Error finding container d054ae305f54efbae148e41f4a1ce3506d86a8a333f8b9a1b26ebad9af69bf4b: Status 404 returned error can't find the container with id d054ae305f54efbae148e41f4a1ce3506d86a8a333f8b9a1b26ebad9af69bf4b
Jul 24 20:01:54.478473 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:54.478373    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4" event={"ID":"bb52faa1-7911-46a0-a5d9-c20516f6b865","Type":"ContainerStarted","Data":"c2ee49433d37a290b6c5943816a6425be7816e9a102e7f519cbd20314365d524"}
Jul 24 20:01:54.478473 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:54.478434    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4" event={"ID":"bb52faa1-7911-46a0-a5d9-c20516f6b865","Type":"ContainerStarted","Data":"d054ae305f54efbae148e41f4a1ce3506d86a8a333f8b9a1b26ebad9af69bf4b"}
Jul 24 20:01:54.494587 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:54.494534    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4" podStartSLOduration=1.494519667 podStartE2EDuration="1.494519667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:54.491944766 +0000 UTC m=+1654.616283921" watchObservedRunningTime="2026-07-24 20:01:54.494519667 +0000 UTC m=+1654.618858824"
Jul 24 20:01:55.485419 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:55.485386    2541 generic.go:356] "Generic (PLEG): container finished" podID="bb52faa1-7911-46a0-a5d9-c20516f6b865" containerID="c2ee49433d37a290b6c5943816a6425be7816e9a102e7f519cbd20314365d524" exitCode=0
Jul 24 20:01:55.485842 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:55.485471    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4" event={"ID":"bb52faa1-7911-46a0-a5d9-c20516f6b865","Type":"ContainerDied","Data":"c2ee49433d37a290b6c5943816a6425be7816e9a102e7f519cbd20314365d524"}
Jul 24 20:01:56.622967 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:56.622939    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"
Jul 24 20:01:56.663857 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:56.663821    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb52faa1-7911-46a0-a5d9-c20516f6b865-maas-api-service-ca\") pod \"bb52faa1-7911-46a0-a5d9-c20516f6b865\" (UID: \"bb52faa1-7911-46a0-a5d9-c20516f6b865\") "
Jul 24 20:01:56.664249 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:56.664219    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb52faa1-7911-46a0-a5d9-c20516f6b865-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb52faa1-7911-46a0-a5d9-c20516f6b865" (UID: "bb52faa1-7911-46a0-a5d9-c20516f6b865"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:01:56.764726 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:56.764636    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb52faa1-7911-46a0-a5d9-c20516f6b865-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:01:57.497159 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:57.497130    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"
Jul 24 20:01:57.497328 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:57.497173    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4" event={"ID":"bb52faa1-7911-46a0-a5d9-c20516f6b865","Type":"ContainerDied","Data":"d054ae305f54efbae148e41f4a1ce3506d86a8a333f8b9a1b26ebad9af69bf4b"}
Jul 24 20:01:57.497328 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:01:57.497221    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d054ae305f54efbae148e41f4a1ce3506d86a8a333f8b9a1b26ebad9af69bf4b"
Jul 24 20:02:08.296524 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:08.296486    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"]
Jul 24 20:02:08.298627 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:08.298603    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-844e866c-vcsg4"]
Jul 24 20:02:08.424292 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:08.424245    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"]
Jul 24 20:02:08.424514 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:08.424488    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy" containerID="cri-o://ce09b65394e75f010c7b6f804ad32977478df987aa4be3933168c860fabf6f8e" gracePeriod=30
Jul 24 20:02:08.578280 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:08.578199    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb52faa1-7911-46a0-a5d9-c20516f6b865" path="/var/lib/kubelet/pods/bb52faa1-7911-46a0-a5d9-c20516f6b865/volumes"
Jul 24 20:02:09.403078 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.403049    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"]
Jul 24 20:02:09.403443 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.403376    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb52faa1-7911-46a0-a5d9-c20516f6b865" containerName="revoke-keys"
Jul 24 20:02:09.403443 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.403386    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb52faa1-7911-46a0-a5d9-c20516f6b865" containerName="revoke-keys"
Jul 24 20:02:09.403521 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.403452    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb52faa1-7911-46a0-a5d9-c20516f6b865" containerName="revoke-keys"
Jul 24 20:02:09.406639 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.406618    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.409240 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.409222    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-bc219aa6-gw-openshift-default-dockercfg-v6s22\""
Jul 24 20:02:09.417581 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.417560    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"]
Jul 24 20:02:09.462094 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462066    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-credential-socket\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462094 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462094    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-token\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462236 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462115    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-data\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462236 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462131    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istiod-ca-cert\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462310 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462231    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-certs\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462310 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462264    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-podinfo\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462310 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462303    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-socket\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462414 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462339    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8bh\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-kube-api-access-ld8bh\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.462414 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.462384    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-envoy\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.563832 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.563795    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-certs\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.563832 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.563835    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-podinfo\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564087 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.563864    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-socket\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564087 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.563890    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8bh\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-kube-api-access-ld8bh\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564087 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.563929    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-envoy\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564087 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.563963    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-credential-socket\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564087 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564050    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-token\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564087 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564075    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-data\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564381 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564097    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istiod-ca-cert\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564381 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564223    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-certs\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564534 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564501    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-credential-socket\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564609 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564589    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-socket\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564686 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564665    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-data\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.564938 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.564919    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istiod-ca-cert\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.566332 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.566299    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-envoy\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.566452 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.566382    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-podinfo\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.571742 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.571723    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-token\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.571952 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.571936    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8bh\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-kube-api-access-ld8bh\") pod \"e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") " pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.717297 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.717218    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:09.850198 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.850162    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"]
Jul 24 20:02:09.851493 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:02:09.851471    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5196cf5e_c7fd_4064_aa7f_27460ea0d66d.slice/crio-2fec72dd390f1c8641fa832bc01691b310e4d9748b0dec5d90ff9b6158d6c30d WatchSource:0}: Error finding container 2fec72dd390f1c8641fa832bc01691b310e4d9748b0dec5d90ff9b6158d6c30d: Status 404 returned error can't find the container with id 2fec72dd390f1c8641fa832bc01691b310e4d9748b0dec5d90ff9b6158d6c30d
Jul 24 20:02:09.853795 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.853731    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:09.853914 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.853889    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:09.853965 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:09.853947    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:10.563270 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:10.563235    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" event={"ID":"5196cf5e-c7fd-4064-aa7f-27460ea0d66d","Type":"ContainerStarted","Data":"044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4"}
Jul 24 20:02:10.563713 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:10.563290    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" event={"ID":"5196cf5e-c7fd-4064-aa7f-27460ea0d66d","Type":"ContainerStarted","Data":"2fec72dd390f1c8641fa832bc01691b310e4d9748b0dec5d90ff9b6158d6c30d"}
Jul 24 20:02:10.583915 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:10.583857    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" podStartSLOduration=1.5838239870000002 podStartE2EDuration="1.583823987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:02:10.582628391 +0000 UTC m=+1670.706967544" watchObservedRunningTime="2026-07-24 20:02:10.583823987 +0000 UTC m=+1670.708163145"
Jul 24 20:02:10.718126 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:10.718086    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:10.722646 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:10.722625    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:11.568321 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:11.568288    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:11.569165 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:11.569141    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:13.581057 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.581024    2541 generic.go:356] "Generic (PLEG): container finished" podID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerID="ce09b65394e75f010c7b6f804ad32977478df987aa4be3933168c860fabf6f8e" exitCode=0
Jul 24 20:02:13.581511 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.581100    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" event={"ID":"74557d3e-b7da-45ce-b5d9-37b20976a473","Type":"ContainerDied","Data":"ce09b65394e75f010c7b6f804ad32977478df987aa4be3933168c860fabf6f8e"}
Jul 24 20:02:13.581511 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.581166    2541 scope.go:117] "RemoveContainer" containerID="c844b5a19ceba50b92cebd4e712afaec3e8f63003784bf0d4d735834370dabcf"
Jul 24 20:02:13.673181 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.673155    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:02:13.804179 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804114    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-data\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804179 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804145    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74557d3e-b7da-45ce-b5d9-37b20976a473-istiod-ca-cert\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804179 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804175    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-certs\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804228    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-credential-socket\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804253    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-envoy\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804276    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-token\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804306    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-podinfo\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804328    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwj5z\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-kube-api-access-qwj5z\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804381    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-socket\") pod \"74557d3e-b7da-45ce-b5d9-37b20976a473\" (UID: \"74557d3e-b7da-45ce-b5d9-37b20976a473\") "
Jul 24 20:02:13.804865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804536    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:13.804865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804572    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:13.804865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804613    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74557d3e-b7da-45ce-b5d9-37b20976a473-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:02:13.804865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804665    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.804865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804683    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.804865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.804763    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:13.805123 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.805101    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-data" (OuterVolumeSpecName: "istio-data") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:13.806535 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.806510    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-token" (OuterVolumeSpecName: "istio-token") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:02:13.806630 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.806569    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:02:13.806986 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.806961    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-kube-api-access-qwj5z" (OuterVolumeSpecName: "kube-api-access-qwj5z") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "kube-api-access-qwj5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:02:13.806986 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.806975    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74557d3e-b7da-45ce-b5d9-37b20976a473" (UID: "74557d3e-b7da-45ce-b5d9-37b20976a473"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:13.905858 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.905833    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.905858 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.905854    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.905858 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.905863    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.906034 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.905871    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwj5z\" (UniqueName: \"kubernetes.io/projected/74557d3e-b7da-45ce-b5d9-37b20976a473-kube-api-access-qwj5z\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.906034 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.905881    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.906034 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.905889    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74557d3e-b7da-45ce-b5d9-37b20976a473-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:13.906034 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:13.905898    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74557d3e-b7da-45ce-b5d9-37b20976a473-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:14.587539 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:14.587513    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"
Jul 24 20:02:14.587990 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:14.587543    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc" event={"ID":"74557d3e-b7da-45ce-b5d9-37b20976a473","Type":"ContainerDied","Data":"0323db7d4f30f913b5f1f979533f7783f9ea11453c42756dd46dba507cf8019e"}
Jul 24 20:02:14.587990 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:14.587606    2541 scope.go:117] "RemoveContainer" containerID="ce09b65394e75f010c7b6f804ad32977478df987aa4be3933168c860fabf6f8e"
Jul 24 20:02:14.605869 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:14.605841    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"]
Jul 24 20:02:14.612656 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:14.612634    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-844e866c-openshift-default-776c7644b4-rfhgc"]
Jul 24 20:02:16.579163 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:16.579130    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" path="/var/lib/kubelet/pods/74557d3e-b7da-45ce-b5d9-37b20976a473/volumes"
Jul 24 20:02:26.569224 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.569188    2541 patch_prober.go:28] interesting pod/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 24 20:02:26.569618 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.569280    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 24 20:02:26.650513 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.650483    2541 generic.go:356] "Generic (PLEG): container finished" podID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerID="044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4" exitCode=0
Jul 24 20:02:26.650656 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.650553    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" event={"ID":"5196cf5e-c7fd-4064-aa7f-27460ea0d66d","Type":"ContainerDied","Data":"044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4"}
Jul 24 20:02:26.650975 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.650949    2541 scope.go:117] "RemoveContainer" containerID="044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4"
Jul 24 20:02:26.651916 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.651893    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:26.651976 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.651956    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:26.652025 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:26.651986    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:27.661310 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:27.661278    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" event={"ID":"5196cf5e-c7fd-4064-aa7f-27460ea0d66d","Type":"ContainerStarted","Data":"df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5"}
Jul 24 20:02:27.718186 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:27.718158    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:27.718341 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:27.718301    2541 patch_prober.go:28] interesting pod/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 24 20:02:27.718389 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:27.718352    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 24 20:02:28.718521 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:28.718487    2541 patch_prober.go:28] interesting pod/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 24 20:02:28.718926 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:28.718549    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 24 20:02:29.718451 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:29.718414    2541 patch_prober.go:28] interesting pod/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 24 20:02:29.718613 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:29.718476    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 24 20:02:30.718391 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:30.718356    2541 patch_prober.go:28] interesting pod/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 24 20:02:30.718585 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:30.718412    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 24 20:02:31.721391 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:31.721365    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:31.721812 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:31.721630    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:31.722304 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:31.722290    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:37.042069 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.042025    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"]
Jul 24 20:02:37.042445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.042354    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy"
Jul 24 20:02:37.042445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.042365    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy"
Jul 24 20:02:37.042445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.042376    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy"
Jul 24 20:02:37.042445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.042381    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy"
Jul 24 20:02:37.042445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.042440    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy"
Jul 24 20:02:37.042598 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.042449    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="74557d3e-b7da-45ce-b5d9-37b20976a473" containerName="istio-proxy"
Jul 24 20:02:37.045970 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.045953    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"
Jul 24 20:02:37.048537 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.048510    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:02:37.048663 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.048577    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:02:37.053070 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.053046    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"]
Jul 24 20:02:37.201682 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.201654    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f7629d-8771-4d43-9aa2-ff80157c9235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk\" (UID: \"43f7629d-8771-4d43-9aa2-ff80157c9235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"
Jul 24 20:02:37.302918 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.302840    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f7629d-8771-4d43-9aa2-ff80157c9235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk\" (UID: \"43f7629d-8771-4d43-9aa2-ff80157c9235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"
Jul 24 20:02:37.303434 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.303412    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f7629d-8771-4d43-9aa2-ff80157c9235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk\" (UID: \"43f7629d-8771-4d43-9aa2-ff80157c9235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"
Jul 24 20:02:37.358001 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.357980    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"
Jul 24 20:02:37.489163 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.489141    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"]
Jul 24 20:02:37.490748 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:02:37.490719    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f7629d_8771_4d43_9aa2_ff80157c9235.slice/crio-b15b6ce3c7d4a31c5d1298dcd6016227438f093e66417150b559cda78bc57656 WatchSource:0}: Error finding container b15b6ce3c7d4a31c5d1298dcd6016227438f093e66417150b559cda78bc57656: Status 404 returned error can't find the container with id b15b6ce3c7d4a31c5d1298dcd6016227438f093e66417150b559cda78bc57656
Jul 24 20:02:37.710747 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:37.710721    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk" event={"ID":"43f7629d-8771-4d43-9aa2-ff80157c9235","Type":"ContainerStarted","Data":"b15b6ce3c7d4a31c5d1298dcd6016227438f093e66417150b559cda78bc57656"}
Jul 24 20:02:38.717030 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:38.716994    2541 generic.go:356] "Generic (PLEG): container finished" podID="43f7629d-8771-4d43-9aa2-ff80157c9235" containerID="091aff977ab84adf2e30f0bd6187eed7b23fe3377aa5515eb865d29285083e31" exitCode=0
Jul 24 20:02:38.717411 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:38.717035    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk" event={"ID":"43f7629d-8771-4d43-9aa2-ff80157c9235","Type":"ContainerDied","Data":"091aff977ab84adf2e30f0bd6187eed7b23fe3377aa5515eb865d29285083e31"}
Jul 24 20:02:39.851173 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:39.851149    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"
Jul 24 20:02:40.024273 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:40.024204    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f7629d-8771-4d43-9aa2-ff80157c9235-maas-api-service-ca\") pod \"43f7629d-8771-4d43-9aa2-ff80157c9235\" (UID: \"43f7629d-8771-4d43-9aa2-ff80157c9235\") "
Jul 24 20:02:40.024539 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:40.024516    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43f7629d-8771-4d43-9aa2-ff80157c9235-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43f7629d-8771-4d43-9aa2-ff80157c9235" (UID: "43f7629d-8771-4d43-9aa2-ff80157c9235"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:02:40.125327 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:40.125302    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f7629d-8771-4d43-9aa2-ff80157c9235-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:40.728433 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:40.728406    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"
Jul 24 20:02:40.728433 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:40.728423    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk" event={"ID":"43f7629d-8771-4d43-9aa2-ff80157c9235","Type":"ContainerDied","Data":"b15b6ce3c7d4a31c5d1298dcd6016227438f093e66417150b559cda78bc57656"}
Jul 24 20:02:40.728602 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:40.728467    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b15b6ce3c7d4a31c5d1298dcd6016227438f093e66417150b559cda78bc57656"
Jul 24 20:02:52.131326 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:52.131287    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"]
Jul 24 20:02:52.137221 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:52.137191    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc219aa6-vkvhk"]
Jul 24 20:02:52.268703 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:52.268670    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"]
Jul 24 20:02:52.268963 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:52.268935    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy" containerID="cri-o://df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5" gracePeriod=30
Jul 24 20:02:52.578674 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:52.578637    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43f7629d-8771-4d43-9aa2-ff80157c9235" path="/var/lib/kubelet/pods/43f7629d-8771-4d43-9aa2-ff80157c9235/volumes"
Jul 24 20:02:53.094189 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.094154    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"]
Jul 24 20:02:53.094494 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.094481    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f7629d-8771-4d43-9aa2-ff80157c9235" containerName="revoke-keys"
Jul 24 20:02:53.094567 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.094495    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f7629d-8771-4d43-9aa2-ff80157c9235" containerName="revoke-keys"
Jul 24 20:02:53.094567 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.094565    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f7629d-8771-4d43-9aa2-ff80157c9235" containerName="revoke-keys"
Jul 24 20:02:53.097649 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.097633    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.100122 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.100100    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d2d8d399-openshift-default-dockercfg-fmt4w\""
Jul 24 20:02:53.109949 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.109924    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"]
Jul 24 20:02:53.129051 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129025    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-token\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129174 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129057    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-podinfo\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129174 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129102    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f7059f-8a8a-4018-b87e-223558ff8f54-istiod-ca-cert\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129174 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129139    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-credential-socket\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129295 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129173    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-certs\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129295 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129271    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-data\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129369 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129317    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-socket\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129369 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129354    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-249lw\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-kube-api-access-249lw\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.129440 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.129404    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-envoy\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.230730 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230696    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-envoy\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.230730 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230730    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-token\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230748    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-podinfo\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230815    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f7059f-8a8a-4018-b87e-223558ff8f54-istiod-ca-cert\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230833    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-credential-socket\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230864    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-certs\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230921    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-data\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230948    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-socket\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.230981    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-249lw\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-kube-api-access-249lw\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.231263    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-credential-socket\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231746 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.231346    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-certs\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231746 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.231359    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-socket\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231746 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.231436    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-data\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.231746 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.231689    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f7059f-8a8a-4018-b87e-223558ff8f54-istiod-ca-cert\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.232988 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.232967    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-envoy\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.233344 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.233326    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-podinfo\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.241793 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.241753    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-token\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.241980 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.241962    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-249lw\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-kube-api-access-249lw\") pod \"e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") " pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.407830 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.407798    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:53.543331 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.543304    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"]
Jul 24 20:02:53.545468 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:02:53.545437    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f7059f_8a8a_4018_b87e_223558ff8f54.slice/crio-b2694f5851c3a38dcb28c9cb8f514a09fcb1fb14d00229e20bb0d857e1192b90 WatchSource:0}: Error finding container b2694f5851c3a38dcb28c9cb8f514a09fcb1fb14d00229e20bb0d857e1192b90: Status 404 returned error can't find the container with id b2694f5851c3a38dcb28c9cb8f514a09fcb1fb14d00229e20bb0d857e1192b90
Jul 24 20:02:53.547599 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.547566    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:53.547692 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.547628    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:53.547692 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.547673    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:02:53.794245 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.794144    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" event={"ID":"71f7059f-8a8a-4018-b87e-223558ff8f54","Type":"ContainerStarted","Data":"86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43"}
Jul 24 20:02:53.794245 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.794215    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" event={"ID":"71f7059f-8a8a-4018-b87e-223558ff8f54","Type":"ContainerStarted","Data":"b2694f5851c3a38dcb28c9cb8f514a09fcb1fb14d00229e20bb0d857e1192b90"}
Jul 24 20:02:53.816042 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:53.815989    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" podStartSLOduration=0.815971668 podStartE2EDuration="815.971668ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:02:53.815314926 +0000 UTC m=+1713.939654082" watchObservedRunningTime="2026-07-24 20:02:53.815971668 +0000 UTC m=+1713.940310824"
Jul 24 20:02:54.408947 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:54.408909    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:54.413928 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:54.413903    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:54.799513 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:54.799418    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:54.800432 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:54.800411    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:02:57.517065 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.517038    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:57.569308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569231    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld8bh\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-kube-api-access-ld8bh\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569289    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-credential-socket\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569538 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569345    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-podinfo\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569538 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569397    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-certs\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569538 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569428    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-envoy\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569689 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569576    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-data\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569689 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569632    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-token\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569689 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569630    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:57.569689 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569650    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:57.569689 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569663    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istiod-ca-cert\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.569934 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.569700    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-socket\") pod \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\" (UID: \"5196cf5e-c7fd-4064-aa7f-27460ea0d66d\") "
Jul 24 20:02:57.570035 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.570022    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.570093 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.570041    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.570093 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.570043    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:02:57.570203 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.570140    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:57.570435 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.570411    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:57.571811 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.571745    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:02:57.571995 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.571968    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:02:57.572113 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.572086    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:02:57.572201 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.572123    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-kube-api-access-ld8bh" (OuterVolumeSpecName: "kube-api-access-ld8bh") pod "5196cf5e-c7fd-4064-aa7f-27460ea0d66d" (UID: "5196cf5e-c7fd-4064-aa7f-27460ea0d66d"). InnerVolumeSpecName "kube-api-access-ld8bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:02:57.671000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.670892    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.671000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.670940    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.671000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.670954    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.671000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.670976    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld8bh\" (UniqueName: \"kubernetes.io/projected/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-kube-api-access-ld8bh\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.676116 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.671340    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.676116 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.671362    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.676116 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.671376    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5196cf5e-c7fd-4064-aa7f-27460ea0d66d-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:02:57.816277 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.816242    2541 generic.go:356] "Generic (PLEG): container finished" podID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerID="df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5" exitCode=0
Jul 24 20:02:57.816444 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.816304    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"
Jul 24 20:02:57.816444 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.816321    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" event={"ID":"5196cf5e-c7fd-4064-aa7f-27460ea0d66d","Type":"ContainerDied","Data":"df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5"}
Jul 24 20:02:57.816444 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.816396    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78" event={"ID":"5196cf5e-c7fd-4064-aa7f-27460ea0d66d","Type":"ContainerDied","Data":"2fec72dd390f1c8641fa832bc01691b310e4d9748b0dec5d90ff9b6158d6c30d"}
Jul 24 20:02:57.816444 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.816420    2541 scope.go:117] "RemoveContainer" containerID="df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5"
Jul 24 20:02:57.826177 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.826159    2541 scope.go:117] "RemoveContainer" containerID="044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4"
Jul 24 20:02:57.837388 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.837367    2541 scope.go:117] "RemoveContainer" containerID="df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5"
Jul 24 20:02:57.837710 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:02:57.837687    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5\": container with ID starting with df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5 not found: ID does not exist" containerID="df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5"
Jul 24 20:02:57.837785 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.837721    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5"} err="failed to get container status \"df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5\": rpc error: code = NotFound desc = could not find container \"df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5\": container with ID starting with df2ce3a3ed6ca180e5c266dfdc98c201de94b12f5e0b8ab09db276d38511e6d5 not found: ID does not exist"
Jul 24 20:02:57.837785 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.837754    2541 scope.go:117] "RemoveContainer" containerID="044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4"
Jul 24 20:02:57.838221 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:02:57.838188    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4\": container with ID starting with 044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4 not found: ID does not exist" containerID="044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4"
Jul 24 20:02:57.838337 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.838226    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4"} err="failed to get container status \"044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4\": rpc error: code = NotFound desc = could not find container \"044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4\": container with ID starting with 044a52f8303d0bea40b6495787f469a6e14ae2a46a337e138e2820a784e09ab4 not found: ID does not exist"
Jul 24 20:02:57.841182 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.841160    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"]
Jul 24 20:02:57.847558 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:57.847533    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-bc219aa6-gw-openshift-default-7ff9f656c6-f7z78"]
Jul 24 20:02:58.579354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:02:58.579321    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" path="/var/lib/kubelet/pods/5196cf5e-c7fd-4064-aa7f-27460ea0d66d/volumes"
Jul 24 20:03:10.191833 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.190736    2541 patch_prober.go:28] interesting pod/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:41592->10.132.0.40:15021: read: connection reset by peer" start-of-body=
Jul 24 20:03:10.191833 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.190816    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:41592->10.132.0.40:15021: read: connection reset by peer"
Jul 24 20:03:10.889088 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.889045    2541 generic.go:356] "Generic (PLEG): container finished" podID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerID="86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43" exitCode=0
Jul 24 20:03:10.889246 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.889120    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" event={"ID":"71f7059f-8a8a-4018-b87e-223558ff8f54","Type":"ContainerDied","Data":"86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43"}
Jul 24 20:03:10.889537 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.889521    2541 scope.go:117] "RemoveContainer" containerID="86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43"
Jul 24 20:03:10.890583 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.890560    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:10.890636 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.890621    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:10.890671 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:10.890653    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:11.896241 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:11.896205    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" event={"ID":"71f7059f-8a8a-4018-b87e-223558ff8f54","Type":"ContainerStarted","Data":"933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79"}
Jul 24 20:03:12.408376 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:12.408340    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:03:12.408560 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:12.408537    2541 patch_prober.go:28] interesting pod/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 24 20:03:12.408613 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:12.408584    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 24 20:03:13.408724 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:13.408687    2541 patch_prober.go:28] interesting pod/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 24 20:03:13.409128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:13.408740    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 24 20:03:14.408962 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:14.408933    2541 patch_prober.go:28] interesting pod/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 24 20:03:14.409346 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:14.408983    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 24 20:03:15.408514 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:15.408475    2541 patch_prober.go:28] interesting pod/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 24 20:03:15.408682 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:15.408536    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 24 20:03:16.412229 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:16.412199    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:03:16.412677 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:16.412588    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:03:16.413374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:16.413355    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:03:20.965908 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.965867    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"]
Jul 24 20:03:20.966308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.966224    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy"
Jul 24 20:03:20.966308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.966236    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy"
Jul 24 20:03:20.966308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.966247    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy"
Jul 24 20:03:20.966308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.966253    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy"
Jul 24 20:03:20.966505 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.966344    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy"
Jul 24 20:03:20.966505 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.966358    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="5196cf5e-c7fd-4064-aa7f-27460ea0d66d" containerName="istio-proxy"
Jul 24 20:03:20.971324 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.971305    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"
Jul 24 20:03:20.975867 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.975292    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:03:20.975867 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.975541    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:03:20.977449 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:20.977427    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"]
Jul 24 20:03:21.071130 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.071097    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165154a1-a3d7-42ea-9935-a116b2305337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2\" (UID: \"165154a1-a3d7-42ea-9935-a116b2305337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"
Jul 24 20:03:21.171867 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.171840    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165154a1-a3d7-42ea-9935-a116b2305337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2\" (UID: \"165154a1-a3d7-42ea-9935-a116b2305337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"
Jul 24 20:03:21.172416 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.172400    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165154a1-a3d7-42ea-9935-a116b2305337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2\" (UID: \"165154a1-a3d7-42ea-9935-a116b2305337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"
Jul 24 20:03:21.284077 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.284014    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"
Jul 24 20:03:21.414167 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.414144    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"]
Jul 24 20:03:21.415582 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:03:21.415556    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165154a1_a3d7_42ea_9935_a116b2305337.slice/crio-1740fe8dde883b9c1069097ac51b1ee6829e62788e6a0ad76db8c6827b176581 WatchSource:0}: Error finding container 1740fe8dde883b9c1069097ac51b1ee6829e62788e6a0ad76db8c6827b176581: Status 404 returned error can't find the container with id 1740fe8dde883b9c1069097ac51b1ee6829e62788e6a0ad76db8c6827b176581
Jul 24 20:03:21.949292 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.949201    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2" event={"ID":"165154a1-a3d7-42ea-9935-a116b2305337","Type":"ContainerStarted","Data":"3dd70b6b0a870465ba4bbaaf56daac05a8619adf793a26c0dee798406a4266eb"}
Jul 24 20:03:21.949435 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.949296    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2" event={"ID":"165154a1-a3d7-42ea-9935-a116b2305337","Type":"ContainerStarted","Data":"1740fe8dde883b9c1069097ac51b1ee6829e62788e6a0ad76db8c6827b176581"}
Jul 24 20:03:21.968889 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:21.968841    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2" podStartSLOduration=1.968827342 podStartE2EDuration="1.968827342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:21.966747199 +0000 UTC m=+1742.091086355" watchObservedRunningTime="2026-07-24 20:03:21.968827342 +0000 UTC m=+1742.093166517"
Jul 24 20:03:22.956054 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:22.956024    2541 generic.go:356] "Generic (PLEG): container finished" podID="165154a1-a3d7-42ea-9935-a116b2305337" containerID="3dd70b6b0a870465ba4bbaaf56daac05a8619adf793a26c0dee798406a4266eb" exitCode=0
Jul 24 20:03:22.956211 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:22.956070    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2" event={"ID":"165154a1-a3d7-42ea-9935-a116b2305337","Type":"ContainerDied","Data":"3dd70b6b0a870465ba4bbaaf56daac05a8619adf793a26c0dee798406a4266eb"}
Jul 24 20:03:24.085913 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:24.085889    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"
Jul 24 20:03:24.194200 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:24.194173    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165154a1-a3d7-42ea-9935-a116b2305337-maas-api-service-ca\") pod \"165154a1-a3d7-42ea-9935-a116b2305337\" (UID: \"165154a1-a3d7-42ea-9935-a116b2305337\") "
Jul 24 20:03:24.194515 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:24.194493    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165154a1-a3d7-42ea-9935-a116b2305337-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "165154a1-a3d7-42ea-9935-a116b2305337" (UID: "165154a1-a3d7-42ea-9935-a116b2305337"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:24.295130 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:24.295061    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/165154a1-a3d7-42ea-9935-a116b2305337-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:24.968362 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:24.968323    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2" event={"ID":"165154a1-a3d7-42ea-9935-a116b2305337","Type":"ContainerDied","Data":"1740fe8dde883b9c1069097ac51b1ee6829e62788e6a0ad76db8c6827b176581"}
Jul 24 20:03:24.968362 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:24.968349    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"
Jul 24 20:03:24.968555 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:24.968387    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1740fe8dde883b9c1069097ac51b1ee6829e62788e6a0ad76db8c6827b176581"
Jul 24 20:03:36.045300 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:36.045267    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"]
Jul 24 20:03:36.047463 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:36.047443    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d2d8d399-mmvf2"]
Jul 24 20:03:36.578546 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:36.578511    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="165154a1-a3d7-42ea-9935-a116b2305337" path="/var/lib/kubelet/pods/165154a1-a3d7-42ea-9935-a116b2305337/volumes"
Jul 24 20:03:37.335085 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:37.335055    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"]
Jul 24 20:03:37.335478 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:37.335314    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy" containerID="cri-o://933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79" gracePeriod=30
Jul 24 20:03:38.036288 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.036251    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"]
Jul 24 20:03:38.036618 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.036605    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165154a1-a3d7-42ea-9935-a116b2305337" containerName="revoke-keys"
Jul 24 20:03:38.036675 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.036620    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="165154a1-a3d7-42ea-9935-a116b2305337" containerName="revoke-keys"
Jul 24 20:03:38.036710 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.036679    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="165154a1-a3d7-42ea-9935-a116b2305337" containerName="revoke-keys"
Jul 24 20:03:38.039872 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.039853    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.042387 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.042368    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ce45103c-openshift-default-dockercfg-kpvfb\""
Jul 24 20:03:38.052231 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.052212    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"]
Jul 24 20:03:38.209820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.209760    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ed214-9c2f-4c65-83f2-c61894440a50-istio-podinfo\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.209826    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-data\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.209848    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ed214-9c2f-4c65-83f2-c61894440a50-istiod-ca-cert\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.209868    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhmjr\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-kube-api-access-bhmjr\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.209944    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-certs\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.209998    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-envoy\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210213 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.210024    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-istio-token\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210213 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.210044    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-socket\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.210213 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.210114    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-credential-socket\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311119 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311034    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-envoy\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311119 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311073    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-istio-token\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311119 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311091    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-socket\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311373 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311129    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-credential-socket\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311373 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311160    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ed214-9c2f-4c65-83f2-c61894440a50-istio-podinfo\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311373 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311176    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-data\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311373 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311190    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ed214-9c2f-4c65-83f2-c61894440a50-istiod-ca-cert\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311373 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311209    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhmjr\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-kube-api-access-bhmjr\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311373 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311252    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-certs\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311669 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311590    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-socket\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311669 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311618    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-credential-socket\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311740 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311686    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-certs\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.311806 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.311746    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-data\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.312185 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.312163    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ed214-9c2f-4c65-83f2-c61894440a50-istiod-ca-cert\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.313436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.313419    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-envoy\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.313571 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.313552    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ed214-9c2f-4c65-83f2-c61894440a50-istio-podinfo\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.319573 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.319545    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-istio-token\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.320490 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.320463    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhmjr\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-kube-api-access-bhmjr\") pod \"e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") " pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.349329 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.349304    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:38.483854 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.483817    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"]
Jul 24 20:03:38.485570 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:03:38.485549    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953ed214_9c2f_4c65_83f2_c61894440a50.slice/crio-bcf64033a346a925bb8fe785c4412f11ccd87ec4c65c67231c4f1babb742ebc7 WatchSource:0}: Error finding container bcf64033a346a925bb8fe785c4412f11ccd87ec4c65c67231c4f1babb742ebc7: Status 404 returned error can't find the container with id bcf64033a346a925bb8fe785c4412f11ccd87ec4c65c67231c4f1babb742ebc7
Jul 24 20:03:38.488127 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.488094    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:38.488206 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.488161    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:38.488206 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:38.488190    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:39.042842 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:39.042805    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" event={"ID":"953ed214-9c2f-4c65-83f2-c61894440a50","Type":"ContainerStarted","Data":"d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa"}
Jul 24 20:03:39.043022 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:39.042862    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" event={"ID":"953ed214-9c2f-4c65-83f2-c61894440a50","Type":"ContainerStarted","Data":"bcf64033a346a925bb8fe785c4412f11ccd87ec4c65c67231c4f1babb742ebc7"}
Jul 24 20:03:39.065273 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:39.065226    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" podStartSLOduration=1.065211678 podStartE2EDuration="1.065211678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:39.063200297 +0000 UTC m=+1759.187539454" watchObservedRunningTime="2026-07-24 20:03:39.065211678 +0000 UTC m=+1759.189550834"
Jul 24 20:03:39.350043 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:39.349973    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:39.354663 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:39.354639    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:40.047985 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:40.047953    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:40.048751 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:40.048731    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:42.588460 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.588438    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:03:42.647167 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647142    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-certs\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.647307 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647176    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-envoy\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.647307 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647209    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-token\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.647307 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647235    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-249lw\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-kube-api-access-249lw\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.647307 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647273    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f7059f-8a8a-4018-b87e-223558ff8f54-istiod-ca-cert\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.647307 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647299    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-credential-socket\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.647577 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647328    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-data\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.647577 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647414    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:42.647679 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647589    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.647805 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647780    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:42.647882 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.647806    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f7059f-8a8a-4018-b87e-223558ff8f54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:42.648166 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.648143    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-data" (OuterVolumeSpecName: "istio-data") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:42.649415 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.649392    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-token" (OuterVolumeSpecName: "istio-token") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:42.649516 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.649493    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-kube-api-access-249lw" (OuterVolumeSpecName: "kube-api-access-249lw") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "kube-api-access-249lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:42.649706 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.649685    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:42.748361 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748330    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-podinfo\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.748549 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748412    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-socket\") pod \"71f7059f-8a8a-4018-b87e-223558ff8f54\" (UID: \"71f7059f-8a8a-4018-b87e-223558ff8f54\") "
Jul 24 20:03:42.748708 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748678    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:42.748708 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748699    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.748907 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748715    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-249lw\" (UniqueName: \"kubernetes.io/projected/71f7059f-8a8a-4018-b87e-223558ff8f54-kube-api-access-249lw\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.748907 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748727    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f7059f-8a8a-4018-b87e-223558ff8f54-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.748907 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748736    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.748907 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748745    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.748907 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.748752    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.750361 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.750340    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71f7059f-8a8a-4018-b87e-223558ff8f54" (UID: "71f7059f-8a8a-4018-b87e-223558ff8f54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:03:42.849297 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.849265    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f7059f-8a8a-4018-b87e-223558ff8f54-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:42.849297 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:42.849291    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f7059f-8a8a-4018-b87e-223558ff8f54-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:03:43.066478 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.066260    2541 generic.go:356] "Generic (PLEG): container finished" podID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerID="933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79" exitCode=0
Jul 24 20:03:43.067528 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.066379    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"
Jul 24 20:03:43.067528 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.066401    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" event={"ID":"71f7059f-8a8a-4018-b87e-223558ff8f54","Type":"ContainerDied","Data":"933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79"}
Jul 24 20:03:43.067528 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.067291    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4" event={"ID":"71f7059f-8a8a-4018-b87e-223558ff8f54","Type":"ContainerDied","Data":"b2694f5851c3a38dcb28c9cb8f514a09fcb1fb14d00229e20bb0d857e1192b90"}
Jul 24 20:03:43.067528 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.067335    2541 scope.go:117] "RemoveContainer" containerID="933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79"
Jul 24 20:03:43.077287 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.077271    2541 scope.go:117] "RemoveContainer" containerID="86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43"
Jul 24 20:03:43.085001 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.084984    2541 scope.go:117] "RemoveContainer" containerID="933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79"
Jul 24 20:03:43.085243 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:03:43.085224    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79\": container with ID starting with 933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79 not found: ID does not exist" containerID="933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79"
Jul 24 20:03:43.085283 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.085256    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79"} err="failed to get container status \"933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79\": rpc error: code = NotFound desc = could not find container \"933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79\": container with ID starting with 933832ba52868cc594a64c4cd6bfa795092c73f738a89da768950fbd6c61ec79 not found: ID does not exist"
Jul 24 20:03:43.085283 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.085272    2541 scope.go:117] "RemoveContainer" containerID="86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43"
Jul 24 20:03:43.085477 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:03:43.085459    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43\": container with ID starting with 86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43 not found: ID does not exist" containerID="86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43"
Jul 24 20:03:43.085513 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.085484    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43"} err="failed to get container status \"86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43\": rpc error: code = NotFound desc = could not find container \"86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43\": container with ID starting with 86ceb63889a6e32d042ceed4f67c8878b6567c92f719a67e014c19b03360bb43 not found: ID does not exist"
Jul 24 20:03:43.096106 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.096086    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"]
Jul 24 20:03:43.107620 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:43.104214    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d2d8d399-openshift-default-5b9fdff586-tbjc4"]
Jul 24 20:03:44.579113 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:44.579082    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" path="/var/lib/kubelet/pods/71f7059f-8a8a-4018-b87e-223558ff8f54/volumes"
Jul 24 20:03:54.124536 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:54.124503    2541 generic.go:356] "Generic (PLEG): container finished" podID="953ed214-9c2f-4c65-83f2-c61894440a50" containerID="d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa" exitCode=0
Jul 24 20:03:54.124982 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:54.124576    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" event={"ID":"953ed214-9c2f-4c65-83f2-c61894440a50","Type":"ContainerDied","Data":"d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa"}
Jul 24 20:03:54.125027 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:54.125005    2541 scope.go:117] "RemoveContainer" containerID="d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa"
Jul 24 20:03:54.125948 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:54.125924    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:54.126018 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:54.125987    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:54.126060 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:54.126017    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:03:55.048227 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:55.048184    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:55.131491 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:55.131456    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" event={"ID":"953ed214-9c2f-4c65-83f2-c61894440a50","Type":"ContainerStarted","Data":"1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1"}
Jul 24 20:03:55.350659 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:55.350551    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:55.351911 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:55.351877    2541 patch_prober.go:28] interesting pod/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 20:03:55.352046 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:55.351944    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 20:03:56.350552 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:56.350516    2541 patch_prober.go:28] interesting pod/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 20:03:56.351162 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:56.351131    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 20:03:57.350461 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:57.350422    2541 patch_prober.go:28] interesting pod/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 20:03:57.350677 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:57.350479    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 20:03:58.350468 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:58.350424    2541 patch_prober.go:28] interesting pod/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 20:03:58.350682 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:58.350509    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 20:03:59.353342 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:59.353310    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:59.353794 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:59.353577    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:03:59.354171 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:03:59.354156    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:04:05.298933 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.298900    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"]
Jul 24 20:04:05.299336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.299235    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy"
Jul 24 20:04:05.299336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.299246    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy"
Jul 24 20:04:05.299336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.299258    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy"
Jul 24 20:04:05.299336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.299264    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy"
Jul 24 20:04:05.299336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.299311    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy"
Jul 24 20:04:05.302674 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.302655    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"
Jul 24 20:04:05.305246 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.305220    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:04:05.305368 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.305293    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:04:05.308051 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.308013    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d433e58-ef3e-456d-8de2-37d5783e6166-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr\" (UID: \"7d433e58-ef3e-456d-8de2-37d5783e6166\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"
Jul 24 20:04:05.309498 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.309465    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"]
Jul 24 20:04:05.408641 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.408617    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d433e58-ef3e-456d-8de2-37d5783e6166-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr\" (UID: \"7d433e58-ef3e-456d-8de2-37d5783e6166\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"
Jul 24 20:04:05.409186 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.409166    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d433e58-ef3e-456d-8de2-37d5783e6166-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr\" (UID: \"7d433e58-ef3e-456d-8de2-37d5783e6166\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"
Jul 24 20:04:05.614262 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.614199    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"
Jul 24 20:04:05.743982 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:05.743954    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"]
Jul 24 20:04:05.746649 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:04:05.746621    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d433e58_ef3e_456d_8de2_37d5783e6166.slice/crio-64733e871f783b2e42b29733d100ff90e849910dc9da0209e74e88be1f62c38d WatchSource:0}: Error finding container 64733e871f783b2e42b29733d100ff90e849910dc9da0209e74e88be1f62c38d: Status 404 returned error can't find the container with id 64733e871f783b2e42b29733d100ff90e849910dc9da0209e74e88be1f62c38d
Jul 24 20:04:06.196967 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:06.196932    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr" event={"ID":"7d433e58-ef3e-456d-8de2-37d5783e6166","Type":"ContainerStarted","Data":"6031ecc9f7e3990663d68f5703faa491b9012149c0d8974be348ff9ae9c27104"}
Jul 24 20:04:06.197111 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:06.196994    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr" event={"ID":"7d433e58-ef3e-456d-8de2-37d5783e6166","Type":"ContainerStarted","Data":"64733e871f783b2e42b29733d100ff90e849910dc9da0209e74e88be1f62c38d"}
Jul 24 20:04:06.212590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:06.212512    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr" podStartSLOduration=1.212497269 podStartE2EDuration="1.212497269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:04:06.210954308 +0000 UTC m=+1786.335293464" watchObservedRunningTime="2026-07-24 20:04:06.212497269 +0000 UTC m=+1786.336836419"
Jul 24 20:04:07.204067 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:07.204030    2541 generic.go:356] "Generic (PLEG): container finished" podID="7d433e58-ef3e-456d-8de2-37d5783e6166" containerID="6031ecc9f7e3990663d68f5703faa491b9012149c0d8974be348ff9ae9c27104" exitCode=0
Jul 24 20:04:07.204506 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:07.204117    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr" event={"ID":"7d433e58-ef3e-456d-8de2-37d5783e6166","Type":"ContainerDied","Data":"6031ecc9f7e3990663d68f5703faa491b9012149c0d8974be348ff9ae9c27104"}
Jul 24 20:04:08.337623 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:08.337600    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"
Jul 24 20:04:08.430819 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:08.430788    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d433e58-ef3e-456d-8de2-37d5783e6166-maas-api-service-ca\") pod \"7d433e58-ef3e-456d-8de2-37d5783e6166\" (UID: \"7d433e58-ef3e-456d-8de2-37d5783e6166\") "
Jul 24 20:04:08.431110 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:08.431088    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d433e58-ef3e-456d-8de2-37d5783e6166-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d433e58-ef3e-456d-8de2-37d5783e6166" (UID: "7d433e58-ef3e-456d-8de2-37d5783e6166"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:08.531855 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:08.531792    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d433e58-ef3e-456d-8de2-37d5783e6166-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:09.216859 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:09.216830    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr" event={"ID":"7d433e58-ef3e-456d-8de2-37d5783e6166","Type":"ContainerDied","Data":"64733e871f783b2e42b29733d100ff90e849910dc9da0209e74e88be1f62c38d"}
Jul 24 20:04:09.216859 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:09.216857    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"
Jul 24 20:04:09.217079 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:09.216882    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64733e871f783b2e42b29733d100ff90e849910dc9da0209e74e88be1f62c38d"
Jul 24 20:04:20.377816 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:20.377548    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"]
Jul 24 20:04:20.379644 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:20.379620    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ce45103c-zkqmr"]
Jul 24 20:04:20.507325 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:20.507290    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"]
Jul 24 20:04:20.507525 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:20.507488    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy" containerID="cri-o://1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1" gracePeriod=30
Jul 24 20:04:20.578589 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:20.578564    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d433e58-ef3e-456d-8de2-37d5783e6166" path="/var/lib/kubelet/pods/7d433e58-ef3e-456d-8de2-37d5783e6166/volumes"
Jul 24 20:04:25.754854 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.754831    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:04:25.869596 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869529    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-credential-socket\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.869596 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869561    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ed214-9c2f-4c65-83f2-c61894440a50-istiod-ca-cert\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.869596 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869592    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-socket\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.869897 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869610    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-data\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.869897 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869713    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ed214-9c2f-4c65-83f2-c61894440a50-istio-podinfo\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.869897 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869756    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhmjr\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-kube-api-access-bhmjr\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.869897 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869821    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:25.869897 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869862    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-istio-token\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.869897 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869900    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-certs\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.870200 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869927    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-envoy\") pod \"953ed214-9c2f-4c65-83f2-c61894440a50\" (UID: \"953ed214-9c2f-4c65-83f2-c61894440a50\") "
Jul 24 20:04:25.870200 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.869974    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:25.870200 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.870050    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953ed214-9c2f-4c65-83f2-c61894440a50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:25.870355 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.870268    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:25.870422 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.870394    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.870422 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.870417    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.870523 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.870432    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ed214-9c2f-4c65-83f2-c61894440a50-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.870523 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.870447    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.870634 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.870575    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-data" (OuterVolumeSpecName: "istio-data") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:25.872015 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.871981    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-istio-token" (OuterVolumeSpecName: "istio-token") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:25.872015 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.872002    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/953ed214-9c2f-4c65-83f2-c61894440a50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:04:25.872145 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.872033    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-kube-api-access-bhmjr" (OuterVolumeSpecName: "kube-api-access-bhmjr") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "kube-api-access-bhmjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:25.872145 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.872043    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "953ed214-9c2f-4c65-83f2-c61894440a50" (UID: "953ed214-9c2f-4c65-83f2-c61894440a50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:04:25.971742 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.971717    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ed214-9c2f-4c65-83f2-c61894440a50-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.971742 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.971740    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhmjr\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-kube-api-access-bhmjr\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.971891 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.971750    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ed214-9c2f-4c65-83f2-c61894440a50-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.971891 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.971758    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:25.971891 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:25.971786    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ed214-9c2f-4c65-83f2-c61894440a50-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:04:26.304661 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.304634    2541 generic.go:356] "Generic (PLEG): container finished" podID="953ed214-9c2f-4c65-83f2-c61894440a50" containerID="1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1" exitCode=0
Jul 24 20:04:26.304843 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.304686    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"
Jul 24 20:04:26.304843 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.304712    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" event={"ID":"953ed214-9c2f-4c65-83f2-c61894440a50","Type":"ContainerDied","Data":"1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1"}
Jul 24 20:04:26.304843 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.304762    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5" event={"ID":"953ed214-9c2f-4c65-83f2-c61894440a50","Type":"ContainerDied","Data":"bcf64033a346a925bb8fe785c4412f11ccd87ec4c65c67231c4f1babb742ebc7"}
Jul 24 20:04:26.304843 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.304786    2541 scope.go:117] "RemoveContainer" containerID="1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1"
Jul 24 20:04:26.313581 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.313563    2541 scope.go:117] "RemoveContainer" containerID="d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa"
Jul 24 20:04:26.321041 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.321022    2541 scope.go:117] "RemoveContainer" containerID="1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1"
Jul 24 20:04:26.321297 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:04:26.321278    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1\": container with ID starting with 1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1 not found: ID does not exist" containerID="1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1"
Jul 24 20:04:26.321365 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.321308    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1"} err="failed to get container status \"1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1\": rpc error: code = NotFound desc = could not find container \"1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1\": container with ID starting with 1063dc53a516bf6e5bf60032b58a5987d5bcd93684af967f0ade2288f4f24db1 not found: ID does not exist"
Jul 24 20:04:26.321365 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.321333    2541 scope.go:117] "RemoveContainer" containerID="d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa"
Jul 24 20:04:26.321580 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:04:26.321565    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa\": container with ID starting with d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa not found: ID does not exist" containerID="d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa"
Jul 24 20:04:26.321621 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.321585    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa"} err="failed to get container status \"d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa\": rpc error: code = NotFound desc = could not find container \"d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa\": container with ID starting with d3101f292ec46658fe59652712a72a0185fabd4b2241f98baf0327e84eda0ffa not found: ID does not exist"
Jul 24 20:04:26.326475 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.326450    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"]
Jul 24 20:04:26.330204 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.330184    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ce45103c-openshift-default-5fc5b486fb-fwcc5"]
Jul 24 20:04:26.579909 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:04:26.579839    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" path="/var/lib/kubelet/pods/953ed214-9c2f-4c65-83f2-c61894440a50/volumes"
Jul 24 20:05:59.416966 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.416935    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"]
Jul 24 20:05:59.417436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.417243    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy"
Jul 24 20:05:59.417436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.417254    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy"
Jul 24 20:05:59.417436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.417268    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d433e58-ef3e-456d-8de2-37d5783e6166" containerName="revoke-keys"
Jul 24 20:05:59.417436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.417274    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d433e58-ef3e-456d-8de2-37d5783e6166" containerName="revoke-keys"
Jul 24 20:05:59.417436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.417329    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy"
Jul 24 20:05:59.417436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.417338    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f7059f-8a8a-4018-b87e-223558ff8f54" containerName="istio-proxy"
Jul 24 20:05:59.417436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.417346    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d433e58-ef3e-456d-8de2-37d5783e6166" containerName="revoke-keys"
Jul 24 20:05:59.420281 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.420263    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.422863 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.422845    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c86ab55b-openshift-default-dockercfg-dnpvt\""
Jul 24 20:05:59.441195 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.441172    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"]
Jul 24 20:05:59.571934 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.571902    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-envoy\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.571934 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.571937    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kth\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-kube-api-access-87kth\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.572134 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.571961    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-data\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.572134 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.572004    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-certs\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.572134 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.572026    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bd9eec-d5f1-4821-a082-405c345ff172-istio-podinfo\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.572134 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.572040    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bd9eec-d5f1-4821-a082-405c345ff172-istiod-ca-cert\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.572134 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.572126    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-istio-token\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.572298 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.572183    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-socket\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.572298 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.572211    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-credential-socket\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.672929 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.672859    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-socket\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.672929 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.672894    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-credential-socket\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.672929 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.672923    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-envoy\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673193 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.672938    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87kth\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-kube-api-access-87kth\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673193 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.672955    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-data\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673193 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.672974    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-certs\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673193 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673002    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bd9eec-d5f1-4821-a082-405c345ff172-istio-podinfo\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673193 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673025    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bd9eec-d5f1-4821-a082-405c345ff172-istiod-ca-cert\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673193 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673059    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-istio-token\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673476 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673327    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-credential-socket\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673476 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673363    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-socket\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673476 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673413    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-data\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673634 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673557    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-certs\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.673787 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.673746    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bd9eec-d5f1-4821-a082-405c345ff172-istiod-ca-cert\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.675174 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.675125    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-envoy\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.675399 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.675382    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bd9eec-d5f1-4821-a082-405c345ff172-istio-podinfo\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.690600 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.690574    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-istio-token\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.690857 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.690839    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87kth\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-kube-api-access-87kth\") pod \"e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") " pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.730398 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.730376    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:05:59.866242 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.866221    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"]
Jul 24 20:05:59.867744 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:05:59.867721    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bd9eec_d5f1_4821_a082_405c345ff172.slice/crio-cc66d812286eec0d25b8b204a03d8a0301fe92bfae9753c0884a1d8d0c116ace WatchSource:0}: Error finding container cc66d812286eec0d25b8b204a03d8a0301fe92bfae9753c0884a1d8d0c116ace: Status 404 returned error can't find the container with id cc66d812286eec0d25b8b204a03d8a0301fe92bfae9753c0884a1d8d0c116ace
Jul 24 20:05:59.869751 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.869719    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:05:59.869830 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.869813    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:05:59.869874 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:05:59.869846    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:06:00.771870 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:00.771839    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" event={"ID":"35bd9eec-d5f1-4821-a082-405c345ff172","Type":"ContainerStarted","Data":"a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864"}
Jul 24 20:06:00.772219 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:00.771888    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" event={"ID":"35bd9eec-d5f1-4821-a082-405c345ff172","Type":"ContainerStarted","Data":"cc66d812286eec0d25b8b204a03d8a0301fe92bfae9753c0884a1d8d0c116ace"}
Jul 24 20:06:00.792959 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:00.792917    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" podStartSLOduration=1.7929013070000002 podStartE2EDuration="1.792901307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:05:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:06:00.791007131 +0000 UTC m=+1900.915346310" watchObservedRunningTime="2026-07-24 20:06:00.792901307 +0000 UTC m=+1900.917240520"
Jul 24 20:06:01.730562 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:01.730525    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:01.735613 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:01.735589    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:01.777584 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:01.777556    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:01.778207 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:01.778190    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:14.161119 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.161080    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"]
Jul 24 20:06:14.161645 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.161618    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy"
Jul 24 20:06:14.161842 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.161820    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy"
Jul 24 20:06:14.161968 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.161944    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="953ed214-9c2f-4c65-83f2-c61894440a50" containerName="istio-proxy"
Jul 24 20:06:14.165317 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.165298    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"
Jul 24 20:06:14.168242 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.168084    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:06:14.168242 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.168093    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:06:14.169722 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.169666    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"]
Jul 24 20:06:14.299083 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.299055    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8737c1c7-d6b5-4cde-b50a-6f6f7533de82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl\" (UID: \"8737c1c7-d6b5-4cde-b50a-6f6f7533de82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"
Jul 24 20:06:14.400189 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.400152    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8737c1c7-d6b5-4cde-b50a-6f6f7533de82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl\" (UID: \"8737c1c7-d6b5-4cde-b50a-6f6f7533de82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"
Jul 24 20:06:14.400760 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.400741    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8737c1c7-d6b5-4cde-b50a-6f6f7533de82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl\" (UID: \"8737c1c7-d6b5-4cde-b50a-6f6f7533de82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"
Jul 24 20:06:14.476815 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.476727    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"
Jul 24 20:06:14.624591 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.624564    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"]
Jul 24 20:06:14.626517 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:06:14.626488    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8737c1c7_d6b5_4cde_b50a_6f6f7533de82.slice/crio-0efd3e9c7dae58ddcf9996106f8f95d2e801f7d8c62dcc23c0a8a1a9ec82065d WatchSource:0}: Error finding container 0efd3e9c7dae58ddcf9996106f8f95d2e801f7d8c62dcc23c0a8a1a9ec82065d: Status 404 returned error can't find the container with id 0efd3e9c7dae58ddcf9996106f8f95d2e801f7d8c62dcc23c0a8a1a9ec82065d
Jul 24 20:06:14.857799 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:14.857747    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl" event={"ID":"8737c1c7-d6b5-4cde-b50a-6f6f7533de82","Type":"ContainerStarted","Data":"0efd3e9c7dae58ddcf9996106f8f95d2e801f7d8c62dcc23c0a8a1a9ec82065d"}
Jul 24 20:06:15.865177 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:15.865134    2541 generic.go:356] "Generic (PLEG): container finished" podID="8737c1c7-d6b5-4cde-b50a-6f6f7533de82" containerID="73cf16312c877bc65cbafb7b230d07171c4d6d2d1c66b80d7ccb5d6853805a40" exitCode=0
Jul 24 20:06:15.865575 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:15.865217    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl" event={"ID":"8737c1c7-d6b5-4cde-b50a-6f6f7533de82","Type":"ContainerDied","Data":"73cf16312c877bc65cbafb7b230d07171c4d6d2d1c66b80d7ccb5d6853805a40"}
Jul 24 20:06:17.004247 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.004223    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"
Jul 24 20:06:17.121994 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.121918    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8737c1c7-d6b5-4cde-b50a-6f6f7533de82-maas-api-service-ca\") pod \"8737c1c7-d6b5-4cde-b50a-6f6f7533de82\" (UID: \"8737c1c7-d6b5-4cde-b50a-6f6f7533de82\") "
Jul 24 20:06:17.122264 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.122237    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8737c1c7-d6b5-4cde-b50a-6f6f7533de82-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8737c1c7-d6b5-4cde-b50a-6f6f7533de82" (UID: "8737c1c7-d6b5-4cde-b50a-6f6f7533de82"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:06:17.223371 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.223335    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8737c1c7-d6b5-4cde-b50a-6f6f7533de82-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:17.709486 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.708611    2541 patch_prober.go:28] interesting pod/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:44892->10.132.0.44:15021: read: connection reset by peer" start-of-body=
Jul 24 20:06:17.709486 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.708675    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:44892->10.132.0.44:15021: read: connection reset by peer"
Jul 24 20:06:17.876877 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.876813    2541 generic.go:356] "Generic (PLEG): container finished" podID="35bd9eec-d5f1-4821-a082-405c345ff172" containerID="a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864" exitCode=0
Jul 24 20:06:17.877005 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.876884    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" event={"ID":"35bd9eec-d5f1-4821-a082-405c345ff172","Type":"ContainerDied","Data":"a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864"}
Jul 24 20:06:17.877333 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.877313    2541 scope.go:117] "RemoveContainer" containerID="a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864"
Jul 24 20:06:17.878250 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.878229    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl" event={"ID":"8737c1c7-d6b5-4cde-b50a-6f6f7533de82","Type":"ContainerDied","Data":"0efd3e9c7dae58ddcf9996106f8f95d2e801f7d8c62dcc23c0a8a1a9ec82065d"}
Jul 24 20:06:17.878343 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.878250    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"
Jul 24 20:06:17.878343 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.878268    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0efd3e9c7dae58ddcf9996106f8f95d2e801f7d8c62dcc23c0a8a1a9ec82065d"
Jul 24 20:06:17.878463 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.878357    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:06:17.878463 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.878438    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:06:17.878609 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:17.878486    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:06:18.884833 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:18.884803    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" event={"ID":"35bd9eec-d5f1-4821-a082-405c345ff172","Type":"ContainerStarted","Data":"a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6"}
Jul 24 20:06:19.731528 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:19.731492    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:19.731737 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:19.731714    2541 patch_prober.go:28] interesting pod/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 24 20:06:19.731807 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:19.731785    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 24 20:06:20.731022 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:20.730989    2541 patch_prober.go:28] interesting pod/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 24 20:06:20.731410 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:20.731038    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 24 20:06:21.731329 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:21.731293    2541 patch_prober.go:28] interesting pod/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 24 20:06:21.731738 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:21.731357    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 24 20:06:22.734172 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:22.734143    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:22.734575 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:22.734525    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:22.735121 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:22.735104    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:29.235801 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:29.235748    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"]
Jul 24 20:06:29.237850 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:29.237829    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c86ab55b-5w5cl"]
Jul 24 20:06:30.578865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:30.578831    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8737c1c7-d6b5-4cde-b50a-6f6f7533de82" path="/var/lib/kubelet/pods/8737c1c7-d6b5-4cde-b50a-6f6f7533de82/volumes"
Jul 24 20:06:35.542018 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:35.541990    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"]
Jul 24 20:06:35.542436 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:35.542203    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy" containerID="cri-o://a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6" gracePeriod=30
Jul 24 20:06:37.736382 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:37.736349    2541 patch_prober.go:28] interesting pod/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 24 20:06:37.736761 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:37.736407    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:06:40.793577 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.793553    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:40.909439 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909417    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-istio-token\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909465    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-certs\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909485    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-envoy\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909522    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bd9eec-d5f1-4821-a082-405c345ff172-istio-podinfo\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909538    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-socket\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909563    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-credential-socket\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909586    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87kth\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-kube-api-access-87kth\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909931 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909648    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bd9eec-d5f1-4821-a082-405c345ff172-istiod-ca-cert\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909931 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909686    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-data\") pod \"35bd9eec-d5f1-4821-a082-405c345ff172\" (UID: \"35bd9eec-d5f1-4821-a082-405c345ff172\") "
Jul 24 20:06:40.909931 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909724    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:06:40.909931 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.909874    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:06:40.910150 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.910025    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:40.910150 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.910044    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:40.910150 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.910086    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35bd9eec-d5f1-4821-a082-405c345ff172-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:06:40.910295 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.910181    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:06:40.910796 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.910758    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-data" (OuterVolumeSpecName: "istio-data") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:06:40.911707 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.911686    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-istio-token" (OuterVolumeSpecName: "istio-token") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:06:40.911798 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.911747    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:06:40.912068 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.912042    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35bd9eec-d5f1-4821-a082-405c345ff172-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:06:40.912068 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.912053    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-kube-api-access-87kth" (OuterVolumeSpecName: "kube-api-access-87kth") pod "35bd9eec-d5f1-4821-a082-405c345ff172" (UID: "35bd9eec-d5f1-4821-a082-405c345ff172"). InnerVolumeSpecName "kube-api-access-87kth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:06:40.995924 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.995898    2541 generic.go:356] "Generic (PLEG): container finished" podID="35bd9eec-d5f1-4821-a082-405c345ff172" containerID="a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6" exitCode=0
Jul 24 20:06:40.996066 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.995962    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"
Jul 24 20:06:40.996066 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.995986    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" event={"ID":"35bd9eec-d5f1-4821-a082-405c345ff172","Type":"ContainerDied","Data":"a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6"}
Jul 24 20:06:40.996186 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.996074    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht" event={"ID":"35bd9eec-d5f1-4821-a082-405c345ff172","Type":"ContainerDied","Data":"cc66d812286eec0d25b8b204a03d8a0301fe92bfae9753c0884a1d8d0c116ace"}
Jul 24 20:06:40.996186 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:40.996107    2541 scope.go:117] "RemoveContainer" containerID="a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6"
Jul 24 20:06:41.004740 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.004720    2541 scope.go:117] "RemoveContainer" containerID="a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864"
Jul 24 20:06:41.011154 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.011136    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bd9eec-d5f1-4821-a082-405c345ff172-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:41.011232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.011155    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:41.011232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.011167    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87kth\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-kube-api-access-87kth\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:41.011232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.011193    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bd9eec-d5f1-4821-a082-405c345ff172-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:41.011232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.011202    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:41.011232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.011209    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bd9eec-d5f1-4821-a082-405c345ff172-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:41.011232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.011216    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bd9eec-d5f1-4821-a082-405c345ff172-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:06:41.012230 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.012212    2541 scope.go:117] "RemoveContainer" containerID="a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6"
Jul 24 20:06:41.012481 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:06:41.012462    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6\": container with ID starting with a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6 not found: ID does not exist" containerID="a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6"
Jul 24 20:06:41.012564 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.012492    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6"} err="failed to get container status \"a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6\": rpc error: code = NotFound desc = could not find container \"a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6\": container with ID starting with a8e5f2c1d005d24eea211176581cbf87b181a01d2a95985671f8cd7ec60b33f6 not found: ID does not exist"
Jul 24 20:06:41.012564 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.012515    2541 scope.go:117] "RemoveContainer" containerID="a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864"
Jul 24 20:06:41.012747 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:06:41.012731    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864\": container with ID starting with a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864 not found: ID does not exist" containerID="a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864"
Jul 24 20:06:41.012815 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.012752    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864"} err="failed to get container status \"a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864\": rpc error: code = NotFound desc = could not find container \"a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864\": container with ID starting with a9858dd46d750a737f40da73d71eb505906bbbbfa81cbe897235d21ca6802864 not found: ID does not exist"
Jul 24 20:06:41.018776 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.018746    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"]
Jul 24 20:06:41.022389 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:41.022368    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c86ab55b-openshift-default-6c78d887b-jgvht"]
Jul 24 20:06:42.579308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:42.579277    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" path="/var/lib/kubelet/pods/35bd9eec-d5f1-4821-a082-405c345ff172/volumes"
Jul 24 20:06:54.782211 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782175    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"]
Jul 24 20:06:54.782675 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782659    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy"
Jul 24 20:06:54.782719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782678    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy"
Jul 24 20:06:54.782719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782697    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy"
Jul 24 20:06:54.782719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782706    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy"
Jul 24 20:06:54.782719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782716    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8737c1c7-d6b5-4cde-b50a-6f6f7533de82" containerName="revoke-keys"
Jul 24 20:06:54.782909 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782725    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="8737c1c7-d6b5-4cde-b50a-6f6f7533de82" containerName="revoke-keys"
Jul 24 20:06:54.782909 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782817    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="8737c1c7-d6b5-4cde-b50a-6f6f7533de82" containerName="revoke-keys"
Jul 24 20:06:54.782909 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782828    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy"
Jul 24 20:06:54.782909 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.782840    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="35bd9eec-d5f1-4821-a082-405c345ff172" containerName="istio-proxy"
Jul 24 20:06:54.789120 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.789090    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.792570 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.792546    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-74e2adbb-openshift-default-dockercfg-mrd6l\""
Jul 24 20:06:54.797963 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.797943    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"]
Jul 24 20:06:54.917244 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917210    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-podinfo\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917259    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-certs\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917290    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7plm4\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-kube-api-access-7plm4\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917313    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-envoy\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917334    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-data\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917585 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917412    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-credential-socket\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917585 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917440    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-token\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917585 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917455    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a9ac5-8a9f-48a8-9024-a9115c35a266-istiod-ca-cert\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:54.917585 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:54.917515    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-socket\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018411 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018377    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-certs\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018411 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018415    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7plm4\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-kube-api-access-7plm4\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018436    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-envoy\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018456    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-data\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018495    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-credential-socket\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018516    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-token\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018660    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a9ac5-8a9f-48a8-9024-a9115c35a266-istiod-ca-cert\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018980 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018800    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-socket\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018980 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018846    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-podinfo\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018980 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018866    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-certs\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018980 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018897    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-credential-socket\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.018980 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.018911    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-data\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.019249 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.019135    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-socket\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.019433 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.019416    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a9ac5-8a9f-48a8-9024-a9115c35a266-istiod-ca-cert\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.020698 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.020679    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-envoy\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.021152 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.021132    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-podinfo\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.027320 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.027298    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-token\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.027505 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.027485    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7plm4\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-kube-api-access-7plm4\") pod \"e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") " pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.100468 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.100402    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:55.233517 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.233491    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"]
Jul 24 20:06:55.235382 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:06:55.235353    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416a9ac5_8a9f_48a8_9024_a9115c35a266.slice/crio-e4a9eb2cc93617278640b2ab060e2e7f05390d3402ed419e869f4d58882a96d2 WatchSource:0}: Error finding container e4a9eb2cc93617278640b2ab060e2e7f05390d3402ed419e869f4d58882a96d2: Status 404 returned error can't find the container with id e4a9eb2cc93617278640b2ab060e2e7f05390d3402ed419e869f4d58882a96d2
Jul 24 20:06:55.237484 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.237454    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:06:55.237575 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.237524    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:06:55.237575 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:55.237568    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:06:56.072892 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:56.072858    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" event={"ID":"416a9ac5-8a9f-48a8-9024-a9115c35a266","Type":"ContainerStarted","Data":"4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5"}
Jul 24 20:06:56.073365 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:56.072906    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" event={"ID":"416a9ac5-8a9f-48a8-9024-a9115c35a266","Type":"ContainerStarted","Data":"e4a9eb2cc93617278640b2ab060e2e7f05390d3402ed419e869f4d58882a96d2"}
Jul 24 20:06:56.094670 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:56.094626    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" podStartSLOduration=2.09461099 podStartE2EDuration="2.09461099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:06:56.092467532 +0000 UTC m=+1956.216806689" watchObservedRunningTime="2026-07-24 20:06:56.09461099 +0000 UTC m=+1956.218950448"
Jul 24 20:06:56.101564 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:56.101542    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:56.106251 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:56.106231    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:57.078078 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:57.078040    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:06:57.078843 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:06:57.078821    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:07:11.152538 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:11.152512    2541 generic.go:356] "Generic (PLEG): container finished" podID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerID="4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5" exitCode=0
Jul 24 20:07:11.152872 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:11.152547    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" event={"ID":"416a9ac5-8a9f-48a8-9024-a9115c35a266","Type":"ContainerDied","Data":"4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5"}
Jul 24 20:07:11.152949 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:11.152935    2541 scope.go:117] "RemoveContainer" containerID="4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5"
Jul 24 20:07:11.153871 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:11.153844    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:07:11.153927 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:11.153909    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:07:11.153971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:11.153942    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:07:12.078943 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:12.078906    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:07:12.162136 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:12.162098    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" event={"ID":"416a9ac5-8a9f-48a8-9024-a9115c35a266","Type":"ContainerStarted","Data":"d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554"}
Jul 24 20:07:13.101372 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:13.101329    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:07:13.102489 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:13.102461    2541 patch_prober.go:28] interesting pod/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 24 20:07:13.102629 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:13.102533    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 24 20:07:14.101047 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:14.101006    2541 patch_prober.go:28] interesting pod/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 24 20:07:14.101484 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:14.101076    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 24 20:07:15.101346 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:15.101303    2541 patch_prober.go:28] interesting pod/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 24 20:07:15.101760 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:15.101372    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 24 20:07:16.101053 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:16.101013    2541 patch_prober.go:28] interesting pod/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 24 20:07:16.101258 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:16.101083    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 24 20:07:17.105091 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:17.105061    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:07:17.105588 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:17.105387    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:07:17.105989 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:17.105971    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:07:57.322668 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.322634    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"]
Jul 24 20:07:57.325859 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.325835    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"
Jul 24 20:07:57.328189 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.328166    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:07:57.328316 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.328300    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:07:57.333437 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.333410    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"]
Jul 24 20:07:57.421674 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.421648    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72872dca-3e7c-4166-a2f3-948eb7362680-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq\" (UID: \"72872dca-3e7c-4166-a2f3-948eb7362680\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"
Jul 24 20:07:57.523042 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.523014    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72872dca-3e7c-4166-a2f3-948eb7362680-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq\" (UID: \"72872dca-3e7c-4166-a2f3-948eb7362680\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"
Jul 24 20:07:57.523595 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.523576    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72872dca-3e7c-4166-a2f3-948eb7362680-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq\" (UID: \"72872dca-3e7c-4166-a2f3-948eb7362680\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"
Jul 24 20:07:57.636862 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.636841    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"
Jul 24 20:07:57.765579 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:57.765552    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"]
Jul 24 20:07:57.767149 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:07:57.767118    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72872dca_3e7c_4166_a2f3_948eb7362680.slice/crio-5804189af7b83d7d8af0a81ca806f697039ce5a2a18f1a6a2c97627632c34d1d WatchSource:0}: Error finding container 5804189af7b83d7d8af0a81ca806f697039ce5a2a18f1a6a2c97627632c34d1d: Status 404 returned error can't find the container with id 5804189af7b83d7d8af0a81ca806f697039ce5a2a18f1a6a2c97627632c34d1d
Jul 24 20:07:58.397168 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:58.397139    2541 generic.go:356] "Generic (PLEG): container finished" podID="72872dca-3e7c-4166-a2f3-948eb7362680" containerID="bdc66043f77f7687ac4e1c9e189b04fc1434ddc28d85a268d3cd5ca880d8bcb3" exitCode=0
Jul 24 20:07:58.397506 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:58.397226    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq" event={"ID":"72872dca-3e7c-4166-a2f3-948eb7362680","Type":"ContainerDied","Data":"bdc66043f77f7687ac4e1c9e189b04fc1434ddc28d85a268d3cd5ca880d8bcb3"}
Jul 24 20:07:58.397506 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:58.397309    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq" event={"ID":"72872dca-3e7c-4166-a2f3-948eb7362680","Type":"ContainerStarted","Data":"5804189af7b83d7d8af0a81ca806f697039ce5a2a18f1a6a2c97627632c34d1d"}
Jul 24 20:07:59.528175 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:59.528152    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"
Jul 24 20:07:59.640991 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:59.640961    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72872dca-3e7c-4166-a2f3-948eb7362680-maas-api-service-ca\") pod \"72872dca-3e7c-4166-a2f3-948eb7362680\" (UID: \"72872dca-3e7c-4166-a2f3-948eb7362680\") "
Jul 24 20:07:59.641288 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:59.641266    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72872dca-3e7c-4166-a2f3-948eb7362680-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72872dca-3e7c-4166-a2f3-948eb7362680" (UID: "72872dca-3e7c-4166-a2f3-948eb7362680"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:07:59.742518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:07:59.742449    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72872dca-3e7c-4166-a2f3-948eb7362680-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:08:00.408738 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:08:00.408708    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"
Jul 24 20:08:00.408919 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:08:00.408747    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq" event={"ID":"72872dca-3e7c-4166-a2f3-948eb7362680","Type":"ContainerDied","Data":"5804189af7b83d7d8af0a81ca806f697039ce5a2a18f1a6a2c97627632c34d1d"}
Jul 24 20:08:00.408919 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:08:00.408800    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5804189af7b83d7d8af0a81ca806f697039ce5a2a18f1a6a2c97627632c34d1d"
Jul 24 20:08:17.404549 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:08:17.404506    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"]
Jul 24 20:08:17.406305 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:08:17.406281    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-74e2adbb-4mftq"]
Jul 24 20:08:18.578363 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:08:18.578322    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72872dca-3e7c-4166-a2f3-948eb7362680" path="/var/lib/kubelet/pods/72872dca-3e7c-4166-a2f3-948eb7362680/volumes"
Jul 24 20:08:20.686979 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:08:20.686951    2541 scope.go:117] "RemoveContainer" containerID="c2ee49433d37a290b6c5943816a6425be7816e9a102e7f519cbd20314365d524"
Jul 24 20:09:08.521737 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:08.521699    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"]
Jul 24 20:09:08.522328 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:08.521971    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy" containerID="cri-o://d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554" gracePeriod=30
Jul 24 20:09:13.771240 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.771217    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:09:13.782482 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.782423    2541 generic.go:356] "Generic (PLEG): container finished" podID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerID="d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554" exitCode=0
Jul 24 20:09:13.782482 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.782465    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"
Jul 24 20:09:13.782640 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.782500    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" event={"ID":"416a9ac5-8a9f-48a8-9024-a9115c35a266","Type":"ContainerDied","Data":"d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554"}
Jul 24 20:09:13.782640 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.782556    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp" event={"ID":"416a9ac5-8a9f-48a8-9024-a9115c35a266","Type":"ContainerDied","Data":"e4a9eb2cc93617278640b2ab060e2e7f05390d3402ed419e869f4d58882a96d2"}
Jul 24 20:09:13.782640 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.782582    2541 scope.go:117] "RemoveContainer" containerID="d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554"
Jul 24 20:09:13.790625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.790611    2541 scope.go:117] "RemoveContainer" containerID="4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5"
Jul 24 20:09:13.799222 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.799197    2541 scope.go:117] "RemoveContainer" containerID="d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554"
Jul 24 20:09:13.799511 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:09:13.799483    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554\": container with ID starting with d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554 not found: ID does not exist" containerID="d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554"
Jul 24 20:09:13.799630 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.799522    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554"} err="failed to get container status \"d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554\": rpc error: code = NotFound desc = could not find container \"d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554\": container with ID starting with d5dd4695c45c8ec12df8f311a3a2314f44c70e507f8a39676ae51f8b82ab0554 not found: ID does not exist"
Jul 24 20:09:13.799630 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.799546    2541 scope.go:117] "RemoveContainer" containerID="4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5"
Jul 24 20:09:13.799893 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:09:13.799865    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5\": container with ID starting with 4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5 not found: ID does not exist" containerID="4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5"
Jul 24 20:09:13.799971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.799902    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5"} err="failed to get container status \"4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5\": rpc error: code = NotFound desc = could not find container \"4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5\": container with ID starting with 4a9bd8acc61c23dad120b808bc8c131db89dc31180c4d3c07289ed5d087ba1f5 not found: ID does not exist"
Jul 24 20:09:13.911572 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911543    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-podinfo\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.911837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911596    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7plm4\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-kube-api-access-7plm4\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.911837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911617    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-data\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.911837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911636    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-certs\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.911837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911669    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-socket\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.911837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911689    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a9ac5-8a9f-48a8-9024-a9115c35a266-istiod-ca-cert\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.911837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911735    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-credential-socket\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.911837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911793    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-envoy\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.912218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911853    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-token\") pod \"416a9ac5-8a9f-48a8-9024-a9115c35a266\" (UID: \"416a9ac5-8a9f-48a8-9024-a9115c35a266\") "
Jul 24 20:09:13.912218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911966    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:13.912218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.911992    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:13.912218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.912088    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:13.912218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.912152    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:13.912218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.912173    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:13.912218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.912189    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:13.912539 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.912411    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/416a9ac5-8a9f-48a8-9024-a9115c35a266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:09:13.912583 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.912554    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-data" (OuterVolumeSpecName: "istio-data") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:13.913938 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.913912    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-kube-api-access-7plm4" (OuterVolumeSpecName: "kube-api-access-7plm4") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "kube-api-access-7plm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:09:13.913938 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.913930    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:13.914221 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.914198    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:09:13.914311 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:13.914296    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-token" (OuterVolumeSpecName: "istio-token") pod "416a9ac5-8a9f-48a8-9024-a9115c35a266" (UID: "416a9ac5-8a9f-48a8-9024-a9115c35a266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:09:14.012834 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.012811    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7plm4\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-kube-api-access-7plm4\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:14.012834 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.012830    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:14.012976 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.012840    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/416a9ac5-8a9f-48a8-9024-a9115c35a266-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:14.012976 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.012847    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:14.012976 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.012855    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:14.012976 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.012862    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/416a9ac5-8a9f-48a8-9024-a9115c35a266-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:09:14.105134 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.105109    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"]
Jul 24 20:09:14.112743 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.112722    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-74e2adbb-openshift-default-6fd86c4fd4-5xdqp"]
Jul 24 20:09:14.579465 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:14.579430    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" path="/var/lib/kubelet/pods/416a9ac5-8a9f-48a8-9024-a9115c35a266/volumes"
Jul 24 20:09:20.712899 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:09:20.712870    2541 scope.go:117] "RemoveContainer" containerID="091aff977ab84adf2e30f0bd6187eed7b23fe3377aa5515eb865d29285083e31"
Jul 24 20:10:04.954655 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.954611    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"]
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.954956    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy"
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.954968    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy"
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.954976    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72872dca-3e7c-4166-a2f3-948eb7362680" containerName="revoke-keys"
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.954982    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="72872dca-3e7c-4166-a2f3-948eb7362680" containerName="revoke-keys"
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.954993    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy"
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.954998    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy"
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.955052    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy"
Jul 24 20:10:04.955142 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.955058    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="72872dca-3e7c-4166-a2f3-948eb7362680" containerName="revoke-keys"
Jul 24 20:10:04.957965 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.957950    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.960888 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.960867    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-05f5d4-openshift-default-dockercfg-2qdc8\""
Jul 24 20:10:04.977301 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.977276    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"]
Jul 24 20:10:04.989255 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989226    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsvrl\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-kube-api-access-vsvrl\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989292    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-credential-socket\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989318    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a0225b-edd5-4768-955f-c669939a40cb-istio-podinfo\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989364    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-data\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989536 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989392    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-socket\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989536 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989421    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-certs\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989536 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989449    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-envoy\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989536 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989492    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a0225b-edd5-4768-955f-c669939a40cb-istiod-ca-cert\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:04.989696 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:04.989537    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-istio-token\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090528 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090495    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-credential-socket\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090528 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090534    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a0225b-edd5-4768-955f-c669939a40cb-istio-podinfo\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090582    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-data\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090610    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-socket\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090636    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-certs\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090661    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-envoy\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090683    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a0225b-edd5-4768-955f-c669939a40cb-istiod-ca-cert\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090720    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-istio-token\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.090851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090804    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsvrl\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-kube-api-access-vsvrl\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.091257 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.090995    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-credential-socket\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.091257 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.091123    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-data\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.091257 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.091190    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-socket\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.091411 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.091277    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-certs\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.091615 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.091596    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a0225b-edd5-4768-955f-c669939a40cb-istiod-ca-cert\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.092991 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.092967    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-envoy\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.093149 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.093129    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a0225b-edd5-4768-955f-c669939a40cb-istio-podinfo\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.099419 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.099398    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-istio-token\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.099419 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.099408    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsvrl\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-kube-api-access-vsvrl\") pod \"e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") " pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.267334 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.267270    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:05.399372 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.399320    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"]
Jul 24 20:10:05.401488 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:10:05.401451    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a0225b_edd5_4768_955f_c669939a40cb.slice/crio-b44251e84ad4f18f8ef5c732b05f2dcfea5e0b3c2640e4c89f65a095ed8b8468 WatchSource:0}: Error finding container b44251e84ad4f18f8ef5c732b05f2dcfea5e0b3c2640e4c89f65a095ed8b8468: Status 404 returned error can't find the container with id b44251e84ad4f18f8ef5c732b05f2dcfea5e0b3c2640e4c89f65a095ed8b8468
Jul 24 20:10:05.403479 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.403450    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:05.403580 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.403508    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:05.403580 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:05.403535    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:06.042830 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:06.042795    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" event={"ID":"81a0225b-edd5-4768-955f-c669939a40cb","Type":"ContainerStarted","Data":"0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1"}
Jul 24 20:10:06.043221 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:06.042853    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" event={"ID":"81a0225b-edd5-4768-955f-c669939a40cb","Type":"ContainerStarted","Data":"b44251e84ad4f18f8ef5c732b05f2dcfea5e0b3c2640e4c89f65a095ed8b8468"}
Jul 24 20:10:06.067380 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:06.067334    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podStartSLOduration=2.067320992 podStartE2EDuration="2.067320992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:06.064900261 +0000 UTC m=+2146.189239441" watchObservedRunningTime="2026-07-24 20:10:06.067320992 +0000 UTC m=+2146.191660142"
Jul 24 20:10:06.267985 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:06.267948    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:06.272805 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:06.272782    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:07.048636 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:07.048603    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:07.049644 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:07.049624    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:13.029596 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.029521    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"]
Jul 24 20:10:13.029970 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.029951    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="416a9ac5-8a9f-48a8-9024-a9115c35a266" containerName="istio-proxy"
Jul 24 20:10:13.033212 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.033195    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.035831 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.035809    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4c32d4-openshift-default-dockercfg-cj9rf\""
Jul 24 20:10:13.045098 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.045077    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"]
Jul 24 20:10:13.053482 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053458    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-socket\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053594 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053501    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-envoy\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053594 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053520    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-certs\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053669 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053639    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-data\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053704 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053679    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-token\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053742 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053706    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istiod-ca-cert\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053796 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053749    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-credential-socket\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053836 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053802    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-podinfo\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.053836 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.053828    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s95b\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-kube-api-access-4s95b\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155027 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.154993    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-data\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155212 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155032    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-token\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155212 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155058    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istiod-ca-cert\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155212 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155095    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-credential-socket\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155212 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155117    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-podinfo\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155212 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155139    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s95b\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-kube-api-access-4s95b\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155212 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155177    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-socket\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155553 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155234    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-envoy\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155553 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155264    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-certs\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155553 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155499    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-data\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155720 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155626    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-credential-socket\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155720 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155669    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-socket\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.155847 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.155716    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-certs\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.156024 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.156004    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istiod-ca-cert\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.157572 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.157555    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-envoy\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.157827 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.157806    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-podinfo\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.162587 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.162560    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s95b\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-kube-api-access-4s95b\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.162587 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.162577    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-token\") pod \"e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") " pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.344520 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.344435    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:13.499388 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.499361    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"]
Jul 24 20:10:13.500857 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:10:13.500823    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b1e757_a264_43a2_9a3d_40aa9c4c8862.slice/crio-5f09ac9a3574f8885682847adbf1e99c74ff47b3fd1c831863c0871078293533 WatchSource:0}: Error finding container 5f09ac9a3574f8885682847adbf1e99c74ff47b3fd1c831863c0871078293533: Status 404 returned error can't find the container with id 5f09ac9a3574f8885682847adbf1e99c74ff47b3fd1c831863c0871078293533
Jul 24 20:10:13.502837 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.502808    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:13.502912 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.502874    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:13.502912 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:13.502907    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:14.094014 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:14.093969    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" event={"ID":"05b1e757-a264-43a2-9a3d-40aa9c4c8862","Type":"ContainerStarted","Data":"6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2"}
Jul 24 20:10:14.094527 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:14.094039    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" event={"ID":"05b1e757-a264-43a2-9a3d-40aa9c4c8862","Type":"ContainerStarted","Data":"5f09ac9a3574f8885682847adbf1e99c74ff47b3fd1c831863c0871078293533"}
Jul 24 20:10:14.124605 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:14.124555    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" podStartSLOduration=1.124542849 podStartE2EDuration="1.124542849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:14.12092998 +0000 UTC m=+2154.245269137" watchObservedRunningTime="2026-07-24 20:10:14.124542849 +0000 UTC m=+2154.248882066"
Jul 24 20:10:14.345448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:14.345363    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:14.350524 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:14.350496    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:15.099587 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:15.099555    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:15.100605 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:15.100586    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:20.738324 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:20.738291    2541 scope.go:117] "RemoveContainer" containerID="6031ecc9f7e3990663d68f5703faa491b9012149c0d8974be348ff9ae9c27104"
Jul 24 20:10:20.756416 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:20.756285    2541 scope.go:117] "RemoveContainer" containerID="3dd70b6b0a870465ba4bbaaf56daac05a8619adf793a26c0dee798406a4266eb"
Jul 24 20:10:22.050826 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.050783    2541 patch_prober.go:28] interesting pod/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 24 20:10:22.051362 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.050848    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 24 20:10:22.138660 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.138607    2541 generic.go:356] "Generic (PLEG): container finished" podID="81a0225b-edd5-4768-955f-c669939a40cb" containerID="0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1" exitCode=0
Jul 24 20:10:22.138865 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.138682    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" event={"ID":"81a0225b-edd5-4768-955f-c669939a40cb","Type":"ContainerDied","Data":"0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1"}
Jul 24 20:10:22.139243 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.139220    2541 scope.go:117] "RemoveContainer" containerID="0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1"
Jul 24 20:10:22.140570 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.140536    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:22.140662 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.140625    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:22.140730 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:22.140673    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:23.151444 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:23.150552    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" event={"ID":"81a0225b-edd5-4768-955f-c669939a40cb","Type":"ContainerStarted","Data":"eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4"}
Jul 24 20:10:23.267612 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:23.267572    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:23.268057 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:23.268020    2541 patch_prober.go:28] interesting pod/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 24 20:10:23.268598 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:23.268248    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 24 20:10:24.268536 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:24.268500    2541 patch_prober.go:28] interesting pod/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 24 20:10:24.269064 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:24.268587    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 24 20:10:25.267915 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:25.267875    2541 patch_prober.go:28] interesting pod/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 24 20:10:25.268092 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:25.267928    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 24 20:10:26.267957 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:26.267918    2541 patch_prober.go:28] interesting pod/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 24 20:10:26.268344 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:26.267977    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 24 20:10:27.268249 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:27.268209    2541 patch_prober.go:28] interesting pod/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 24 20:10:27.268655 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:27.268272    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 24 20:10:28.192031 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.190879    2541 generic.go:356] "Generic (PLEG): container finished" podID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerID="6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2" exitCode=0
Jul 24 20:10:28.192031 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.191021    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" event={"ID":"05b1e757-a264-43a2-9a3d-40aa9c4c8862","Type":"ContainerDied","Data":"6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2"}
Jul 24 20:10:28.192031 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.191447    2541 scope.go:117] "RemoveContainer" containerID="6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2"
Jul 24 20:10:28.193411 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.193143    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:28.193411 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.193226    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:28.193411 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.193272    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:10:28.271869 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.271842    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:28.272235 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.272216    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:28.272882 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:28.272865    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:10:29.198121 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:29.198085    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" event={"ID":"05b1e757-a264-43a2-9a3d-40aa9c4c8862","Type":"ContainerStarted","Data":"c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc"}
Jul 24 20:10:29.345452 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:29.345407    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:29.346946 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:29.346907    2541 patch_prober.go:28] interesting pod/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 24 20:10:29.347069 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:29.346988    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 24 20:10:30.099938 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:30.099903    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:30.345398 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:30.345360    2541 patch_prober.go:28] interesting pod/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 24 20:10:30.345609 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:30.345427    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 24 20:10:31.344904 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:31.344868    2541 patch_prober.go:28] interesting pod/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 24 20:10:31.345112 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:31.344928    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 24 20:10:32.344848 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:32.344810    2541 patch_prober.go:28] interesting pod/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 24 20:10:32.345469 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:32.345434    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 24 20:10:33.349174 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:33.349138    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:10:33.350154 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:10:33.350134    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:11:31.445034 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.444998    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"]
Jul 24 20:11:31.448474 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.448459    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"
Jul 24 20:11:31.451448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.451426    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:11:31.451982 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.451963    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:11:31.457145 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.457122    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"]
Jul 24 20:11:31.495273 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.495243    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5357c14f-b49d-4279-8e24-ce7b48ee8452-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw\" (UID: \"5357c14f-b49d-4279-8e24-ce7b48ee8452\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"
Jul 24 20:11:31.596537 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.596510    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5357c14f-b49d-4279-8e24-ce7b48ee8452-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw\" (UID: \"5357c14f-b49d-4279-8e24-ce7b48ee8452\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"
Jul 24 20:11:31.597101 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.597082    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5357c14f-b49d-4279-8e24-ce7b48ee8452-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw\" (UID: \"5357c14f-b49d-4279-8e24-ce7b48ee8452\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"
Jul 24 20:11:31.759460 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.759393    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"
Jul 24 20:11:31.887354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:31.887328    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"]
Jul 24 20:11:31.890000 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:11:31.889969    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5357c14f_b49d_4279_8e24_ce7b48ee8452.slice/crio-2fa650396601ff2f333550e35906718a564c6b6f668faecbe6ee431d8d55ef97 WatchSource:0}: Error finding container 2fa650396601ff2f333550e35906718a564c6b6f668faecbe6ee431d8d55ef97: Status 404 returned error can't find the container with id 2fa650396601ff2f333550e35906718a564c6b6f668faecbe6ee431d8d55ef97
Jul 24 20:11:32.531336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:32.531305    2541 generic.go:356] "Generic (PLEG): container finished" podID="5357c14f-b49d-4279-8e24-ce7b48ee8452" containerID="7fedd6ed995af338bdfce6d9339c4e0bcc6ca4345b478b19589b7d70d6e71a73" exitCode=0
Jul 24 20:11:32.531703 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:32.531360    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw" event={"ID":"5357c14f-b49d-4279-8e24-ce7b48ee8452","Type":"ContainerDied","Data":"7fedd6ed995af338bdfce6d9339c4e0bcc6ca4345b478b19589b7d70d6e71a73"}
Jul 24 20:11:32.531703 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:32.531408    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw" event={"ID":"5357c14f-b49d-4279-8e24-ce7b48ee8452","Type":"ContainerStarted","Data":"2fa650396601ff2f333550e35906718a564c6b6f668faecbe6ee431d8d55ef97"}
Jul 24 20:11:33.665251 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:33.665230    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"
Jul 24 20:11:33.711050 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:33.711024    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5357c14f-b49d-4279-8e24-ce7b48ee8452-maas-api-service-ca\") pod \"5357c14f-b49d-4279-8e24-ce7b48ee8452\" (UID: \"5357c14f-b49d-4279-8e24-ce7b48ee8452\") "
Jul 24 20:11:33.711340 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:33.711320    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5357c14f-b49d-4279-8e24-ce7b48ee8452-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5357c14f-b49d-4279-8e24-ce7b48ee8452" (UID: "5357c14f-b49d-4279-8e24-ce7b48ee8452"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:11:33.812645 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:33.812576    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5357c14f-b49d-4279-8e24-ce7b48ee8452-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:34.543228 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:34.543191    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw" event={"ID":"5357c14f-b49d-4279-8e24-ce7b48ee8452","Type":"ContainerDied","Data":"2fa650396601ff2f333550e35906718a564c6b6f668faecbe6ee431d8d55ef97"}
Jul 24 20:11:34.543228 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:34.543220    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"
Jul 24 20:11:34.543434 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:34.543252    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fa650396601ff2f333550e35906718a564c6b6f668faecbe6ee431d8d55ef97"
Jul 24 20:11:46.554953 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:46.554861    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"]
Jul 24 20:11:46.557501 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:46.557479    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-05f5d4-t4bgw"]
Jul 24 20:11:46.578840 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:46.578806    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5357c14f-b49d-4279-8e24-ce7b48ee8452" path="/var/lib/kubelet/pods/5357c14f-b49d-4279-8e24-ce7b48ee8452/volumes"
Jul 24 20:11:53.143251 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:53.143217    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"]
Jul 24 20:11:53.143669 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:53.143468    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" containerID="cri-o://eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4" gracePeriod=30
Jul 24 20:11:58.273104 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.273071    2541 patch_prober.go:28] interesting pod/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 24 20:11:58.273495 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.273132    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 24 20:11:58.387978 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.387953    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:11:58.518957 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.518893    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-istio-token\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.518957 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.518930    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-envoy\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.518957 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.518948    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-data\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.519224 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519004    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a0225b-edd5-4768-955f-c669939a40cb-istiod-ca-cert\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.519224 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519024    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-credential-socket\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.519224 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519060    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-certs\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.519224 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519082    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-socket\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.519224 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519115    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsvrl\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-kube-api-access-vsvrl\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.519224 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519164    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a0225b-edd5-4768-955f-c669939a40cb-istio-podinfo\") pod \"81a0225b-edd5-4768-955f-c669939a40cb\" (UID: \"81a0225b-edd5-4768-955f-c669939a40cb\") "
Jul 24 20:11:58.519529 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519344    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:58.519529 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519358    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:58.519529 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519481    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.519529 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519501    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.519730 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519601    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:58.519730 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519638    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a0225b-edd5-4768-955f-c669939a40cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:11:58.520001 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.519977    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:58.521472 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.521447    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81a0225b-edd5-4768-955f-c669939a40cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:11:58.521547 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.521481    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-kube-api-access-vsvrl" (OuterVolumeSpecName: "kube-api-access-vsvrl") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "kube-api-access-vsvrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:11:58.521547 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.521521    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:11:58.521547 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.521520    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81a0225b-edd5-4768-955f-c669939a40cb" (UID: "81a0225b-edd5-4768-955f-c669939a40cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:58.620152 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.620125    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a0225b-edd5-4768-955f-c669939a40cb-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.620152 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.620147    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.620293 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.620161    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.620293 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.620172    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.620293 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.620184    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a0225b-edd5-4768-955f-c669939a40cb-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.620293 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.620198    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a0225b-edd5-4768-955f-c669939a40cb-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.620293 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.620211    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsvrl\" (UniqueName: \"kubernetes.io/projected/81a0225b-edd5-4768-955f-c669939a40cb-kube-api-access-vsvrl\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:11:58.658954 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.658924    2541 generic.go:356] "Generic (PLEG): container finished" podID="81a0225b-edd5-4768-955f-c669939a40cb" containerID="eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4" exitCode=0
Jul 24 20:11:58.659063 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.658975    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"
Jul 24 20:11:58.659063 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.659003    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" event={"ID":"81a0225b-edd5-4768-955f-c669939a40cb","Type":"ContainerDied","Data":"eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4"}
Jul 24 20:11:58.659063 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.659060    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx" event={"ID":"81a0225b-edd5-4768-955f-c669939a40cb","Type":"ContainerDied","Data":"b44251e84ad4f18f8ef5c732b05f2dcfea5e0b3c2640e4c89f65a095ed8b8468"}
Jul 24 20:11:58.659226 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.659083    2541 scope.go:117] "RemoveContainer" containerID="eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4"
Jul 24 20:11:58.667726 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.667709    2541 scope.go:117] "RemoveContainer" containerID="0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1"
Jul 24 20:11:58.675631 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.675602    2541 scope.go:117] "RemoveContainer" containerID="eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4"
Jul 24 20:11:58.676108 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:11:58.676085    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4\": container with ID starting with eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4 not found: ID does not exist" containerID="eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4"
Jul 24 20:11:58.676297 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.676272    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4"} err="failed to get container status \"eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4\": rpc error: code = NotFound desc = could not find container \"eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4\": container with ID starting with eb4d88a6dd2ac9a3ba2a74ad8f130ea6d23b139c2a576033671e4ff438aa4ce4 not found: ID does not exist"
Jul 24 20:11:58.676425 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.676403    2541 scope.go:117] "RemoveContainer" containerID="0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1"
Jul 24 20:11:58.676687 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:11:58.676669    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1\": container with ID starting with 0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1 not found: ID does not exist" containerID="0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1"
Jul 24 20:11:58.676759 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.676693    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1"} err="failed to get container status \"0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1\": rpc error: code = NotFound desc = could not find container \"0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1\": container with ID starting with 0b768d234f8cb72dc5ae1b5552ba72bb715f5caca3890e7f3250f617b4d444e1 not found: ID does not exist"
Jul 24 20:11:58.678760 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.678742    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"]
Jul 24 20:11:58.683612 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:11:58.683591    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-05f5d4-openshift-default-6d87cb8694-s4npx"]
Jul 24 20:12:00.578691 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:00.578659    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a0225b-edd5-4768-955f-c669939a40cb" path="/var/lib/kubelet/pods/81a0225b-edd5-4768-955f-c669939a40cb/volumes"
Jul 24 20:12:15.346172 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:15.346140    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"]
Jul 24 20:12:15.346563 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:15.346391    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy" containerID="cri-o://c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc" gracePeriod=30
Jul 24 20:12:16.250612 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.250575    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"]
Jul 24 20:12:16.251022 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.251005    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5357c14f-b49d-4279-8e24-ce7b48ee8452" containerName="revoke-keys"
Jul 24 20:12:16.251079 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.251024    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="5357c14f-b49d-4279-8e24-ce7b48ee8452" containerName="revoke-keys"
Jul 24 20:12:16.251079 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.251042    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy"
Jul 24 20:12:16.251079 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.251047    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy"
Jul 24 20:12:16.251177 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.251109    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="5357c14f-b49d-4279-8e24-ce7b48ee8452" containerName="revoke-keys"
Jul 24 20:12:16.251177 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.251118    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy"
Jul 24 20:12:16.251177 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.251125    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy"
Jul 24 20:12:16.255510 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.255494    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.258048 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.258026    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3ff089-openshift-default-dockercfg-kxw8q\""
Jul 24 20:12:16.265987 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.265965    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"]
Jul 24 20:12:16.370538 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370503    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-socket\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370555    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-data\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370578    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d494029-c886-447c-b015-f0e7a0ad8e43-istiod-ca-cert\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370620    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-certs\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370685    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-envoy\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370704    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-token\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370806    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjbg\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-kube-api-access-lfjbg\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370869    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-podinfo\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.371029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.370914    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-credential-socket\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.471941 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.471902    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-credential-socket\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.471947    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-socket\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.471977    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-data\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.471995    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d494029-c886-447c-b015-f0e7a0ad8e43-istiod-ca-cert\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472014    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-certs\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472039    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-envoy\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472056    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-token\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472128 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472102    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjbg\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-kube-api-access-lfjbg\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472434 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472151    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-podinfo\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472434 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472360    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-credential-socket\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472605 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472582    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-certs\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472670 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472611    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-data\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.472724 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.472669    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-socket\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.473087 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.473064    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d494029-c886-447c-b015-f0e7a0ad8e43-istiod-ca-cert\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.474404 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.474375    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-envoy\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.474598 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.474581    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-podinfo\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.479547 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.479527    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-token\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.479674 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.479658    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjbg\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-kube-api-access-lfjbg\") pod \"e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") " pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.565796 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.565717    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:16.697270 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.697246    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"]
Jul 24 20:12:16.698997 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:12:16.698967    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d494029_c886_447c_b015_f0e7a0ad8e43.slice/crio-4679f975c7f907f9ccc0b128f714a405aca1882375fcfb075f07aa0140faf2d9 WatchSource:0}: Error finding container 4679f975c7f907f9ccc0b128f714a405aca1882375fcfb075f07aa0140faf2d9: Status 404 returned error can't find the container with id 4679f975c7f907f9ccc0b128f714a405aca1882375fcfb075f07aa0140faf2d9
Jul 24 20:12:16.701421 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.701389    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:16.701520 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.701451    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:16.701520 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.701483    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:16.750798 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:16.750754    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" event={"ID":"9d494029-c886-447c-b015-f0e7a0ad8e43","Type":"ContainerStarted","Data":"4679f975c7f907f9ccc0b128f714a405aca1882375fcfb075f07aa0140faf2d9"}
Jul 24 20:12:17.758095 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:17.758053    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" event={"ID":"9d494029-c886-447c-b015-f0e7a0ad8e43","Type":"ContainerStarted","Data":"2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591"}
Jul 24 20:12:17.781590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:17.781540    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podStartSLOduration=1.7815270619999999 podStartE2EDuration="1.781527062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:12:17.779154699 +0000 UTC m=+2277.903493857" watchObservedRunningTime="2026-07-24 20:12:17.781527062 +0000 UTC m=+2277.905866218"
Jul 24 20:12:18.351969 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:18.351932    2541 patch_prober.go:28] interesting pod/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 20:12:18.352125 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:18.351991    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:12:18.565927 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:18.565898    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:18.570621 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:18.570600    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:18.762956 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:18.762931    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:18.763738 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:18.763721    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:20.600829 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.600804    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:12:20.601862 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.601843    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-data\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.601917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.601871    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-credential-socket\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.601917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.601911    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-certs\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.601987 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.601928    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istiod-ca-cert\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.601987 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.601948    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-socket\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.601987 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.601963    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-podinfo\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.602130 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.601985    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-envoy\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.602130 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602042    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-token\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.602130 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602093    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s95b\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-kube-api-access-4s95b\") pod \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\" (UID: \"05b1e757-a264-43a2-9a3d-40aa9c4c8862\") "
Jul 24 20:12:20.602319 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602155    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:12:20.602319 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602279    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:12:20.602319 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602288    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:12:20.602504 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602370    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:12:20.602504 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602419    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.602504 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602439    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.602504 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602457    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.602712 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.602579    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-data" (OuterVolumeSpecName: "istio-data") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:12:20.604181 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.604155    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:12:20.604181 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.604171    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:12:20.604312 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.604217    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-token" (OuterVolumeSpecName: "istio-token") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:12:20.604312 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.604265    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-kube-api-access-4s95b" (OuterVolumeSpecName: "kube-api-access-4s95b") pod "05b1e757-a264-43a2-9a3d-40aa9c4c8862" (UID: "05b1e757-a264-43a2-9a3d-40aa9c4c8862"). InnerVolumeSpecName "kube-api-access-4s95b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:12:20.703694 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.703662    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.703694 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.703686    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s95b\" (UniqueName: \"kubernetes.io/projected/05b1e757-a264-43a2-9a3d-40aa9c4c8862-kube-api-access-4s95b\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.703694 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.703697    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.703951 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.703705    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.703951 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.703714    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.703951 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.703722    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b1e757-a264-43a2-9a3d-40aa9c4c8862-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:20.775333 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.775298    2541 generic.go:356] "Generic (PLEG): container finished" podID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerID="c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc" exitCode=0
Jul 24 20:12:20.775552 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.775341    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"
Jul 24 20:12:20.775552 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.775342    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" event={"ID":"05b1e757-a264-43a2-9a3d-40aa9c4c8862","Type":"ContainerDied","Data":"c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc"}
Jul 24 20:12:20.775552 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.775399    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694" event={"ID":"05b1e757-a264-43a2-9a3d-40aa9c4c8862","Type":"ContainerDied","Data":"5f09ac9a3574f8885682847adbf1e99c74ff47b3fd1c831863c0871078293533"}
Jul 24 20:12:20.775552 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.775430    2541 scope.go:117] "RemoveContainer" containerID="c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc"
Jul 24 20:12:20.789203 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.789184    2541 scope.go:117] "RemoveContainer" containerID="6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2"
Jul 24 20:12:20.793563 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.793544    2541 scope.go:117] "RemoveContainer" containerID="73cf16312c877bc65cbafb7b230d07171c4d6d2d1c66b80d7ccb5d6853805a40"
Jul 24 20:12:20.798009 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.797992    2541 scope.go:117] "RemoveContainer" containerID="c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc"
Jul 24 20:12:20.798243 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:12:20.798224    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc\": container with ID starting with c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc not found: ID does not exist" containerID="c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc"
Jul 24 20:12:20.798311 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.798251    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc"} err="failed to get container status \"c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc\": rpc error: code = NotFound desc = could not find container \"c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc\": container with ID starting with c32e74503605e2ffcf7c8280b97b4af64c8b587ce3a87583dbbd69c71f6832fc not found: ID does not exist"
Jul 24 20:12:20.798311 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.798271    2541 scope.go:117] "RemoveContainer" containerID="6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2"
Jul 24 20:12:20.798563 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:12:20.798546    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2\": container with ID starting with 6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2 not found: ID does not exist" containerID="6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2"
Jul 24 20:12:20.798618 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.798570    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2"} err="failed to get container status \"6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2\": rpc error: code = NotFound desc = could not find container \"6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2\": container with ID starting with 6f7365ca184e34fbc3dffd20c6596e9b8c282824f34ed931e797a464b1364ad2 not found: ID does not exist"
Jul 24 20:12:20.822037 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.822016    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"]
Jul 24 20:12:20.825303 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:20.825281    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4c32d4-openshift-default-6d567bb7b8-zk694"]
Jul 24 20:12:22.578540 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:22.578508    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" path="/var/lib/kubelet/pods/05b1e757-a264-43a2-9a3d-40aa9c4c8862/volumes"
Jul 24 20:12:24.893552 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893521    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"]
Jul 24 20:12:24.894061 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893877    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy"
Jul 24 20:12:24.894061 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893889    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a0225b-edd5-4768-955f-c669939a40cb" containerName="istio-proxy"
Jul 24 20:12:24.894061 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893902    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy"
Jul 24 20:12:24.894061 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893908    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy"
Jul 24 20:12:24.894061 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893925    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy"
Jul 24 20:12:24.894061 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893932    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy"
Jul 24 20:12:24.894061 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.893990    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy"
Jul 24 20:12:24.898558 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.898537    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.901252 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.901232    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-247467-openshift-default-dockercfg-pdbhd\""
Jul 24 20:12:24.910298 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.910276    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"]
Jul 24 20:12:24.939875 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.939852    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-socket\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.939999 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.939882    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/894a9445-1d8e-4f0f-a086-5f178954f24d-istiod-ca-cert\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.939999 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.939902    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8tq\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-kube-api-access-mh8tq\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.939999 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.939985    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-data\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.940107 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.940029    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-credential-socket\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.940107 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.940067    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-certs\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.940107 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.940097    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-token\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.940199 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.940119    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-podinfo\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:24.940199 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:24.940164    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-envoy\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041001 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.040953    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-data\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041001 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041007    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-credential-socket\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041244 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041039    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-certs\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041244 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041067    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-token\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041244 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041087    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-podinfo\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041244 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041183    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-envoy\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041451 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041279    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-socket\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041451 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041305    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/894a9445-1d8e-4f0f-a086-5f178954f24d-istiod-ca-cert\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041451 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041331    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8tq\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-kube-api-access-mh8tq\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041451 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041411    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-data\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041451 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041429    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-certs\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041718 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041568    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-credential-socket\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.041718 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.041648    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-socket\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.042113 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.042092    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/894a9445-1d8e-4f0f-a086-5f178954f24d-istiod-ca-cert\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.043603 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.043582    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-envoy\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.043741 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.043720    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-podinfo\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.051203 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.051178    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8tq\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-kube-api-access-mh8tq\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.052071 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.052053    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-token\") pod \"e2e-api-b-247467-openshift-default-c9b56d666-ft49m\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") " pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.209141 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.209060    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:25.344514 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.344489    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"]
Jul 24 20:12:25.345956 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:12:25.345930    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894a9445_1d8e_4f0f_a086_5f178954f24d.slice/crio-bae18b70e4d8f2f4aac63a9c01248a57756b98251aa75ef0040ef6cbd8b81c72 WatchSource:0}: Error finding container bae18b70e4d8f2f4aac63a9c01248a57756b98251aa75ef0040ef6cbd8b81c72: Status 404 returned error can't find the container with id bae18b70e4d8f2f4aac63a9c01248a57756b98251aa75ef0040ef6cbd8b81c72
Jul 24 20:12:25.348025 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.347998    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:25.348103 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.348057    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:25.348103 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.348085    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:25.803260 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.803223    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" event={"ID":"894a9445-1d8e-4f0f-a086-5f178954f24d","Type":"ContainerStarted","Data":"937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff"}
Jul 24 20:12:25.803420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.803286    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" event={"ID":"894a9445-1d8e-4f0f-a086-5f178954f24d","Type":"ContainerStarted","Data":"bae18b70e4d8f2f4aac63a9c01248a57756b98251aa75ef0040ef6cbd8b81c72"}
Jul 24 20:12:25.824139 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:25.824095    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" podStartSLOduration=1.824081349 podStartE2EDuration="1.824081349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:12:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:12:25.823959692 +0000 UTC m=+2285.948298849" watchObservedRunningTime="2026-07-24 20:12:25.824081349 +0000 UTC m=+2285.948420504"
Jul 24 20:12:26.210178 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:26.210143    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:26.214921 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:26.214896    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:26.810036 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:26.809994    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:26.811029 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:26.811005    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:33.765184 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.765097    2541 patch_prober.go:28] interesting pod/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 24 20:12:33.765184 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.765164    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 24 20:12:33.854707 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.854662    2541 generic.go:356] "Generic (PLEG): container finished" podID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerID="2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591" exitCode=0
Jul 24 20:12:33.854920 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.854833    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" event={"ID":"9d494029-c886-447c-b015-f0e7a0ad8e43","Type":"ContainerDied","Data":"2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591"}
Jul 24 20:12:33.855370 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.855346    2541 scope.go:117] "RemoveContainer" containerID="2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591"
Jul 24 20:12:33.857986 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.857947    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:33.858096 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.858057    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:33.858161 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:33.858128    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:34.866756 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:34.866698    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" event={"ID":"9d494029-c886-447c-b015-f0e7a0ad8e43","Type":"ContainerStarted","Data":"242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4"}
Jul 24 20:12:35.567161 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:35.567125    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:35.567545 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:35.567515    2541 patch_prober.go:28] interesting pod/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 24 20:12:35.567714 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:35.567689    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 24 20:12:36.567065 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:36.567022    2541 patch_prober.go:28] interesting pod/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 24 20:12:36.567432 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:36.567093    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 24 20:12:37.566490 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:37.566443    2541 patch_prober.go:28] interesting pod/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 24 20:12:37.566717 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:37.566507    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 24 20:12:38.567216 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:38.567173    2541 patch_prober.go:28] interesting pod/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 24 20:12:38.567688 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:38.567240    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 24 20:12:39.570429 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.570397    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:39.572704 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.570794    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:39.572704 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.571597    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:12:39.898602 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.898571    2541 generic.go:356] "Generic (PLEG): container finished" podID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerID="937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff" exitCode=0
Jul 24 20:12:39.898798 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.898643    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" event={"ID":"894a9445-1d8e-4f0f-a086-5f178954f24d","Type":"ContainerDied","Data":"937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff"}
Jul 24 20:12:39.899021 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.899007    2541 scope.go:117] "RemoveContainer" containerID="937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff"
Jul 24 20:12:39.899985 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.899958    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:39.900088 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.900050    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:39.900153 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:39.900109    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:12:40.135432 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.135396    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"]
Jul 24 20:12:40.135996 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.135980    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b1e757-a264-43a2-9a3d-40aa9c4c8862" containerName="istio-proxy"
Jul 24 20:12:40.139326 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.139309    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"
Jul 24 20:12:40.142232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.142181    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:12:40.142232 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.142183    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:12:40.145043 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.145018    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"]
Jul 24 20:12:40.282490 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.282461    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff153e6-4dd4-4f6c-9ded-848aaae69151-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3ff089-xccqd\" (UID: \"7ff153e6-4dd4-4f6c-9ded-848aaae69151\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"
Jul 24 20:12:40.383019 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.382984    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff153e6-4dd4-4f6c-9ded-848aaae69151-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3ff089-xccqd\" (UID: \"7ff153e6-4dd4-4f6c-9ded-848aaae69151\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"
Jul 24 20:12:40.383598 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.383577    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff153e6-4dd4-4f6c-9ded-848aaae69151-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3ff089-xccqd\" (UID: \"7ff153e6-4dd4-4f6c-9ded-848aaae69151\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"
Jul 24 20:12:40.452814 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.452711    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"
Jul 24 20:12:40.609716 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.609680    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"]
Jul 24 20:12:40.610371 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:12:40.610343    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff153e6_4dd4_4f6c_9ded_848aaae69151.slice/crio-a528bbc5bd7f190bcbd8db5f4446e431a6af50aa9f187016796c839fb1700046 WatchSource:0}: Error finding container a528bbc5bd7f190bcbd8db5f4446e431a6af50aa9f187016796c839fb1700046: Status 404 returned error can't find the container with id a528bbc5bd7f190bcbd8db5f4446e431a6af50aa9f187016796c839fb1700046
Jul 24 20:12:40.906312 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.906278    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" event={"ID":"894a9445-1d8e-4f0f-a086-5f178954f24d","Type":"ContainerStarted","Data":"084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a"}
Jul 24 20:12:40.907461 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:40.907431    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd" event={"ID":"7ff153e6-4dd4-4f6c-9ded-848aaae69151","Type":"ContainerStarted","Data":"a528bbc5bd7f190bcbd8db5f4446e431a6af50aa9f187016796c839fb1700046"}
Jul 24 20:12:41.209361 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:41.209326    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:41.210501 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:41.210471    2541 patch_prober.go:28] interesting pod/e2e-api-b-247467-openshift-default-c9b56d666-ft49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 24 20:12:41.210947 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:41.210545    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 24 20:12:41.810578 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:41.810497    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:41.914403 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:41.914368    2541 generic.go:356] "Generic (PLEG): container finished" podID="7ff153e6-4dd4-4f6c-9ded-848aaae69151" containerID="4f24b88ec69116682bf3b0263a8d89152c02f9a1dbc6b24048e4cdfe25c1d5ea" exitCode=0
Jul 24 20:12:41.914587 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:41.914455    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd" event={"ID":"7ff153e6-4dd4-4f6c-9ded-848aaae69151","Type":"ContainerDied","Data":"4f24b88ec69116682bf3b0263a8d89152c02f9a1dbc6b24048e4cdfe25c1d5ea"}
Jul 24 20:12:42.209688 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:42.209652    2541 patch_prober.go:28] interesting pod/e2e-api-b-247467-openshift-default-c9b56d666-ft49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 24 20:12:42.209896 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:42.209706    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 24 20:12:43.081273 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.081251    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"
Jul 24 20:12:43.210103 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.210012    2541 patch_prober.go:28] interesting pod/e2e-api-b-247467-openshift-default-c9b56d666-ft49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 24 20:12:43.210103 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.210071    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 24 20:12:43.213308 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.213280    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff153e6-4dd4-4f6c-9ded-848aaae69151-maas-api-service-ca\") pod \"7ff153e6-4dd4-4f6c-9ded-848aaae69151\" (UID: \"7ff153e6-4dd4-4f6c-9ded-848aaae69151\") "
Jul 24 20:12:43.213606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.213584    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff153e6-4dd4-4f6c-9ded-848aaae69151-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ff153e6-4dd4-4f6c-9ded-848aaae69151" (UID: "7ff153e6-4dd4-4f6c-9ded-848aaae69151"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:12:43.314083 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.314052    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ff153e6-4dd4-4f6c-9ded-848aaae69151-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:12:43.928357 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.928322    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"
Jul 24 20:12:43.928545 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.928357    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd" event={"ID":"7ff153e6-4dd4-4f6c-9ded-848aaae69151","Type":"ContainerDied","Data":"a528bbc5bd7f190bcbd8db5f4446e431a6af50aa9f187016796c839fb1700046"}
Jul 24 20:12:43.928545 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:43.928405    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a528bbc5bd7f190bcbd8db5f4446e431a6af50aa9f187016796c839fb1700046"
Jul 24 20:12:44.209723 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:44.209627    2541 patch_prober.go:28] interesting pod/e2e-api-b-247467-openshift-default-c9b56d666-ft49m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 24 20:12:44.209723 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:44.209683    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 24 20:12:45.213578 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:45.213542    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:12:45.214432 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:12:45.214414    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:13:00.343787 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:00.343745    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"]
Jul 24 20:13:00.346680 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:00.346655    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3ff089-xccqd"]
Jul 24 20:13:00.579180 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:00.579154    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff153e6-4dd4-4f6c-9ded-848aaae69151" path="/var/lib/kubelet/pods/7ff153e6-4dd4-4f6c-9ded-848aaae69151/volumes"
Jul 24 20:13:06.755434 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:06.755399    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"]
Jul 24 20:13:06.755849 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:06.755615    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy" containerID="cri-o://242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4" gracePeriod=30
Jul 24 20:13:07.147334 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.147302    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"]
Jul 24 20:13:07.147659 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.147647    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff153e6-4dd4-4f6c-9ded-848aaae69151" containerName="revoke-keys"
Jul 24 20:13:07.147705 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.147661    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff153e6-4dd4-4f6c-9ded-848aaae69151" containerName="revoke-keys"
Jul 24 20:13:07.147749 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.147740    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff153e6-4dd4-4f6c-9ded-848aaae69151" containerName="revoke-keys"
Jul 24 20:13:07.151010 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.150995    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"
Jul 24 20:13:07.160477 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.160458    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:13:07.160695 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.160681    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:13:07.169913 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.169892    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"]
Jul 24 20:13:07.321472 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.321440    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd9938a6-3403-482a-8bf7-1d749eb317ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-247467-8ncrs\" (UID: \"dd9938a6-3403-482a-8bf7-1d749eb317ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"
Jul 24 20:13:07.422581 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.422508    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd9938a6-3403-482a-8bf7-1d749eb317ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-247467-8ncrs\" (UID: \"dd9938a6-3403-482a-8bf7-1d749eb317ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"
Jul 24 20:13:07.423125 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.423105    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd9938a6-3403-482a-8bf7-1d749eb317ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-247467-8ncrs\" (UID: \"dd9938a6-3403-482a-8bf7-1d749eb317ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"
Jul 24 20:13:07.460715 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.460691    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"
Jul 24 20:13:07.592691 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:07.592651    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"]
Jul 24 20:13:07.595057 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:13:07.595030    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9938a6_3403_482a_8bf7_1d749eb317ad.slice/crio-c5535626cce34b16828fbc732f36d6d6ddd5519ecca7b78d7ec18fe610ee3a06 WatchSource:0}: Error finding container c5535626cce34b16828fbc732f36d6d6ddd5519ecca7b78d7ec18fe610ee3a06: Status 404 returned error can't find the container with id c5535626cce34b16828fbc732f36d6d6ddd5519ecca7b78d7ec18fe610ee3a06
Jul 24 20:13:08.050099 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:08.050020    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs" event={"ID":"dd9938a6-3403-482a-8bf7-1d749eb317ad","Type":"ContainerStarted","Data":"4a5dc45fecb31bb9b95cf5f5bf55890ce8af106eba852be1133629b378c9d780"}
Jul 24 20:13:08.050099 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:08.050078    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs" event={"ID":"dd9938a6-3403-482a-8bf7-1d749eb317ad","Type":"ContainerStarted","Data":"c5535626cce34b16828fbc732f36d6d6ddd5519ecca7b78d7ec18fe610ee3a06"}
Jul 24 20:13:08.065198 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:08.065152    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs" podStartSLOduration=1.065135747 podStartE2EDuration="1.065135747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:13:08.064058153 +0000 UTC m=+2328.188397306" watchObservedRunningTime="2026-07-24 20:13:08.065135747 +0000 UTC m=+2328.189474903"
Jul 24 20:13:09.057002 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:09.056966    2541 generic.go:356] "Generic (PLEG): container finished" podID="dd9938a6-3403-482a-8bf7-1d749eb317ad" containerID="4a5dc45fecb31bb9b95cf5f5bf55890ce8af106eba852be1133629b378c9d780" exitCode=0
Jul 24 20:13:09.057377 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:09.057052    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs" event={"ID":"dd9938a6-3403-482a-8bf7-1d749eb317ad","Type":"ContainerDied","Data":"4a5dc45fecb31bb9b95cf5f5bf55890ce8af106eba852be1133629b378c9d780"}
Jul 24 20:13:09.573149 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:09.573119    2541 patch_prober.go:28] interesting pod/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 20:13:09.573305 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:09.573174    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:13:10.193827 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:10.193805    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"
Jul 24 20:13:10.244656 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:10.244625    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd9938a6-3403-482a-8bf7-1d749eb317ad-maas-api-service-ca\") pod \"dd9938a6-3403-482a-8bf7-1d749eb317ad\" (UID: \"dd9938a6-3403-482a-8bf7-1d749eb317ad\") "
Jul 24 20:13:10.244979 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:10.244956    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd9938a6-3403-482a-8bf7-1d749eb317ad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dd9938a6-3403-482a-8bf7-1d749eb317ad" (UID: "dd9938a6-3403-482a-8bf7-1d749eb317ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:10.345492 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:10.345430    2541 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd9938a6-3403-482a-8bf7-1d749eb317ad-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:11.070539 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:11.070511    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"
Jul 24 20:13:11.070539 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:11.070529    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs" event={"ID":"dd9938a6-3403-482a-8bf7-1d749eb317ad","Type":"ContainerDied","Data":"c5535626cce34b16828fbc732f36d6d6ddd5519ecca7b78d7ec18fe610ee3a06"}
Jul 24 20:13:11.070741 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:11.070569    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5535626cce34b16828fbc732f36d6d6ddd5519ecca7b78d7ec18fe610ee3a06"
Jul 24 20:13:11.999485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:11.999463    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:13:12.058831 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.058739    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-socket\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.058831 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.058811    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-certs\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059022 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.058839    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-credential-socket\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059022 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.058879    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d494029-c886-447c-b015-f0e7a0ad8e43-istiod-ca-cert\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059022 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.058903    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfjbg\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-kube-api-access-lfjbg\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059175 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059025    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:12.059175 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059032    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-envoy\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059175 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059125    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-token\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059175 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059137    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:12.059175 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059155    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-data\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059193    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-podinfo\") pod \"9d494029-c886-447c-b015-f0e7a0ad8e43\" (UID: \"9d494029-c886-447c-b015-f0e7a0ad8e43\") "
Jul 24 20:13:12.059420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059158    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:12.059420 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059246    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d494029-c886-447c-b015-f0e7a0ad8e43-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:12.059573 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059479    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.059573 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059493    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.059573 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059502    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.059573 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059510    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d494029-c886-447c-b015-f0e7a0ad8e43-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.059876 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.059853    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:12.061243 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.061215    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:12.061243 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.061217    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:13:12.061519 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.061497    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:12.061519 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.061510    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-kube-api-access-lfjbg" (OuterVolumeSpecName: "kube-api-access-lfjbg") pod "9d494029-c886-447c-b015-f0e7a0ad8e43" (UID: "9d494029-c886-447c-b015-f0e7a0ad8e43"). InnerVolumeSpecName "kube-api-access-lfjbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:12.077565 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.077539    2541 generic.go:356] "Generic (PLEG): container finished" podID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerID="242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4" exitCode=0
Jul 24 20:13:12.077679 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.077583    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"
Jul 24 20:13:12.077679 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.077605    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" event={"ID":"9d494029-c886-447c-b015-f0e7a0ad8e43","Type":"ContainerDied","Data":"242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4"}
Jul 24 20:13:12.077679 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.077657    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl" event={"ID":"9d494029-c886-447c-b015-f0e7a0ad8e43","Type":"ContainerDied","Data":"4679f975c7f907f9ccc0b128f714a405aca1882375fcfb075f07aa0140faf2d9"}
Jul 24 20:13:12.077873 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.077686    2541 scope.go:117] "RemoveContainer" containerID="242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4"
Jul 24 20:13:12.087054 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.087037    2541 scope.go:117] "RemoveContainer" containerID="2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591"
Jul 24 20:13:12.094701 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.094687    2541 scope.go:117] "RemoveContainer" containerID="242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4"
Jul 24 20:13:12.094955 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:13:12.094939    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4\": container with ID starting with 242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4 not found: ID does not exist" containerID="242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4"
Jul 24 20:13:12.095012 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.094962    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4"} err="failed to get container status \"242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4\": rpc error: code = NotFound desc = could not find container \"242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4\": container with ID starting with 242ea1bfc9c7784d423324b2d17409230f847443a441e2b3f45c8c16556cefe4 not found: ID does not exist"
Jul 24 20:13:12.095012 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.094979    2541 scope.go:117] "RemoveContainer" containerID="2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591"
Jul 24 20:13:12.095235 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:13:12.095216    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591\": container with ID starting with 2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591 not found: ID does not exist" containerID="2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591"
Jul 24 20:13:12.095288 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.095240    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591"} err="failed to get container status \"2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591\": rpc error: code = NotFound desc = could not find container \"2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591\": container with ID starting with 2b5eea598b6a4b4e07eb654ac6a0bfbd6dbf666047ec132e14a40a39059de591 not found: ID does not exist"
Jul 24 20:13:12.099345 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.099324    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"]
Jul 24 20:13:12.103041 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.103024    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3ff089-openshift-default-6c9d8b8bf6-sdzpl"]
Jul 24 20:13:12.160662 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.160642    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfjbg\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-kube-api-access-lfjbg\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.160662 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.160662    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.160810 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.160672    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.160810 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.160680    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.160810 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.160687    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d494029-c886-447c-b015-f0e7a0ad8e43-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:12.578738 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:12.578705    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" path="/var/lib/kubelet/pods/9d494029-c886-447c-b015-f0e7a0ad8e43/volumes"
Jul 24 20:13:27.220125 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:27.220087    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"]
Jul 24 20:13:27.224792 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:27.224739    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-247467-8ncrs"]
Jul 24 20:13:28.579252 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:28.579218    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd9938a6-3403-482a-8bf7-1d749eb317ad" path="/var/lib/kubelet/pods/dd9938a6-3403-482a-8bf7-1d749eb317ad/volumes"
Jul 24 20:13:33.726736 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:33.726700    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"]
Jul 24 20:13:33.727192 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:33.726970    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy" containerID="cri-o://084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a" gracePeriod=30
Jul 24 20:13:34.620131 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.620094    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"]
Jul 24 20:13:34.620473 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.620460    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy"
Jul 24 20:13:34.620523 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.620474    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy"
Jul 24 20:13:34.620523 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.620490    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9938a6-3403-482a-8bf7-1d749eb317ad" containerName="revoke-keys"
Jul 24 20:13:34.620523 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.620495    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9938a6-3403-482a-8bf7-1d749eb317ad" containerName="revoke-keys"
Jul 24 20:13:34.620639 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.620556    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd9938a6-3403-482a-8bf7-1d749eb317ad" containerName="revoke-keys"
Jul 24 20:13:34.620639 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.620564    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy"
Jul 24 20:13:34.623633 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.623618    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.626183 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.626163    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-53d0a0-openshift-default-dockercfg-qmlsx\""
Jul 24 20:13:34.636641 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.636619    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"]
Jul 24 20:13:34.734023 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.733990    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-socket\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734023 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734027    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhpc\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-kube-api-access-2lhpc\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734058    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-token\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734146    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-data\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734190    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-certs\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734317    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-credential-socket\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734362    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istiod-ca-cert\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734409    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-envoy\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.734606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.734428    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-podinfo\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835344 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835315    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-data\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835351    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-certs\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835393    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-credential-socket\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835408    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istiod-ca-cert\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835435    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-envoy\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835452    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-podinfo\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835473    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-socket\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835803 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835489    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhpc\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-kube-api-access-2lhpc\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835803 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835517    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-token\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835940 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835794    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-data\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835940 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835816    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-credential-socket\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.835940 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.835874    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-socket\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.836110 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.836042    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-certs\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.836260 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.836241    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istiod-ca-cert\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.837724 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.837694    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-envoy\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.838056 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.838037    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-podinfo\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.843324 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.843300    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-token\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.843324 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.843309    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhpc\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-kube-api-access-2lhpc\") pod \"e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") " pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:34.933774 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:34.933747    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:35.064849 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.064811    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"]
Jul 24 20:13:35.065891 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:13:35.065866    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb71dd8_2f94_48ef_b993_2d8256043d9b.slice/crio-6432869ff30c3819e88e542832734715d133551d425abe83e5c2bf3af9ad473c WatchSource:0}: Error finding container 6432869ff30c3819e88e542832734715d133551d425abe83e5c2bf3af9ad473c: Status 404 returned error can't find the container with id 6432869ff30c3819e88e542832734715d133551d425abe83e5c2bf3af9ad473c
Jul 24 20:13:35.067927 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.067897    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:35.068034 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.067961    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:35.068034 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.067989    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:35.208701 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.208610    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" event={"ID":"7eb71dd8-2f94-48ef-b993-2d8256043d9b","Type":"ContainerStarted","Data":"4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749"}
Jul 24 20:13:35.208701 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.208665    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" event={"ID":"7eb71dd8-2f94-48ef-b993-2d8256043d9b","Type":"ContainerStarted","Data":"6432869ff30c3819e88e542832734715d133551d425abe83e5c2bf3af9ad473c"}
Jul 24 20:13:35.231159 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.231103    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" podStartSLOduration=1.23108324 podStartE2EDuration="1.23108324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:13:35.227358664 +0000 UTC m=+2355.351697843" watchObservedRunningTime="2026-07-24 20:13:35.23108324 +0000 UTC m=+2355.355422397"
Jul 24 20:13:35.934729 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:35.934698    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:36.939252 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:36.939222    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:37.219099 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:37.219021    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:37.219850 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:37.219831    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:38.976659 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:38.976629    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:13:39.073756 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.073686    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-data\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.073756 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.073727    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-socket\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.073756 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.073746    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh8tq\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-kube-api-access-mh8tq\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.074014 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.073794    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-token\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.074014 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.073854    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-credential-socket\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.074014 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.073992    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-certs\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.074168 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074065    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-podinfo\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.074168 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074049    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:39.074168 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074123    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:39.074168 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074128    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-envoy\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.074391 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074178    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/894a9445-1d8e-4f0f-a086-5f178954f24d-istiod-ca-cert\") pod \"894a9445-1d8e-4f0f-a086-5f178954f24d\" (UID: \"894a9445-1d8e-4f0f-a086-5f178954f24d\") "
Jul 24 20:13:39.074391 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074260    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:39.074510 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074451    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-data" (OuterVolumeSpecName: "istio-data") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:39.074510 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074451    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/894a9445-1d8e-4f0f-a086-5f178954f24d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:39.074675 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074533    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.074675 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074549    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.074675 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074564    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.074675 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.074575    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.076236 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.076212    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-token" (OuterVolumeSpecName: "istio-token") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:39.076236 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.076222    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:13:39.076590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.076570    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-kube-api-access-mh8tq" (OuterVolumeSpecName: "kube-api-access-mh8tq") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "kube-api-access-mh8tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:39.076677 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.076572    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "894a9445-1d8e-4f0f-a086-5f178954f24d" (UID: "894a9445-1d8e-4f0f-a086-5f178954f24d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:39.175280 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.175250    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/894a9445-1d8e-4f0f-a086-5f178954f24d-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.175280 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.175276    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh8tq\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-kube-api-access-mh8tq\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.175280 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.175286    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.175498 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.175295    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.175498 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.175303    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/894a9445-1d8e-4f0f-a086-5f178954f24d-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:13:39.230229 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.230197    2541 generic.go:356] "Generic (PLEG): container finished" podID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerID="084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a" exitCode=0
Jul 24 20:13:39.230374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.230249    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"
Jul 24 20:13:39.230374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.230279    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" event={"ID":"894a9445-1d8e-4f0f-a086-5f178954f24d","Type":"ContainerDied","Data":"084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a"}
Jul 24 20:13:39.230374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.230341    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m" event={"ID":"894a9445-1d8e-4f0f-a086-5f178954f24d","Type":"ContainerDied","Data":"bae18b70e4d8f2f4aac63a9c01248a57756b98251aa75ef0040ef6cbd8b81c72"}
Jul 24 20:13:39.230374 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.230364    2541 scope.go:117] "RemoveContainer" containerID="084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a"
Jul 24 20:13:39.240325 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.240306    2541 scope.go:117] "RemoveContainer" containerID="937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff"
Jul 24 20:13:39.248169 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.248151    2541 scope.go:117] "RemoveContainer" containerID="084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a"
Jul 24 20:13:39.248451 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:13:39.248432    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a\": container with ID starting with 084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a not found: ID does not exist" containerID="084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a"
Jul 24 20:13:39.248520 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.248458    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a"} err="failed to get container status \"084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a\": rpc error: code = NotFound desc = could not find container \"084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a\": container with ID starting with 084cf57aa7450de6c094bb80cb61874710319e03d0d2d52ae1e62daf576a793a not found: ID does not exist"
Jul 24 20:13:39.248520 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.248476    2541 scope.go:117] "RemoveContainer" containerID="937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff"
Jul 24 20:13:39.248704 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:13:39.248685    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff\": container with ID starting with 937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff not found: ID does not exist" containerID="937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff"
Jul 24 20:13:39.248753 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.248712    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff"} err="failed to get container status \"937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff\": rpc error: code = NotFound desc = could not find container \"937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff\": container with ID starting with 937ec1eef79089546d44f28538d08a83b17d7d1dec9062bf6f49bef1f1b2f7ff not found: ID does not exist"
Jul 24 20:13:39.257419 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.257396    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"]
Jul 24 20:13:39.259477 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:39.259458    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-247467-openshift-default-c9b56d666-ft49m"]
Jul 24 20:13:40.579164 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:40.579133    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" path="/var/lib/kubelet/pods/894a9445-1d8e-4f0f-a086-5f178954f24d/volumes"
Jul 24 20:13:42.268622 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.268584    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"]
Jul 24 20:13:42.269007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.268958    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy"
Jul 24 20:13:42.269007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.268969    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy"
Jul 24 20:13:42.269007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.268981    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy"
Jul 24 20:13:42.269007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.268987    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy"
Jul 24 20:13:42.269007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.269001    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy"
Jul 24 20:13:42.269007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.269007    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy"
Jul 24 20:13:42.269236 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.269057    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy"
Jul 24 20:13:42.269236 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.269063    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="894a9445-1d8e-4f0f-a086-5f178954f24d" containerName="istio-proxy"
Jul 24 20:13:42.269236 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.269072    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d494029-c886-447c-b015-f0e7a0ad8e43" containerName="istio-proxy"
Jul 24 20:13:42.273823 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.273802    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.276439 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.276422    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-3f5fc9-openshift-default-dockercfg-cwjm6\""
Jul 24 20:13:42.287378 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.287355    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"]
Jul 24 20:13:42.406004 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.405969    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-socket\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406004 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406008    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-certs\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406223 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406039    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-data\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406223 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406106    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-token\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406223 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406155    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-podinfo\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406223 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406174    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66gs\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-kube-api-access-b66gs\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406223 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406193    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istiod-ca-cert\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406403 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406252    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-envoy\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.406403 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.406280    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-credential-socket\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507156 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507126    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-socket\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507156 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507159    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-certs\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507340 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507184    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-data\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507340 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507296    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-token\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507441 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507343    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-podinfo\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507441 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507369    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b66gs\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-kube-api-access-b66gs\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507548 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507496    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istiod-ca-cert\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507548 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507507    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-certs\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507548 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507542    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-envoy\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507702 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507564    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-socket\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507702 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507584    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-credential-socket\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507702 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507623    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-data\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.507900 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.507866    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-credential-socket\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.508090 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.508070    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istiod-ca-cert\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.509654 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.509632    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-envoy\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.509800 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.509762    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-podinfo\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.515546 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.515526    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-token\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.515640 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.515567    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66gs\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-kube-api-access-b66gs\") pod \"e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") " pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.583288 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.583231    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:42.714976 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.714944    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"]
Jul 24 20:13:42.717101 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:13:42.717074    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcfd2bc_0f7e_4e70_8432_8e875b575172.slice/crio-bf55762bfdf01719f23bd3d3972fd50fac984ed82040c419e3e0fa98020bf8a1 WatchSource:0}: Error finding container bf55762bfdf01719f23bd3d3972fd50fac984ed82040c419e3e0fa98020bf8a1: Status 404 returned error can't find the container with id bf55762bfdf01719f23bd3d3972fd50fac984ed82040c419e3e0fa98020bf8a1
Jul 24 20:13:42.719218 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.719191    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:42.719282 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.719251    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:42.719324 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:42.719281    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:43.253523 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:43.253490    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" event={"ID":"4dcfd2bc-0f7e-4e70-8432-8e875b575172","Type":"ContainerStarted","Data":"a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80"}
Jul 24 20:13:43.253692 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:43.253545    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" event={"ID":"4dcfd2bc-0f7e-4e70-8432-8e875b575172","Type":"ContainerStarted","Data":"bf55762bfdf01719f23bd3d3972fd50fac984ed82040c419e3e0fa98020bf8a1"}
Jul 24 20:13:43.273915 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:43.273870    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" podStartSLOduration=1.273855068 podStartE2EDuration="1.273855068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:13:43.272720446 +0000 UTC m=+2363.397059651" watchObservedRunningTime="2026-07-24 20:13:43.273855068 +0000 UTC m=+2363.398194224"
Jul 24 20:13:43.584113 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:43.584025    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:43.588887 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:43.588860    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:44.262927 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:44.262888    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:44.263994 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:44.263974    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:51.300373 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:51.300338    2541 generic.go:356] "Generic (PLEG): container finished" podID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerID="4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749" exitCode=0
Jul 24 20:13:51.300823 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:51.300411    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" event={"ID":"7eb71dd8-2f94-48ef-b993-2d8256043d9b","Type":"ContainerDied","Data":"4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749"}
Jul 24 20:13:51.300823 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:51.300803    2541 scope.go:117] "RemoveContainer" containerID="4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749"
Jul 24 20:13:51.301846 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:51.301819    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:51.301940 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:51.301890    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:51.301940 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:51.301923    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:52.219483 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:52.219436    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:52.307098 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:52.307061    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" event={"ID":"7eb71dd8-2f94-48ef-b993-2d8256043d9b","Type":"ContainerStarted","Data":"1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61"}
Jul 24 20:13:52.934458 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:52.934206    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:52.935345 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:52.935307    2541 patch_prober.go:28] interesting pod/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 24 20:13:52.935453 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:52.935369    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 24 20:13:53.938793 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:53.934411    2541 patch_prober.go:28] interesting pod/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 24 20:13:53.938793 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:53.934484    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 24 20:13:54.945793 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:54.934607    2541 patch_prober.go:28] interesting pod/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 24 20:13:54.945793 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:54.934675    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 24 20:13:55.934789 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:55.934725    2541 patch_prober.go:28] interesting pod/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 24 20:13:55.934990 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:55.934829    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 24 20:13:56.937994 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:56.937969    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:56.938429 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:56.938208    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:56.938851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:56.938835    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:13:57.337074 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:57.336990    2541 generic.go:356] "Generic (PLEG): container finished" podID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerID="a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80" exitCode=0
Jul 24 20:13:57.337074 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:57.337061    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" event={"ID":"4dcfd2bc-0f7e-4e70-8432-8e875b575172","Type":"ContainerDied","Data":"a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80"}
Jul 24 20:13:57.337507 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:57.337490    2541 scope.go:117] "RemoveContainer" containerID="a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80"
Jul 24 20:13:57.338469 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:57.338445    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:57.338579 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:57.338507    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:57.338579 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:57.338537    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:13:57.382668 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:13:57.382637    2541 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcfd2bc_0f7e_4e70_8432_8e875b575172.slice/crio-223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af.scope\": RecentStats: unable to find data in memory cache]"
Jul 24 20:13:58.350083 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:58.350043    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" event={"ID":"4dcfd2bc-0f7e-4e70-8432-8e875b575172","Type":"ContainerStarted","Data":"223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af"}
Jul 24 20:13:58.584258 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:58.584223    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:58.585352 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:58.585330    2541 patch_prober.go:28] interesting pod/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 24 20:13:58.585481 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:58.585370    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 24 20:13:59.263652 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:59.263616    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:13:59.584632 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:59.584542    2541 patch_prober.go:28] interesting pod/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 24 20:13:59.584632 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:13:59.584610    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 24 20:14:00.584139 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:14:00.584109    2541 patch_prober.go:28] interesting pod/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 24 20:14:00.584316 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:14:00.584156    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 24 20:14:01.584431 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:14:01.584397    2541 patch_prober.go:28] interesting pod/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 24 20:14:01.584858 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:14:01.584452    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 24 20:14:02.587930 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:14:02.587902    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:14:02.588971 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:14:02.588948    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:14:20.839671 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:14:20.839640    2541 scope.go:117] "RemoveContainer" containerID="bdc66043f77f7687ac4e1c9e189b04fc1434ddc28d85a268d3cd5ca880d8bcb3"
Jul 24 20:15:00.132954 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.132919    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"]
Jul 24 20:15:00.136245 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.136226    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"]
Jul 24 20:15:00.136378 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.136354    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"
Jul 24 20:15:00.138902 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.138883    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:15:00.139299 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.139286    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5"]
Jul 24 20:15:00.139414 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.139401    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"
Jul 24 20:15:00.142754 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.142401    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5"
Jul 24 20:15:00.146092 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.146069    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"]
Jul 24 20:15:00.156435 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.156305    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"]
Jul 24 20:15:00.158171 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.158150    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"
Jul 24 20:15:00.160366 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.160347    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5"]
Jul 24 20:15:00.165145 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.165120    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"
Jul 24 20:15:00.192261 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.192241    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5"
Jul 24 20:15:00.359613 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.359584    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5"]
Jul 24 20:15:00.361197 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:15:00.361166    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbeb07ff_f03b_4740_89a5_de206728f5cd.slice/crio-19191489a3a20060a35f7b9c9d5f2a552c0110f682993a9f5aad7c9d0718221b WatchSource:0}: Error finding container 19191489a3a20060a35f7b9c9d5f2a552c0110f682993a9f5aad7c9d0718221b: Status 404 returned error can't find the container with id 19191489a3a20060a35f7b9c9d5f2a552c0110f682993a9f5aad7c9d0718221b
Jul 24 20:15:00.522888 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.522861    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"]
Jul 24 20:15:00.524644 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:15:00.524620    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323c214d_b4b5_4f64_bfdd_6e3c99862d7d.slice/crio-46b070f9b2b7945163f35fba67a60cfd16467ca19d01899ba06a11f5035ffddd WatchSource:0}: Error finding container 46b070f9b2b7945163f35fba67a60cfd16467ca19d01899ba06a11f5035ffddd: Status 404 returned error can't find the container with id 46b070f9b2b7945163f35fba67a60cfd16467ca19d01899ba06a11f5035ffddd
Jul 24 20:15:00.525690 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.525670    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"]
Jul 24 20:15:00.526982 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:15:00.526956    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4634455d_b0ed_4c99_84f6_2f17a7b59942.slice/crio-d968bbe3545795d1b376225b0a060b263b68a02bf5fc7ad6c4c681960bdc3f26 WatchSource:0}: Error finding container d968bbe3545795d1b376225b0a060b263b68a02bf5fc7ad6c4c681960bdc3f26: Status 404 returned error can't find the container with id d968bbe3545795d1b376225b0a060b263b68a02bf5fc7ad6c4c681960bdc3f26
Jul 24 20:15:00.668445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.668361    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5" event={"ID":"fbeb07ff-f03b-4740-89a5-de206728f5cd","Type":"ContainerStarted","Data":"1e768342ef426be22ef9330862dc28230402b32573000f4ba90e93f56afb23d8"}
Jul 24 20:15:00.668445 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.668415    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5" event={"ID":"fbeb07ff-f03b-4740-89a5-de206728f5cd","Type":"ContainerStarted","Data":"19191489a3a20060a35f7b9c9d5f2a552c0110f682993a9f5aad7c9d0718221b"}
Jul 24 20:15:00.669568 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.669547    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j" event={"ID":"323c214d-b4b5-4f64-bfdd-6e3c99862d7d","Type":"ContainerStarted","Data":"46b070f9b2b7945163f35fba67a60cfd16467ca19d01899ba06a11f5035ffddd"}
Jul 24 20:15:00.670753 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.670733    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n" event={"ID":"4634455d-b0ed-4c99-84f6-2f17a7b59942","Type":"ContainerStarted","Data":"d968bbe3545795d1b376225b0a060b263b68a02bf5fc7ad6c4c681960bdc3f26"}
Jul 24 20:15:00.684097 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:00.684050    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5" podStartSLOduration=0.684036999 podStartE2EDuration="684.036999ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:00.68194601 +0000 UTC m=+2440.806285251" watchObservedRunningTime="2026-07-24 20:15:00.684036999 +0000 UTC m=+2440.808376149"
Jul 24 20:15:01.678469 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:01.678439    2541 generic.go:356] "Generic (PLEG): container finished" podID="fbeb07ff-f03b-4740-89a5-de206728f5cd" containerID="1e768342ef426be22ef9330862dc28230402b32573000f4ba90e93f56afb23d8" exitCode=0
Jul 24 20:15:01.678910 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:01.678519    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5" event={"ID":"fbeb07ff-f03b-4740-89a5-de206728f5cd","Type":"ContainerDied","Data":"1e768342ef426be22ef9330862dc28230402b32573000f4ba90e93f56afb23d8"}
Jul 24 20:15:01.679968 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:01.679946    2541 generic.go:356] "Generic (PLEG): container finished" podID="323c214d-b4b5-4f64-bfdd-6e3c99862d7d" containerID="52db7abf7f9fa503526080a56fd117d68174425be1efed90cb6014fee65ba3f2" exitCode=0
Jul 24 20:15:01.680064 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:01.680021    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j" event={"ID":"323c214d-b4b5-4f64-bfdd-6e3c99862d7d","Type":"ContainerDied","Data":"52db7abf7f9fa503526080a56fd117d68174425be1efed90cb6014fee65ba3f2"}
Jul 24 20:15:01.681320 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:01.681302    2541 generic.go:356] "Generic (PLEG): container finished" podID="4634455d-b0ed-4c99-84f6-2f17a7b59942" containerID="33a75ef7b4fe9c22142754dbb26fc975883e96c571b5c015b1aefc4e62a7fd44" exitCode=0
Jul 24 20:15:01.681402 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:01.681381    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n" event={"ID":"4634455d-b0ed-4c99-84f6-2f17a7b59942","Type":"ContainerDied","Data":"33a75ef7b4fe9c22142754dbb26fc975883e96c571b5c015b1aefc4e62a7fd44"}
Jul 24 20:15:02.831151 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:02.831125    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"
Jul 24 20:15:02.876694 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:02.876672    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5"
Jul 24 20:15:02.879007 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:02.878990    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"
Jul 24 20:15:03.698672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.698642    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5"
Jul 24 20:15:03.698672 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.698663    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-mfmg5" event={"ID":"fbeb07ff-f03b-4740-89a5-de206728f5cd","Type":"ContainerDied","Data":"19191489a3a20060a35f7b9c9d5f2a552c0110f682993a9f5aad7c9d0718221b"}
Jul 24 20:15:03.698921 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.698736    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19191489a3a20060a35f7b9c9d5f2a552c0110f682993a9f5aad7c9d0718221b"
Jul 24 20:15:03.700017 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.699995    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j" event={"ID":"323c214d-b4b5-4f64-bfdd-6e3c99862d7d","Type":"ContainerDied","Data":"46b070f9b2b7945163f35fba67a60cfd16467ca19d01899ba06a11f5035ffddd"}
Jul 24 20:15:03.700125 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.700043    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46b070f9b2b7945163f35fba67a60cfd16467ca19d01899ba06a11f5035ffddd"
Jul 24 20:15:03.700125 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.700000    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"
Jul 24 20:15:03.701353 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.701333    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"
Jul 24 20:15:03.701446 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.701334    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n" event={"ID":"4634455d-b0ed-4c99-84f6-2f17a7b59942","Type":"ContainerDied","Data":"d968bbe3545795d1b376225b0a060b263b68a02bf5fc7ad6c4c681960bdc3f26"}
Jul 24 20:15:03.701494 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:15:03.701450    2541 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d968bbe3545795d1b376225b0a060b263b68a02bf5fc7ad6c4c681960bdc3f26"
Jul 24 20:18:20.886147 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:18:20.886117    2541 scope.go:117] "RemoveContainer" containerID="7fedd6ed995af338bdfce6d9339c4e0bcc6ca4345b478b19589b7d70d6e71a73"
Jul 24 20:19:20.909151 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:20.909084    2541 scope.go:117] "RemoveContainer" containerID="4f24b88ec69116682bf3b0263a8d89152c02f9a1dbc6b24048e4cdfe25c1d5ea"
Jul 24 20:19:20.916761 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:20.916744    2541 scope.go:117] "RemoveContainer" containerID="4a5dc45fecb31bb9b95cf5f5bf55890ce8af106eba852be1133629b378c9d780"
Jul 24 20:19:27.922950 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.922915    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"]
Jul 24 20:19:27.923507 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923409    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4634455d-b0ed-4c99-84f6-2f17a7b59942" containerName="cleanup"
Jul 24 20:19:27.923507 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923430    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4634455d-b0ed-4c99-84f6-2f17a7b59942" containerName="cleanup"
Jul 24 20:19:27.923507 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923446    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323c214d-b4b5-4f64-bfdd-6e3c99862d7d" containerName="cleanup"
Jul 24 20:19:27.923507 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923456    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="323c214d-b4b5-4f64-bfdd-6e3c99862d7d" containerName="cleanup"
Jul 24 20:19:27.923507 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923479    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbeb07ff-f03b-4740-89a5-de206728f5cd" containerName="cleanup"
Jul 24 20:19:27.923507 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923487    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbeb07ff-f03b-4740-89a5-de206728f5cd" containerName="cleanup"
Jul 24 20:19:27.923851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923564    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4634455d-b0ed-4c99-84f6-2f17a7b59942" containerName="cleanup"
Jul 24 20:19:27.923851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923580    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="323c214d-b4b5-4f64-bfdd-6e3c99862d7d" containerName="cleanup"
Jul 24 20:19:27.923851 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.923591    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbeb07ff-f03b-4740-89a5-de206728f5cd" containerName="cleanup"
Jul 24 20:19:27.927903 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.927882    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.930799 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.930755    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-937547-openshift-default-dockercfg-9s65x\""
Jul 24 20:19:27.943226 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.943204    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"]
Jul 24 20:19:27.990485 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990447    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrlr\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-kube-api-access-7qrlr\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990624 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990501    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-credential-socket\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990624 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990545    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-token\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990624 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990581    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-data\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990747 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990687    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-certs\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990747 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990730    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-socket\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990875 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990825    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-envoy\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990875 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990870    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istiod-ca-cert\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:27.990977 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:27.990899    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-podinfo\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.091733 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.091699    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-token\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.091950 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.091741    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-data\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.091950 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.091815    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-certs\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.091950 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.091847    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-socket\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.091950 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.091902    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-envoy\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.091950 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.091945    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istiod-ca-cert\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092228 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.091981    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-podinfo\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092228 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.092148    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrlr\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-kube-api-access-7qrlr\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092228 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.092200    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-credential-socket\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092386 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.092241    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-certs\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092386 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.092267    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-data\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092386 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.092330    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-socket\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092570 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.092550    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-credential-socket\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.092644 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.092626    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istiod-ca-cert\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.094375 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.094354    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-envoy\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.094503 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.094487    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-podinfo\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.100072 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.100053    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrlr\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-kube-api-access-7qrlr\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.100157 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.100088    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-token\") pod \"e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") " pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.244606 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.244538    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:28.385473 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.385445    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"]
Jul 24 20:19:28.386452 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:19:28.386424    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c358b6_7181_47cd_a3e9_0395aedbe4a7.slice/crio-b2e5d777b85296c60fafa12b7826fe4ae42bc1032abef07bc03d0dda4e61b879 WatchSource:0}: Error finding container b2e5d777b85296c60fafa12b7826fe4ae42bc1032abef07bc03d0dda4e61b879: Status 404 returned error can't find the container with id b2e5d777b85296c60fafa12b7826fe4ae42bc1032abef07bc03d0dda4e61b879
Jul 24 20:19:28.388742 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.388703    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:28.388840 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.388809    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:28.388878 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:28.388860    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:29.091226 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:29.091187    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" event={"ID":"62c358b6-7181-47cd-a3e9-0395aedbe4a7","Type":"ContainerStarted","Data":"ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be"}
Jul 24 20:19:29.091625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:29.091249    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" event={"ID":"62c358b6-7181-47cd-a3e9-0395aedbe4a7","Type":"ContainerStarted","Data":"b2e5d777b85296c60fafa12b7826fe4ae42bc1032abef07bc03d0dda4e61b879"}
Jul 24 20:19:29.111638 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:29.111592    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" podStartSLOduration=2.111577743 podStartE2EDuration="2.111577743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:19:29.109897343 +0000 UTC m=+2709.234236498" watchObservedRunningTime="2026-07-24 20:19:29.111577743 +0000 UTC m=+2709.235916898"
Jul 24 20:19:29.245067 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:29.245038    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:29.249839 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:29.249817    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:30.096614 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:30.096582    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:30.097567 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:30.097547    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:46.699744 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.699712    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"]
Jul 24 20:19:46.703925 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.703909    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.707898 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.707877    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-307a30-openshift-default-dockercfg-bnqlr\""
Jul 24 20:19:46.719071 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.719048    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"]
Jul 24 20:19:46.875341 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875302    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-certs\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875532 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875360    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-credential-socket\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875532 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875388    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjc5s\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-kube-api-access-bjc5s\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875532 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875420    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d40a9332-6d65-4511-a69d-248e04d65c73-istio-podinfo\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875532 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875481    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d40a9332-6d65-4511-a69d-248e04d65c73-istiod-ca-cert\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875700 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875533    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-istio-token\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875700 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875560    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-data\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875700 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875578    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-socket\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.875700 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.875594    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-envoy\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976351 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976276    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-credential-socket\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976351 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976309    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjc5s\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-kube-api-access-bjc5s\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976351 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976332    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d40a9332-6d65-4511-a69d-248e04d65c73-istio-podinfo\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976356    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d40a9332-6d65-4511-a69d-248e04d65c73-istiod-ca-cert\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976383    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-istio-token\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976409    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-data\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976436    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-socket\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976460    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-envoy\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976625 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976530    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-certs\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976977 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976733    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-credential-socket\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976977 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976818    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-data\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976977 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976888    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-certs\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.976977 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.976938    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-socket\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.977239 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.977219    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d40a9332-6d65-4511-a69d-248e04d65c73-istiod-ca-cert\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.978946 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.978926    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-envoy\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.979336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.979316    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d40a9332-6d65-4511-a69d-248e04d65c73-istio-podinfo\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.985013 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.984986    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-istio-token\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:46.985250 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:46.985232    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjc5s\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-kube-api-access-bjc5s\") pod \"e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") " pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:47.018060 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:47.018038    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:47.164760 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:47.164730    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"]
Jul 24 20:19:47.166386 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:19:47.166325    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40a9332_6d65_4511_a69d_248e04d65c73.slice/crio-92b6a367fd2697cc987c77e038a2f000569d77df35544672ed24496dc4c773df WatchSource:0}: Error finding container 92b6a367fd2697cc987c77e038a2f000569d77df35544672ed24496dc4c773df: Status 404 returned error can't find the container with id 92b6a367fd2697cc987c77e038a2f000569d77df35544672ed24496dc4c773df
Jul 24 20:19:47.169123 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:47.169086    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:47.169204 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:47.169175    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:47.169246 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:47.169216    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:47.196669 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:47.196637    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" event={"ID":"d40a9332-6d65-4511-a69d-248e04d65c73","Type":"ContainerStarted","Data":"92b6a367fd2697cc987c77e038a2f000569d77df35544672ed24496dc4c773df"}
Jul 24 20:19:48.203439 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.203361    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" event={"ID":"d40a9332-6d65-4511-a69d-248e04d65c73","Type":"ContainerStarted","Data":"13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e"}
Jul 24 20:19:48.205003 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.204981    2541 generic.go:356] "Generic (PLEG): container finished" podID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerID="ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be" exitCode=0
Jul 24 20:19:48.205109 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.205010    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" event={"ID":"62c358b6-7181-47cd-a3e9-0395aedbe4a7","Type":"ContainerDied","Data":"ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be"}
Jul 24 20:19:48.205337 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.205324    2541 scope.go:117] "RemoveContainer" containerID="ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be"
Jul 24 20:19:48.206426 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.206398    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:48.206499 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.206482    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:48.206542 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.206526    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:19:48.223805 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:48.223750    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" podStartSLOduration=2.223736211 podStartE2EDuration="2.223736211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:19:48.221969089 +0000 UTC m=+2728.346308292" watchObservedRunningTime="2026-07-24 20:19:48.223736211 +0000 UTC m=+2728.348075367"
Jul 24 20:19:49.018170 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.018132    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:49.023395 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.023364    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:49.212573 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.212537    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" event={"ID":"62c358b6-7181-47cd-a3e9-0395aedbe4a7","Type":"ContainerStarted","Data":"12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc"}
Jul 24 20:19:49.213084 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.212796    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:49.213861 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.213842    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:19:49.245114 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.245070    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:49.245440 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.245410    2541 patch_prober.go:28] interesting pod/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 20:19:49.245546 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:49.245471    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 20:19:50.245910 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:50.245874    2541 patch_prober.go:28] interesting pod/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 20:19:50.246496 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:50.246466    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 20:19:51.245984 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:51.245941    2541 patch_prober.go:28] interesting pod/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 20:19:51.246537 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:51.246016    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 20:19:52.245422 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:52.245380    2541 patch_prober.go:28] interesting pod/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 20:19:52.246044 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:52.245645    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 20:19:53.263500 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:53.263462    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:53.264301 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:53.264279    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:19:53.265552 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:19:53.265521    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:20:09.318302 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:09.318266    2541 generic.go:356] "Generic (PLEG): container finished" podID="d40a9332-6d65-4511-a69d-248e04d65c73" containerID="13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e" exitCode=0
Jul 24 20:20:09.318730 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:09.318345    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" event={"ID":"d40a9332-6d65-4511-a69d-248e04d65c73","Type":"ContainerDied","Data":"13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e"}
Jul 24 20:20:09.318805 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:09.318787    2541 scope.go:117] "RemoveContainer" containerID="13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e"
Jul 24 20:20:09.319808 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:09.319784    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:20:09.319882 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:09.319852    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:20:09.319928 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:09.319883    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:20:10.326026 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:10.325998    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" event={"ID":"d40a9332-6d65-4511-a69d-248e04d65c73","Type":"ContainerStarted","Data":"4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d"}
Jul 24 20:20:11.018657 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:11.018617    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:20:11.018904 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:11.018882    2541 patch_prober.go:28] interesting pod/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 24 20:20:11.018977 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:11.018931    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 24 20:20:12.019130 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:12.019099    2541 patch_prober.go:28] interesting pod/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 24 20:20:12.019510 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:12.019154    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 24 20:20:13.018917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:13.018881    2541 patch_prober.go:28] interesting pod/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 24 20:20:13.019097 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:13.018945    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 24 20:20:14.018368 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:14.018326    2541 patch_prober.go:28] interesting pod/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 24 20:20:14.018785 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:14.018386    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 24 20:20:15.023162 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:15.023129    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:20:15.023550 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:15.023391    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:20:15.023966 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:15.023945    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:20:54.219020 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.218977    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"]
Jul 24 20:20:54.222597 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.222580    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.225196 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.225177    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-712eee-openshift-default-dockercfg-64rpl\""
Jul 24 20:20:54.231929 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.231903    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-credential-socket\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232038 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.231952    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-envoy\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232038 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.231993    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc242\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-kube-api-access-xc242\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232169 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.232040    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-socket\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232169 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.232074    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-data\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232283 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.232247    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-token\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232339 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.232303    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-podinfo\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232339 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.232329    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-certs\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.232483 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.232350    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.235518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.235499    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"]
Jul 24 20:20:54.333643 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333602    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-socket\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.333870 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333665    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-data\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.333870 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333731    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-token\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.333870 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333786    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-podinfo\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.333870 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333819    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-certs\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.333870 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333843    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.334156 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333897    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-credential-socket\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.334156 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333929    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-envoy\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.334156 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.333957    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc242\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-kube-api-access-xc242\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.334719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.334690    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-socket\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.335010 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.334987    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-data\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.336504 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.336470    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.336815 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.336790    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-certs\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.337216 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.337194    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-credential-socket\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.338386 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.338364    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-podinfo\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.341150 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.340684    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-envoy\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.356512 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.356479    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc242\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-kube-api-access-xc242\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.357390 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.357355    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-token\") pod \"e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") " pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.534191 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.534103    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:54.669893 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.669866    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"]
Jul 24 20:20:54.671209 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:20:54.671182    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3a0e5f_40af_4b6c_9da1_2db70cae8cb9.slice/crio-c2f4f34d75be0fe70f8876a33b8f47ca123e14681820a8cb00c886ac5b0a78fd WatchSource:0}: Error finding container c2f4f34d75be0fe70f8876a33b8f47ca123e14681820a8cb00c886ac5b0a78fd: Status 404 returned error can't find the container with id c2f4f34d75be0fe70f8876a33b8f47ca123e14681820a8cb00c886ac5b0a78fd
Jul 24 20:20:54.673289 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.673257    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:20:54.673378 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.673327    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:20:54.673378 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:54.673369    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:20:55.571682 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:55.571643    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" event={"ID":"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9","Type":"ContainerStarted","Data":"9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c"}
Jul 24 20:20:55.572147 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:55.571726    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" event={"ID":"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9","Type":"ContainerStarted","Data":"c2f4f34d75be0fe70f8876a33b8f47ca123e14681820a8cb00c886ac5b0a78fd"}
Jul 24 20:20:55.592103 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:55.592055    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" podStartSLOduration=1.592040393 podStartE2EDuration="1.592040393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:20:55.589010976 +0000 UTC m=+2795.713350132" watchObservedRunningTime="2026-07-24 20:20:55.592040393 +0000 UTC m=+2795.716379617"
Jul 24 20:20:56.534675 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:56.534643    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:56.539498 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:56.539473    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:56.580850 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:56.580827    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:20:56.581189 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:20:56.580887    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:21:11.580521 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.580486    2541 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 20:21:11.580983 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.580538    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 20:21:11.677100 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.677066    2541 generic.go:356] "Generic (PLEG): container finished" podID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerID="9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c" exitCode=0
Jul 24 20:21:11.677255 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.677138    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" event={"ID":"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9","Type":"ContainerDied","Data":"9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c"}
Jul 24 20:21:11.677503 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.677490    2541 scope.go:117] "RemoveContainer" containerID="9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c"
Jul 24 20:21:11.678526 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.678501    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:21:11.678590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.678567    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:21:11.678626 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:11.678595    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 20:21:12.684355 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:12.684316    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" event={"ID":"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9","Type":"ContainerStarted","Data":"11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f"}
Jul 24 20:21:13.535331 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:13.535292    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:21:13.535545 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:13.535486    2541 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 20:21:13.535618 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:13.535543    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 20:21:14.535132 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:14.535090    2541 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 20:21:14.535632 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:14.535156    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 20:21:15.535840 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:15.535799    2541 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 20:21:15.536348 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:15.535867    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 20:21:16.534704 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:16.534665    2541 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 20:21:16.534930 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:16.534733    2541 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 20:21:17.539069 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:17.539042    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:21:17.539463 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:17.539295    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:21:17.540023 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:17.540005    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:21:34.112951 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:34.112917    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"]
Jul 24 20:21:34.113565 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:34.113158    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy" containerID="cri-o://11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f" gracePeriod=30
Jul 24 20:21:39.368560 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.368535    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:21:39.446604 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446574    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-credential-socket\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446740 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446628    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-podinfo\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446740 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446651    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-certs\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446740 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446708    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istiod-ca-cert\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446751    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-token\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446803    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-socket\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446837    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc242\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-kube-api-access-xc242\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446866    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-data\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446895    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-envoy\") pod \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\" (UID: \"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9\") "
Jul 24 20:21:39.446917 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446897    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:21:39.447234 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.446993    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:21:39.447234 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.447204    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:21:39.447346 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.447243    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:21:39.447346 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.447261    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.447346 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.447279    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.447630 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.447609    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:21:39.448791 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.448743    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:21:39.449291 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.449265    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:21:39.449377 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.449308    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-kube-api-access-xc242" (OuterVolumeSpecName: "kube-api-access-xc242") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "kube-api-access-xc242". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:21:39.449377 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.449323    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" (UID: "ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:21:39.548545 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.548520    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.548545 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.548542    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.548545 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.548551    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.548709 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.548559    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.548709 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.548567    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc242\" (UniqueName: \"kubernetes.io/projected/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-kube-api-access-xc242\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.548709 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.548576    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.548709 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.548584    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:21:39.828519 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.828437    2541 generic.go:356] "Generic (PLEG): container finished" podID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerID="11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f" exitCode=0
Jul 24 20:21:39.828519 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.828488    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"
Jul 24 20:21:39.828690 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.828523    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" event={"ID":"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9","Type":"ContainerDied","Data":"11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f"}
Jul 24 20:21:39.828690 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.828570    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf" event={"ID":"ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9","Type":"ContainerDied","Data":"c2f4f34d75be0fe70f8876a33b8f47ca123e14681820a8cb00c886ac5b0a78fd"}
Jul 24 20:21:39.828690 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.828593    2541 scope.go:117] "RemoveContainer" containerID="11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f"
Jul 24 20:21:39.838064 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.838045    2541 scope.go:117] "RemoveContainer" containerID="9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c"
Jul 24 20:21:39.849820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.849801    2541 scope.go:117] "RemoveContainer" containerID="11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f"
Jul 24 20:21:39.850103 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:21:39.850083    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f\": container with ID starting with 11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f not found: ID does not exist" containerID="11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f"
Jul 24 20:21:39.850197 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.850116    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f"} err="failed to get container status \"11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f\": rpc error: code = NotFound desc = could not find container \"11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f\": container with ID starting with 11ddf14408ae64468bae08ab03ff842e4bb4e7d32c740ec7edf57f5f40ef2a4f not found: ID does not exist"
Jul 24 20:21:39.850197 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.850141    2541 scope.go:117] "RemoveContainer" containerID="9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c"
Jul 24 20:21:39.850457 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:21:39.850437    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c\": container with ID starting with 9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c not found: ID does not exist" containerID="9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c"
Jul 24 20:21:39.850532 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.850463    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c"} err="failed to get container status \"9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c\": rpc error: code = NotFound desc = could not find container \"9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c\": container with ID starting with 9ad90026c6dcb7f72b70c9e23d10b984c5714de607549f9e10f9832984cc568c not found: ID does not exist"
Jul 24 20:21:39.851108 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.851088    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"]
Jul 24 20:21:39.854497 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:39.854477    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-712eee-openshift-default-58bd94f78-bcgjf"]
Jul 24 20:21:40.579184 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:21:40.579155    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" path="/var/lib/kubelet/pods/ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9/volumes"
Jul 24 20:22:51.243357 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:51.243323    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"]
Jul 24 20:22:51.243967 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:51.243574    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy" containerID="cri-o://12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc" gracePeriod=30
Jul 24 20:22:53.266354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:53.266309    2541 patch_prober.go:28] interesting pod/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 20:22:53.266735 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:53.266372    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:22:56.503450 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.503388    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:22:56.579305 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579281    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istiod-ca-cert\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579462 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579326    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-podinfo\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579462 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579350    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-envoy\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579485    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-token\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579541    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qrlr\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-kube-api-access-7qrlr\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579572    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-data\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579760 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579635    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-certs\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579760 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579683    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-socket\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.579760 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.579717    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-credential-socket\") pod \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\" (UID: \"62c358b6-7181-47cd-a3e9-0395aedbe4a7\") "
Jul 24 20:22:56.580408 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.580091    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:22:56.580408 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.580261    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:56.580590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.580410    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:56.580590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.580470    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:56.580810 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.580762    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:56.581611 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.581590    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:22:56.581882 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.581858    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-kube-api-access-7qrlr" (OuterVolumeSpecName: "kube-api-access-7qrlr") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "kube-api-access-7qrlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:22:56.582037 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.582017    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:56.582317 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.582295    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "62c358b6-7181-47cd-a3e9-0395aedbe4a7" (UID: "62c358b6-7181-47cd-a3e9-0395aedbe4a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:22:56.681211 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681181    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681211 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681208    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681222    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681234    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681246    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681258    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681271    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681283    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qrlr\" (UniqueName: \"kubernetes.io/projected/62c358b6-7181-47cd-a3e9-0395aedbe4a7-kube-api-access-7qrlr\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:56.681354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:56.681295    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62c358b6-7181-47cd-a3e9-0395aedbe4a7-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:22:57.231337 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.231302    2541 generic.go:356] "Generic (PLEG): container finished" podID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerID="12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc" exitCode=0
Jul 24 20:22:57.231508 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.231356    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"
Jul 24 20:22:57.231508 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.231362    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" event={"ID":"62c358b6-7181-47cd-a3e9-0395aedbe4a7","Type":"ContainerDied","Data":"12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc"}
Jul 24 20:22:57.231508 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.231415    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6" event={"ID":"62c358b6-7181-47cd-a3e9-0395aedbe4a7","Type":"ContainerDied","Data":"b2e5d777b85296c60fafa12b7826fe4ae42bc1032abef07bc03d0dda4e61b879"}
Jul 24 20:22:57.231508 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.231445    2541 scope.go:117] "RemoveContainer" containerID="12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc"
Jul 24 20:22:57.240855 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.240837    2541 scope.go:117] "RemoveContainer" containerID="ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be"
Jul 24 20:22:57.249023 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.249004    2541 scope.go:117] "RemoveContainer" containerID="12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc"
Jul 24 20:22:57.249259 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:22:57.249238    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc\": container with ID starting with 12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc not found: ID does not exist" containerID="12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc"
Jul 24 20:22:57.249320 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.249267    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc"} err="failed to get container status \"12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc\": rpc error: code = NotFound desc = could not find container \"12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc\": container with ID starting with 12a3560597dde13c8073979ea83ed2b5703d5ce40d5a65973c9aa7a70cde73dc not found: ID does not exist"
Jul 24 20:22:57.249320 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.249284    2541 scope.go:117] "RemoveContainer" containerID="ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be"
Jul 24 20:22:57.249510 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:22:57.249495    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be\": container with ID starting with ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be not found: ID does not exist" containerID="ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be"
Jul 24 20:22:57.249557 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.249514    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be"} err="failed to get container status \"ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be\": rpc error: code = NotFound desc = could not find container \"ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be\": container with ID starting with ee3456c89a6c4bfb5191990a3c0c054fdfa12444153c9fa821660e11615e57be not found: ID does not exist"
Jul 24 20:22:57.254074 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.254051    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"]
Jul 24 20:22:57.263085 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:57.259531    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-937547-openshift-default-6d86578b88-wxwp6"]
Jul 24 20:22:58.579025 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:22:58.578994    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" path="/var/lib/kubelet/pods/62c358b6-7181-47cd-a3e9-0395aedbe4a7/volumes"
Jul 24 20:23:13.007933 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:13.007901    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"]
Jul 24 20:23:13.008359 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:13.008142    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy" containerID="cri-o://4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d" gracePeriod=30
Jul 24 20:23:15.025732 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:15.025692    2541 patch_prober.go:28] interesting pod/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 20:23:15.026133 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:15.025763    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:23:18.258996 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.258973    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:23:18.342684 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.342564    2541 generic.go:356] "Generic (PLEG): container finished" podID="d40a9332-6d65-4511-a69d-248e04d65c73" containerID="4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d" exitCode=0
Jul 24 20:23:18.342684 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.342629    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"
Jul 24 20:23:18.342684 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.342648    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" event={"ID":"d40a9332-6d65-4511-a69d-248e04d65c73","Type":"ContainerDied","Data":"4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d"}
Jul 24 20:23:18.342916 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.342726    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw" event={"ID":"d40a9332-6d65-4511-a69d-248e04d65c73","Type":"ContainerDied","Data":"92b6a367fd2697cc987c77e038a2f000569d77df35544672ed24496dc4c773df"}
Jul 24 20:23:18.342916 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.342748    2541 scope.go:117] "RemoveContainer" containerID="4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d"
Jul 24 20:23:18.351383 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.351364    2541 scope.go:117] "RemoveContainer" containerID="13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e"
Jul 24 20:23:18.359156 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.359140    2541 scope.go:117] "RemoveContainer" containerID="4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d"
Jul 24 20:23:18.359399 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:23:18.359380    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d\": container with ID starting with 4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d not found: ID does not exist" containerID="4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d"
Jul 24 20:23:18.359456 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.359406    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d"} err="failed to get container status \"4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d\": rpc error: code = NotFound desc = could not find container \"4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d\": container with ID starting with 4ac6bdb93e4645707fff2084648d36eb80ea3ba7b4690d444e34e4c35fe5998d not found: ID does not exist"
Jul 24 20:23:18.359456 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.359423    2541 scope.go:117] "RemoveContainer" containerID="13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e"
Jul 24 20:23:18.359659 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:23:18.359641    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e\": container with ID starting with 13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e not found: ID does not exist" containerID="13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e"
Jul 24 20:23:18.359701 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.359668    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e"} err="failed to get container status \"13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e\": rpc error: code = NotFound desc = could not find container \"13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e\": container with ID starting with 13b424bf840c75fa82c3a355f4ba23deebc55bae241e58dc469c5e487559380e not found: ID does not exist"
Jul 24 20:23:18.365000 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.364982    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-envoy\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365070 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365010    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-certs\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365070 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365040    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d40a9332-6d65-4511-a69d-248e04d65c73-istiod-ca-cert\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365070 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365064    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjc5s\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-kube-api-access-bjc5s\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365198 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365088    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d40a9332-6d65-4511-a69d-248e04d65c73-istio-podinfo\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365198 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365118    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-data\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365198 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365172    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-credential-socket\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365342 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365255    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:18.365342 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365265    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-istio-token\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365452 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365344    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-socket\") pod \"d40a9332-6d65-4511-a69d-248e04d65c73\" (UID: \"d40a9332-6d65-4511-a69d-248e04d65c73\") "
Jul 24 20:23:18.365452 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365412    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40a9332-6d65-4511-a69d-248e04d65c73-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:23:18.365634 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365598    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:18.365702 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365643    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:18.365809 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365790    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d40a9332-6d65-4511-a69d-248e04d65c73-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.365871 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365815    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.365871 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.365830    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.366209 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.366189    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-data" (OuterVolumeSpecName: "istio-data") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:18.367041 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.367021    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:18.367216 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.367195    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-kube-api-access-bjc5s" (OuterVolumeSpecName: "kube-api-access-bjc5s") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "kube-api-access-bjc5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:23:18.367583 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.367554    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d40a9332-6d65-4511-a69d-248e04d65c73-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:23:18.367583 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.367565    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-istio-token" (OuterVolumeSpecName: "istio-token") pod "d40a9332-6d65-4511-a69d-248e04d65c73" (UID: "d40a9332-6d65-4511-a69d-248e04d65c73"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:23:18.466622 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.466598    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.466622 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.466620    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjc5s\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-kube-api-access-bjc5s\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.466785 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.466630    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d40a9332-6d65-4511-a69d-248e04d65c73-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.466785 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.466639    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.466785 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.466647    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d40a9332-6d65-4511-a69d-248e04d65c73-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.466785 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.466654    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d40a9332-6d65-4511-a69d-248e04d65c73-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:18.659407 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.659383    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"]
Jul 24 20:23:18.664472 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:18.664449    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-307a30-openshift-default-55c7fd5944-7z5pw"]
Jul 24 20:23:20.579813 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:20.579783    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" path="/var/lib/kubelet/pods/d40a9332-6d65-4511-a69d-248e04d65c73/volumes"
Jul 24 20:23:23.851978 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:23.851938    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"]
Jul 24 20:23:23.854850 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:23.854822    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-53d0a0-29748735-xbp6j"]
Jul 24 20:23:24.579638 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:24.579611    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323c214d-b4b5-4f64-bfdd-6e3c99862d7d" path="/var/lib/kubelet/pods/323c214d-b4b5-4f64-bfdd-6e3c99862d7d/volumes"
Jul 24 20:23:34.892727 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:34.892686    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"]
Jul 24 20:23:34.893153 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:34.892920    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy" containerID="cri-o://1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61" gracePeriod=30
Jul 24 20:23:40.143110 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.143086    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:23:40.240257 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240192    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-token\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240257 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240225    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lhpc\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-kube-api-access-2lhpc\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240280    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-data\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240302    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-envoy\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240328    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-socket\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240346    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istiod-ca-cert\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240362    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-podinfo\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240448 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240439    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-certs\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240757 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240472    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-credential-socket\") pod \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\" (UID: \"7eb71dd8-2f94-48ef-b993-2d8256043d9b\") "
Jul 24 20:23:40.240757 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240709    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:40.240906 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240840    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:40.240964 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.240936    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:40.241163 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.241142    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:40.241255 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.241235    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:23:40.242874 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.242846    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:23:40.242874 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.242850    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:23:40.243001 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.242872    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-kube-api-access-2lhpc" (OuterVolumeSpecName: "kube-api-access-2lhpc") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "kube-api-access-2lhpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:23:40.243001 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.242962    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7eb71dd8-2f94-48ef-b993-2d8256043d9b" (UID: "7eb71dd8-2f94-48ef-b993-2d8256043d9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:23:40.341116 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341095    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341116 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341114    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341266 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341123    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341266 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341132    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341266 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341140    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341266 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341148    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341266 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341157    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7eb71dd8-2f94-48ef-b993-2d8256043d9b-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341266 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341165    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.341266 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.341173    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lhpc\" (UniqueName: \"kubernetes.io/projected/7eb71dd8-2f94-48ef-b993-2d8256043d9b-kube-api-access-2lhpc\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:23:40.457473 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.457446    2541 generic.go:356] "Generic (PLEG): container finished" podID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerID="1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61" exitCode=0
Jul 24 20:23:40.457578 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.457486    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"
Jul 24 20:23:40.457578 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.457521    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" event={"ID":"7eb71dd8-2f94-48ef-b993-2d8256043d9b","Type":"ContainerDied","Data":"1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61"}
Jul 24 20:23:40.457578 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.457564    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll" event={"ID":"7eb71dd8-2f94-48ef-b993-2d8256043d9b","Type":"ContainerDied","Data":"6432869ff30c3819e88e542832734715d133551d425abe83e5c2bf3af9ad473c"}
Jul 24 20:23:40.457700 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.457587    2541 scope.go:117] "RemoveContainer" containerID="1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61"
Jul 24 20:23:40.466999 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.466980    2541 scope.go:117] "RemoveContainer" containerID="4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749"
Jul 24 20:23:40.474840 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.474821    2541 scope.go:117] "RemoveContainer" containerID="1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61"
Jul 24 20:23:40.475090 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:23:40.475071    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61\": container with ID starting with 1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61 not found: ID does not exist" containerID="1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61"
Jul 24 20:23:40.475163 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.475101    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61"} err="failed to get container status \"1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61\": rpc error: code = NotFound desc = could not find container \"1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61\": container with ID starting with 1fcd14b6bd7a23458d4587858b6bff9bdeeb3a5755c4c43948c0ac2b189d6b61 not found: ID does not exist"
Jul 24 20:23:40.475163 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.475126    2541 scope.go:117] "RemoveContainer" containerID="4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749"
Jul 24 20:23:40.475355 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:23:40.475339    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749\": container with ID starting with 4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749 not found: ID does not exist" containerID="4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749"
Jul 24 20:23:40.475398 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.475360    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749"} err="failed to get container status \"4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749\": rpc error: code = NotFound desc = could not find container \"4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749\": container with ID starting with 4ae200e4becd7c2b9baa7fb2d0d82e289e0395559011b7421fadb06081d73749 not found: ID does not exist"
Jul 24 20:23:40.479651 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.479631    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"]
Jul 24 20:23:40.485170 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.485147    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-53d0a0-openshift-default-59696574dd-bn5ll"]
Jul 24 20:23:40.579336 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:40.579283    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" path="/var/lib/kubelet/pods/7eb71dd8-2f94-48ef-b993-2d8256043d9b/volumes"
Jul 24 20:23:45.855346 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:45.855216    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"]
Jul 24 20:23:45.861576 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:45.861553    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3f5fc9-29748735-nbx2n"]
Jul 24 20:23:46.578667 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:46.578626    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4634455d-b0ed-4c99-84f6-2f17a7b59942" path="/var/lib/kubelet/pods/4634455d-b0ed-4c99-84f6-2f17a7b59942/volumes"
Jul 24 20:23:56.630508 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:56.630477    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"]
Jul 24 20:23:56.631063 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:23:56.630686    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy" containerID="cri-o://223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af" gracePeriod=30
Jul 24 20:24:01.886730 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.886704    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:24:01.909178 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909089    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-data\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909178 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909140    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-certs\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909185    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istiod-ca-cert\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909236    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-credential-socket\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909267    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-socket\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909322    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-envoy\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909420    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-token\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909458    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909494    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b66gs\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-kube-api-access-b66gs\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.909518 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909531    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-podinfo\") pod \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\" (UID: \"4dcfd2bc-0f7e-4e70-8432-8e875b575172\") "
Jul 24 20:24:01.910066 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909814    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:24:01.910066 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909861    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:24:01.910066 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909911    2541 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:01.910066 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.909929    2541 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-workload-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:01.910272 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.910138    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:24:01.910640 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.910603    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-data" (OuterVolumeSpecName: "istio-data") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:24:01.912250 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.912224    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:24:01.912474 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.912449    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:24:01.912644 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.912612    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-kube-api-access-b66gs" (OuterVolumeSpecName: "kube-api-access-b66gs") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "kube-api-access-b66gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:24:01.912761 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:01.912731    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-token" (OuterVolumeSpecName: "istio-token") pod "4dcfd2bc-0f7e-4e70-8432-8e875b575172" (UID: "4dcfd2bc-0f7e-4e70-8432-8e875b575172"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:24:02.011268 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.011245    2541 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istiod-ca-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:02.011268 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.011268    2541 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-credential-socket\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:02.011402 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.011279    2541 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-envoy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:02.011402 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.011289    2541 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:02.011402 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.011297    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b66gs\" (UniqueName: \"kubernetes.io/projected/4dcfd2bc-0f7e-4e70-8432-8e875b575172-kube-api-access-b66gs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:02.011402 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.011305    2541 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-podinfo\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:02.011402 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.011313    2541 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd2bc-0f7e-4e70-8432-8e875b575172-istio-data\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 24 20:24:02.573395 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.573364    2541 generic.go:356] "Generic (PLEG): container finished" podID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerID="223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af" exitCode=0
Jul 24 20:24:02.573553 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.573478    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"
Jul 24 20:24:02.578093 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.578070    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" event={"ID":"4dcfd2bc-0f7e-4e70-8432-8e875b575172","Type":"ContainerDied","Data":"223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af"}
Jul 24 20:24:02.578204 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.578110    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl" event={"ID":"4dcfd2bc-0f7e-4e70-8432-8e875b575172","Type":"ContainerDied","Data":"bf55762bfdf01719f23bd3d3972fd50fac984ed82040c419e3e0fa98020bf8a1"}
Jul 24 20:24:02.578204 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.578131    2541 scope.go:117] "RemoveContainer" containerID="223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af"
Jul 24 20:24:02.587670 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.587655    2541 scope.go:117] "RemoveContainer" containerID="a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80"
Jul 24 20:24:02.595727 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.595710    2541 scope.go:117] "RemoveContainer" containerID="223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af"
Jul 24 20:24:02.596016 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:24:02.595998    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af\": container with ID starting with 223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af not found: ID does not exist" containerID="223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af"
Jul 24 20:24:02.596083 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.596022    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af"} err="failed to get container status \"223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af\": rpc error: code = NotFound desc = could not find container \"223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af\": container with ID starting with 223fd3ec94e858779d26c7a3946656289c13fa615cdbb59edb658c618cdad6af not found: ID does not exist"
Jul 24 20:24:02.596083 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.596079    2541 scope.go:117] "RemoveContainer" containerID="a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80"
Jul 24 20:24:02.596494 ip-10-0-140-118 kubenswrapper[2541]: E0724 20:24:02.596389    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80\": container with ID starting with a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80 not found: ID does not exist" containerID="a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80"
Jul 24 20:24:02.596494 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.596451    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80"} err="failed to get container status \"a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80\": rpc error: code = NotFound desc = could not find container \"a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80\": container with ID starting with a314deb8e4b9426f4bfdb813f69f42817227ad421147234d328afcde6df4ff80 not found: ID does not exist"
Jul 24 20:24:02.599073 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.599056    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"]
Jul 24 20:24:02.602299 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:02.602279    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-3f5fc9-openshift-default-8675f4db9b-hpbvl"]
Jul 24 20:24:03.503418 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:03.503393    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-ps64d_c0234b6e-f8f0-4908-86e1-7d050b038bfc/copy-manifests/0.log"
Jul 24 20:24:03.509359 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:03.509339    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-ps64d_c0234b6e-f8f0-4908-86e1-7d050b038bfc/manager/0.log"
Jul 24 20:24:04.081790 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:04.081745    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748720-4w495_c08e593b-bc3c-4036-935f-62fef9d8173b/cleanup/0.log"
Jul 24 20:24:04.189314 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:04.189285    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748735-mfmg5_fbeb07ff-f03b-4740-89a5-de206728f5cd/cleanup/0.log"
Jul 24 20:24:04.578547 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:04.578517    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" path="/var/lib/kubelet/pods/4dcfd2bc-0f7e-4e70-8432-8e875b575172/volumes"
Jul 24 20:24:05.057541 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.057509    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx_7e94b4dc-3766-4322-952e-8924024f78b0/extract/0.log"
Jul 24 20:24:05.063154 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.063128    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx_7e94b4dc-3766-4322-952e-8924024f78b0/util/0.log"
Jul 24 20:24:05.069017 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.068991    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx_7e94b4dc-3766-4322-952e-8924024f78b0/pull/0.log"
Jul 24 20:24:05.178847 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.178827    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4_9ecc686e-0fbd-4c21-b859-b586cb8156d3/util/0.log"
Jul 24 20:24:05.184316 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.184297    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4_9ecc686e-0fbd-4c21-b859-b586cb8156d3/pull/0.log"
Jul 24 20:24:05.189375 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.189340    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4_9ecc686e-0fbd-4c21-b859-b586cb8156d3/extract/0.log"
Jul 24 20:24:05.293946 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.293923    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg_7ca6c34b-4059-40c9-b09f-7ed0f5270a3c/util/0.log"
Jul 24 20:24:05.299195 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.299176    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg_7ca6c34b-4059-40c9-b09f-7ed0f5270a3c/pull/0.log"
Jul 24 20:24:05.304377 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.304362    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg_7ca6c34b-4059-40c9-b09f-7ed0f5270a3c/extract/0.log"
Jul 24 20:24:05.417189 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.417171    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq_e6a02b5d-ce02-44c2-97a5-3b7a7408ec42/extract/0.log"
Jul 24 20:24:05.422375 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.422358    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq_e6a02b5d-ce02-44c2-97a5-3b7a7408ec42/util/0.log"
Jul 24 20:24:05.427973 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:05.427956    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq_e6a02b5d-ce02-44c2-97a5-3b7a7408ec42/pull/0.log"
Jul 24 20:24:06.698614 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:06.698587    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh_b412459d-b352-48dd-9d2f-56e2b1ee6ea7/istio-proxy/0.log"
Jul 24 20:24:06.812194 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:06.812157    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zpzpz_567e225a-8961-453e-bc5b-3272a9e8d31b/discovery/0.log"
Jul 24 20:24:07.139215 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:07.139188    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hkv8r_4d049fad-be2e-474b-98a4-4ad2e2071398/istio-proxy/1.log"
Jul 24 20:24:07.503134 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:07.503063    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7895ff9947-rjb69_453dc48a-2e5e-4a9d-93b0-ab62e2128529/router/0.log"
Jul 24 20:24:07.841795 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:07.841720    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-22kz6_4bd6c6d4-8ac3-437d-8be4-bef26943dc4c/main/0.log"
Jul 24 20:24:08.189821 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:08.189794    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhglnw_96255f72-ae19-440c-9010-d671225ab508/main/0.log"
Jul 24 20:24:16.822274 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:16.822243    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-56r2d_459ff394-f5bd-4502-b106-c57e6f6cb884/global-pull-secret-syncer/0.log"
Jul 24 20:24:17.019279 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:17.019249    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vkxlc_bccf34b6-e75f-4764-8977-363456c349e6/konnectivity-agent/0.log"
Jul 24 20:24:17.082105 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:17.082034    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-118.ec2.internal_2361c9c159847def10336548e796fbdb/haproxy/0.log"
Jul 24 20:24:20.989094 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:20.989062    2541 scope.go:117] "RemoveContainer" containerID="33a75ef7b4fe9c22142754dbb26fc975883e96c571b5c015b1aefc4e62a7fd44"
Jul 24 20:24:20.996831 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:20.996812    2541 scope.go:117] "RemoveContainer" containerID="52db7abf7f9fa503526080a56fd117d68174425be1efed90cb6014fee65ba3f2"
Jul 24 20:24:21.800962 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.800937    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx_7e94b4dc-3766-4322-952e-8924024f78b0/extract/0.log"
Jul 24 20:24:21.819443 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.819415    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx_7e94b4dc-3766-4322-952e-8924024f78b0/util/0.log"
Jul 24 20:24:21.843011 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.842992    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759glgsx_7e94b4dc-3766-4322-952e-8924024f78b0/pull/0.log"
Jul 24 20:24:21.882025 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.882004    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4_9ecc686e-0fbd-4c21-b859-b586cb8156d3/extract/0.log"
Jul 24 20:24:21.904182 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.904158    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4_9ecc686e-0fbd-4c21-b859-b586cb8156d3/util/0.log"
Jul 24 20:24:21.923296 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.923276    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jwsp4_9ecc686e-0fbd-4c21-b859-b586cb8156d3/pull/0.log"
Jul 24 20:24:21.946997 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.946979    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg_7ca6c34b-4059-40c9-b09f-7ed0f5270a3c/extract/0.log"
Jul 24 20:24:21.971203 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.971185    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg_7ca6c34b-4059-40c9-b09f-7ed0f5270a3c/util/0.log"
Jul 24 20:24:21.996776 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:21.996756    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dqkrg_7ca6c34b-4059-40c9-b09f-7ed0f5270a3c/pull/0.log"
Jul 24 20:24:22.035108 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:22.035091    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq_e6a02b5d-ce02-44c2-97a5-3b7a7408ec42/extract/0.log"
Jul 24 20:24:22.060354 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:22.060305    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq_e6a02b5d-ce02-44c2-97a5-3b7a7408ec42/util/0.log"
Jul 24 20:24:22.078414 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:22.078397    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15cmdq_e6a02b5d-ce02-44c2-97a5-3b7a7408ec42/pull/0.log"
Jul 24 20:24:25.417067 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:25.417040    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4g2d_f8a47109-1268-4f5f-83ba-ed38022a2741/node-exporter/0.log"
Jul 24 20:24:25.436459 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:25.436434    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4g2d_f8a47109-1268-4f5f-83ba-ed38022a2741/kube-rbac-proxy/0.log"
Jul 24 20:24:25.461253 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:25.461232    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4g2d_f8a47109-1268-4f5f-83ba-ed38022a2741/init-textfile/0.log"
Jul 24 20:24:25.840421 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:25.840351    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66fc67dbb6-q4p78_1af033a3-8b36-4bc8-b544-0ffce21172ec/telemeter-client/0.log"
Jul 24 20:24:25.859520 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:25.859501    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66fc67dbb6-q4p78_1af033a3-8b36-4bc8-b544-0ffce21172ec/reload/0.log"
Jul 24 20:24:25.878497 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:25.878473    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66fc67dbb6-q4p78_1af033a3-8b36-4bc8-b544-0ffce21172ec/kube-rbac-proxy/0.log"
Jul 24 20:24:26.811367 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811327    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"]
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811705    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811718    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811727    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811732    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811741    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811747    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811752    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811758    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811777    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811783    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811792    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811797    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811806    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811812    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy"
Jul 24 20:24:26.811820 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811825    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811832    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811878    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811884    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3a0e5f-40af-4b6c-9da1-2db70cae8cb9" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811891    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811897    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811902    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcfd2bc-0f7e-4e70-8432-8e875b575172" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811907    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811911    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eb71dd8-2f94-48ef-b993-2d8256043d9b" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811916    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40a9332-6d65-4511-a69d-248e04d65c73" containerName="istio-proxy"
Jul 24 20:24:26.812265 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.811922    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c358b6-7181-47cd-a3e9-0395aedbe4a7" containerName="istio-proxy"
Jul 24 20:24:26.816557 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.816538    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.819144 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.819121    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzgtx\"/\"kube-root-ca.crt\""
Jul 24 20:24:26.820532 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.820437    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gzgtx\"/\"default-dockercfg-q9hgm\""
Jul 24 20:24:26.820637 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.820556    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzgtx\"/\"openshift-service-ca.crt\""
Jul 24 20:24:26.824334 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.824269    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"]
Jul 24 20:24:26.893812 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.893789    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-proc\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.893946 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.893819    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-sys\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.893946 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.893853    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-lib-modules\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.893946 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.893932    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qhfj\" (UniqueName: \"kubernetes.io/projected/10d88744-c64e-4277-8260-11e867532a95-kube-api-access-4qhfj\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.894103 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.893972    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-podres\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994618 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994591    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-lib-modules\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994622    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qhfj\" (UniqueName: \"kubernetes.io/projected/10d88744-c64e-4277-8260-11e867532a95-kube-api-access-4qhfj\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994644    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-podres\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994719 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994694    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-proc\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994920 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994722    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-sys\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994920 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994794    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-lib-modules\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994920 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994827    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-proc\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994920 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994835    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-sys\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:26.994920 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:26.994866    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10d88744-c64e-4277-8260-11e867532a95-podres\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:27.002640 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.002614    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qhfj\" (UniqueName: \"kubernetes.io/projected/10d88744-c64e-4277-8260-11e867532a95-kube-api-access-4qhfj\") pod \"perf-node-gather-daemonset-r77zm\" (UID: \"10d88744-c64e-4277-8260-11e867532a95\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:27.109245 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.109191    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-xqpsq_0e0d134e-308b-4c18-8bd3-fdfc04c38d0f/networking-console-plugin/0.log"
Jul 24 20:24:27.127014 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.126992    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:27.254925 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.254900    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"]
Jul 24 20:24:27.256522 ip-10-0-140-118 kubenswrapper[2541]: W0724 20:24:27.256490    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod10d88744_c64e_4277_8260_11e867532a95.slice/crio-f6b969a58bcf60f3b7780f9f946c6167e0d6112421e1b09c55ae3fd3d5f49880 WatchSource:0}: Error finding container f6b969a58bcf60f3b7780f9f946c6167e0d6112421e1b09c55ae3fd3d5f49880: Status 404 returned error can't find the container with id f6b969a58bcf60f3b7780f9f946c6167e0d6112421e1b09c55ae3fd3d5f49880
Jul 24 20:24:27.693205 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.693175    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm" event={"ID":"10d88744-c64e-4277-8260-11e867532a95","Type":"ContainerStarted","Data":"f85c2a4dcb6d6f6c43b3a7ed10384b5818dcda49a609a6269bb953c94faa457b"}
Jul 24 20:24:27.693393 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.693230    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm" event={"ID":"10d88744-c64e-4277-8260-11e867532a95","Type":"ContainerStarted","Data":"f6b969a58bcf60f3b7780f9f946c6167e0d6112421e1b09c55ae3fd3d5f49880"}
Jul 24 20:24:27.693393 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.693280    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:27.709842 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:27.709801    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm" podStartSLOduration=1.709787736 podStartE2EDuration="1.709787736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:24:27.708067163 +0000 UTC m=+3007.832406338" watchObservedRunningTime="2026-07-24 20:24:27.709787736 +0000 UTC m=+3007.834126889"
Jul 24 20:24:29.837124 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:29.837075    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vfbx8_625809e2-a447-47cc-8855-1258e486fb87/dns/0.log"
Jul 24 20:24:29.855831 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:29.855810    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vfbx8_625809e2-a447-47cc-8855-1258e486fb87/kube-rbac-proxy/0.log"
Jul 24 20:24:29.883421 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:29.883396    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-276zs_02036468-9e21-4e65-aa8a-cff992d3d777/dns-node-resolver/0.log"
Jul 24 20:24:30.571635 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:30.571603    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4qpn_bb3d1179-ce80-4527-b6f6-5719469a8ab2/node-ca/0.log"
Jul 24 20:24:31.471180 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:31.471154    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh_b412459d-b352-48dd-9d2f-56e2b1ee6ea7/istio-proxy/0.log"
Jul 24 20:24:31.610383 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:31.610351    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zpzpz_567e225a-8961-453e-bc5b-3272a9e8d31b/discovery/0.log"
Jul 24 20:24:31.683203 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:31.683173    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hkv8r_4d049fad-be2e-474b-98a4-4ad2e2071398/istio-proxy/0.log"
Jul 24 20:24:31.706842 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:31.706816    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hkv8r_4d049fad-be2e-474b-98a4-4ad2e2071398/istio-proxy/1.log"
Jul 24 20:24:31.797052 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:31.796978    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7895ff9947-rjb69_453dc48a-2e5e-4a9d-93b0-ab62e2128529/router/0.log"
Jul 24 20:24:32.654350 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:32.654316    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwvmj_181d01dd-6034-4e63-85d3-9179c8d28f59/serve-healthcheck-canary/0.log"
Jul 24 20:24:33.199312 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:33.199285    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxhm6_9ff9555a-9a1f-48da-b6d2-d62bde051d0c/kube-rbac-proxy/0.log"
Jul 24 20:24:33.218455 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:33.218433    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxhm6_9ff9555a-9a1f-48da-b6d2-d62bde051d0c/exporter/0.log"
Jul 24 20:24:33.236848 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:33.236827    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxhm6_9ff9555a-9a1f-48da-b6d2-d62bde051d0c/extractor/0.log"
Jul 24 20:24:33.707474 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:33.707448    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-r77zm"
Jul 24 20:24:36.423211 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:36.423185    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-ps64d_c0234b6e-f8f0-4908-86e1-7d050b038bfc/manager/0.log"
Jul 24 20:24:36.441590 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:36.441569    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-ps64d_c0234b6e-f8f0-4908-86e1-7d050b038bfc/copy-manifests/0.log"
Jul 24 20:24:37.918032 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:37.918003    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c7b4484d8-ttk9f_22edf87e-e433-40a2-9283-f18fbe8d2d1d/manager/0.log"
Jul 24 20:24:37.940239 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:37.940218    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh_b412459d-b352-48dd-9d2f-56e2b1ee6ea7/istio-proxy/0.log"
Jul 24 20:24:38.065720 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:38.065691    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zpzpz_567e225a-8961-453e-bc5b-3272a9e8d31b/discovery/0.log"
Jul 24 20:24:38.114387 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:38.114368    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hkv8r_4d049fad-be2e-474b-98a4-4ad2e2071398/istio-proxy/0.log"
Jul 24 20:24:38.141166 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:38.141145    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hkv8r_4d049fad-be2e-474b-98a4-4ad2e2071398/istio-proxy/1.log"
Jul 24 20:24:38.206551 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:38.206487    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7895ff9947-rjb69_453dc48a-2e5e-4a9d-93b0-ab62e2128529/router/0.log"
Jul 24 20:24:39.536069 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:39.536038    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xzgxh_b412459d-b352-48dd-9d2f-56e2b1ee6ea7/istio-proxy/0.log"
Jul 24 20:24:39.678753 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:39.678726    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zpzpz_567e225a-8961-453e-bc5b-3272a9e8d31b/discovery/0.log"
Jul 24 20:24:39.723179 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:39.723151    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hkv8r_4d049fad-be2e-474b-98a4-4ad2e2071398/istio-proxy/0.log"
Jul 24 20:24:39.751269 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:39.751235    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hkv8r_4d049fad-be2e-474b-98a4-4ad2e2071398/istio-proxy/1.log"
Jul 24 20:24:39.819603 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:39.819585    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7895ff9947-rjb69_453dc48a-2e5e-4a9d-93b0-ab62e2128529/router/0.log"
Jul 24 20:24:42.793476 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:42.793445    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-68f64_dfcf4df2-7216-47cd-a79e-d2e0d8d38997/migrator/0.log"
Jul 24 20:24:42.821264 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:42.821238    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-68f64_dfcf4df2-7216-47cd-a79e-d2e0d8d38997/graceful-termination/0.log"
Jul 24 20:24:43.251031 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:43.251000    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd_66168002-0b89-4954-8ab3-c6a54de37249/kube-storage-version-migrator-operator/1.log"
Jul 24 20:24:43.251866 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:43.251846    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-76rxd_66168002-0b89-4954-8ab3-c6a54de37249/kube-storage-version-migrator-operator/0.log"
Jul 24 20:24:44.249864 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.249834    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4zznj_fee7909a-f7dd-401a-b862-7803a4934e3b/kube-multus/0.log"
Jul 24 20:24:44.273284 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.273262    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwp5p_2ddd4a06-4cec-41af-a784-2249b3e39fa5/kube-multus-additional-cni-plugins/0.log"
Jul 24 20:24:44.291529 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.291504    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwp5p_2ddd4a06-4cec-41af-a784-2249b3e39fa5/egress-router-binary-copy/0.log"
Jul 24 20:24:44.310206 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.310186    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwp5p_2ddd4a06-4cec-41af-a784-2249b3e39fa5/cni-plugins/0.log"
Jul 24 20:24:44.328136 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.328117    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwp5p_2ddd4a06-4cec-41af-a784-2249b3e39fa5/bond-cni-plugin/0.log"
Jul 24 20:24:44.347017 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.347000    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwp5p_2ddd4a06-4cec-41af-a784-2249b3e39fa5/routeoverride-cni/0.log"
Jul 24 20:24:44.368878 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.368858    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwp5p_2ddd4a06-4cec-41af-a784-2249b3e39fa5/whereabouts-cni-bincopy/0.log"
Jul 24 20:24:44.386491 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.386473    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gwp5p_2ddd4a06-4cec-41af-a784-2249b3e39fa5/whereabouts-cni/0.log"
Jul 24 20:24:44.869530 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.869505    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pbgmc_77763871-5b8d-4026-b916-770abf823589/network-metrics-daemon/0.log"
Jul 24 20:24:44.886504 ip-10-0-140-118 kubenswrapper[2541]: I0724 20:24:44.886479    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pbgmc_77763871-5b8d-4026-b916-770abf823589/kube-rbac-proxy/0.log"